-- Logs begin at Tue 2022-10-04 13:46:49 UTC, end at Tue 2022-10-04 14:51:02 UTC. -- Oct 04 14:13:09.407647 dv-cinder-860260-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 04 14:13:09.418047 dv-cinder-860260-1-smb devstack@keystone.service[81455]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 04 14:13:09.420198 dv-cinder-860260-1-smb devstack@keystone.service[81455]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 14:13:09 2022] *** Oct 04 14:13:09.420198 dv-cinder-860260-1-smb devstack@keystone.service[81455]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 14:13:09.420198 dv-cinder-860260-1-smb devstack@keystone.service[81455]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 14:13:09.420198 dv-cinder-860260-1-smb devstack@keystone.service[81455]: nodename: dv-cinder-860260-1-smb Oct 04 14:13:09.420198 dv-cinder-860260-1-smb devstack@keystone.service[81455]: machine: x86_64 Oct 04 14:13:09.420198 dv-cinder-860260-1-smb devstack@keystone.service[81455]: clock source: unix Oct 04 14:13:09.420198 dv-cinder-860260-1-smb devstack@keystone.service[81455]: pcre jit disabled Oct 04 14:13:09.420198 dv-cinder-860260-1-smb devstack@keystone.service[81455]: detected number of CPU cores: 4 Oct 04 14:13:09.420198 dv-cinder-860260-1-smb devstack@keystone.service[81455]: current working directory: / Oct 04 14:13:09.420198 dv-cinder-860260-1-smb devstack@keystone.service[81455]: detected binary path: /usr/bin/uwsgi-core Oct 04 14:13:09.420198 dv-cinder-860260-1-smb devstack@keystone.service[81455]: your processes number limit is 47680 Oct 04 14:13:09.420198 dv-cinder-860260-1-smb devstack@keystone.service[81455]: your memory page size is 4096 bytes Oct 04 14:13:09.420198 dv-cinder-860260-1-smb devstack@keystone.service[81455]: detected max file descriptor number: 2048 Oct 04 14:13:09.420198 dv-cinder-860260-1-smb devstack@keystone.service[81455]: lock engine: pthread robust mutexes Oct 04 14:13:09.421508 dv-cinder-860260-1-smb devstack@keystone.service[81455]: thunder lock: enabled Oct 04 14:13:09.421508 dv-cinder-860260-1-smb devstack@keystone.service[81455]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 04 14:13:09.421508 dv-cinder-860260-1-smb devstack@keystone.service[81455]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 14:13:09.461143 dv-cinder-860260-1-smb devstack@keystone.service[81455]: Python main interpreter initialized at 0x55fd226859c0 Oct 04 14:13:09.461143 dv-cinder-860260-1-smb devstack@keystone.service[81455]: python threads support enabled Oct 04 14:13:09.461143 dv-cinder-860260-1-smb devstack@keystone.service[81455]: your server socket listen backlog is limited to 100 connections Oct 04 14:13:09.461143 dv-cinder-860260-1-smb devstack@keystone.service[81455]: your mercy for graceful operations on workers is 90 seconds Oct 04 14:13:09.461693 dv-cinder-860260-1-smb devstack@keystone.service[81455]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 14:13:09.461693 dv-cinder-860260-1-smb devstack@keystone.service[81455]: *** Operational MODE: preforking *** Oct 04 14:13:09.461900 dv-cinder-860260-1-smb devstack@keystone.service[81455]: *** uWSGI is running in multiple interpreter mode *** Oct 04 14:13:09.461900 dv-cinder-860260-1-smb devstack@keystone.service[81455]: spawned uWSGI master process (pid: 81455) Oct 04 14:13:09.462142 dv-cinder-860260-1-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 04 14:13:09.463236 dv-cinder-860260-1-smb devstack@keystone.service[81455]: spawned uWSGI worker 1 (pid: 81467, cores: 1) Oct 04 14:13:09.463236 dv-cinder-860260-1-smb devstack@keystone.service[81455]: spawned uWSGI worker 2 (pid: 81468, cores: 1) Oct 04 14:13:09.463236 dv-cinder-860260-1-smb devstack@keystone.service[81455]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 14:13:14.046676 dv-cinder-860260-1-smb devstack@keystone.service[81467]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 14:13:14.046676 dv-cinder-860260-1-smb devstack@keystone.service[81467]: from cryptography.utils import int_from_bytes Oct 04 14:13:14.047500 dv-cinder-860260-1-smb devstack@keystone.service[81467]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 14:13:14.047500 dv-cinder-860260-1-smb devstack@keystone.service[81467]: from cryptography.utils import int_from_bytes Oct 04 14:13:14.078110 dv-cinder-860260-1-smb devstack@keystone.service[81468]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 14:13:14.078110 dv-cinder-860260-1-smb devstack@keystone.service[81468]: from cryptography.utils import int_from_bytes Oct 04 14:13:14.078820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 14:13:14.078820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: from cryptography.utils import int_from_bytes Oct 04 14:13:14.100620 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 14:13:14.100848 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 14:13:14.100984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] command line args: [] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 14:13:14.101254 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 14:13:14.101433 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ================================================================================ {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 14:13:14.101681 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] admin_token = **** {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.101937 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] config_dir = [] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.102126 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.102304 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] config_source = [] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.102483 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] debug = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.102677 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.103045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.103222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.103475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.103746 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.103974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] list_limit = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.104150 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] log_config_append = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.104318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.104493 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] log_dir = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.104668 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] log_file = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.104904 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.105153 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.105399 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.105640 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.105798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.105974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.106219 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.106461 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.106686 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.106921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.107149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.107372 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.107612 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.107879 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.108158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.108664 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.108885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] publish_errors = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.109098 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.109421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.109621 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.109947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.110183 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.110416 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] standard_threads = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.110642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.110884 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.111056 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.111230 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] use_journal = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.111407 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] use_json = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.111577 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] use_stderr = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.111776 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] use_syslog = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.112011 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.112266 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.112504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.112760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.113574 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.113867 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.114112 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.114359 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.114593 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.114906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.115153 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.115396 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.115631 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.115901 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.116137 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.116381 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.116630 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.116861 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.117112 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.117363 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.117613 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.117846 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.118233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.118424 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.118599 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.118940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.119211 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.119535 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.119790 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.120030 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.120280 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.120527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.120755 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.120982 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.121227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.121472 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.121714 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.121958 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.122185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.122412 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.122643 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.122871 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.123097 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.123323 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.123548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.123800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.124045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.124274 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.124510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.124738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.124964 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.125198 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.125440 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.125666 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.125899 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.126132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.126363 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.126595 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.126824 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.127049 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.127295 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.127517 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.127768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.127999 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.128089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 14:13:14.128263 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.128413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 14:13:14.128570 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] command line args: [] {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 14:13:14.128699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.128831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.128961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 14:13:14.128961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ================================================================================ {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 14:13:14.129219 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.129351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] admin_token = **** {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.129490 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.129630 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] config_dir = [] {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.129771 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.129911 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.130050 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.130186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] config_source = [] {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.130323 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.130462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] debug = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.130462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.130783 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.130870 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.131013 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.131095 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.131217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.131296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.131379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.131454 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.131533 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.131606 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] list_limit = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.131685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.131793 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] log_config_append = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.131881 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.131956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.131956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] log_dir = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.132089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.132160 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] log_file = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.132239 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.132312 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.132383 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.132453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.132524 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.132595 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.132676 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.132755 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.132829 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.132900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.133009 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.133090 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.133241 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.133323 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.133500 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.133613 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.133738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.133818 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.133967 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.134054 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.134199 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.134279 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.134429 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.134511 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.134664 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.134746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.134895 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.134979 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.135127 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.135234 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.135391 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.135574 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.135653 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.135820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.135961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] publish_errors = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.136090 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.136217 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.136351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.136438 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.136513 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.136645 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.136731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.136805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.136911 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.136992 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.137147 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] standard_threads = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.137236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.137377 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.137479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.137618 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.137715 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.137795 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.137900 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.137981 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] use_journal = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.138096 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.138184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] use_json = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.138258 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] use_stderr = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.138340 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] auth.external = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.138436 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] use_syslog = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.138537 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.138671 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:13:14.138831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.139071 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.139262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.139443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.139600 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] auth.password = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.139769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.139876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] auth.token = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.139996 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.140171 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.140363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.140474 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.140618 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.140804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.140969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.141089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.141284 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.141413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.141516 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.141814 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.141964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.142184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.142359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.142474 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] credential.caching = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.142662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.142916 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.143056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.143218 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.143478 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.143478 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.143688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.143933 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.144027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.144114 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.144205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.144284 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.144383 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.144561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.144698 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.144888 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.145095 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.145235 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.145369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.145494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.145620 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.145819 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.145966 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.146102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.146291 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.146399 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.146525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.146652 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.146794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.146956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.147081 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.147081 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] federation.caching = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.147274 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.147353 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.147466 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.147549 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.147719 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.147815 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.147898 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.147978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.148063 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.148144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.148219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.148291 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.148363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.148435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.148544 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.148627 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.148750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.148830 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.148904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.148977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.149132 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.149219 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.149302 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.149377 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.caching = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.149450 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.149571 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.149697 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.149840 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.149971 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.150104 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.150249 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.150365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.150446 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.150531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.150606 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.150702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.150809 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.150894 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.150970 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.151057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.151134 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.151208 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.151334 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.151412 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.151485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.151571 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.151682 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.151824 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.151902 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.152056 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.152159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.152238 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.152311 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.152394 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.152470 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.152545 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.152620 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.152699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.152800 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.152800 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.152951 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.153025 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.153098 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.153098 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.153230 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.153313 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.153416 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.153542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.153670 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.153818 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.153963 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.154094 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.154191 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.154269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.154344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.154418 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.154504 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.154638 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.154767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.154897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.155030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.155163 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.155256 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.155341 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.155427 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.155503 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.155576 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.155655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.155818 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.155910 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.155988 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.156061 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.156133 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.156206 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.156332 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.156425 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.156502 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.156575 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.156687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.156796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.156896 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.157031 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.157163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.157295 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.157385 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.157471 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.157547 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.157707 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.157842 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.157973 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.158103 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.158238 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.158361 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.158454 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.158535 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.158657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.158786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.158911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.159054 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.159171 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.159257 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.159333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.159462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.159542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.159664 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.160281 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.160391 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.160523 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.160657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.160792 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.160923 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.161165 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.161305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.161441 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.161570 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.161701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.161798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.161897 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.161986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.162070 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.162193 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.162315 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.162460 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.162591 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.162720 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.162804 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.162879 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.162953 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.163026 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.163090 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.163150 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.163210 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.163394 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.163531 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.163674 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.163847 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.163979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.164110 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.164193 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.164256 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.164390 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.164519 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] auth.external = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.164671 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.164805 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.164937 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.165065 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.165200 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.165329 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.165523 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.165657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] auth.password = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.165787 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.165925 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] auth.token = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.166105 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.166338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.166493 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.166622 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.166735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.166873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.167013 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.167214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.167440 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.167643 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.167891 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.168022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.168169 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.168300 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.168300 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] credential.caching = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.168581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.168748 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.168889 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.169078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.169182 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.169260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.169335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.169409 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.169490 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.169575 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.169652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.169726 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.169806 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] resource.caching = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.169944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.170025 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.170109 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.170185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.170266 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.170347 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.170423 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.170519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.170660 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.170754 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.170831 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.170905 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.170905 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.171095 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.171180 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.171256 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.171330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.171403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.171477 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] role.caching = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.171550 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] federation.caching = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.171664 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] role.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.171930 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.172080 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.172161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.172236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.172311 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.172394 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.172476 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.172551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.172624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.172747 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.172837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.172914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.173034 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.173118 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.173223 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.173301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.173385 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.173461 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.173535 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.173609 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.173683 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.173846 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.173949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] identity.caching = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.174094 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.174235 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.174366 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.174497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.174629 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.174780 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.174780 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.174982 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.175065 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.175220 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.175351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.176058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.176195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.176329 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.176466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.176598 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.176731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.176731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.176992 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.177122 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.177291 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.177423 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.177582 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.177715 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.177849 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.177977 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.178139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.178271 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.178439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.178640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.178756 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.178836 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.178946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.179104 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.179104 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.179434 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.179570 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.179702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.179860 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.179991 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.180126 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.180239 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.180319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.180381 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.180442 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.180584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.180668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.180806 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] token.caching = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.180939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.181047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.181173 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.181297 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.181426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.181540 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.181699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.181810 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.181958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.182072 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.182177 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.182286 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.182365 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.182440 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.182531 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.182593 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.182663 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.182663 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.182829 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.182892 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.182984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.183095 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.183245 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.183472 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.183597 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.183836 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.183969 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.184105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.184301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.184412 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.184477 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.184548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.184619 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.184722 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.184798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.184905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.184905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.185182 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.connection = **** {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.185314 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.185442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.185571 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.185701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.185848 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.185989 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.186121 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.186206 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.186271 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.186331 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.186431 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.user = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.186565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.186664 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.186729 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.186729 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.186877 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.186951 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.187041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.187168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.187529 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.187611 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.187675 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.187825 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.187939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.188067 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.188149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.188305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.188439 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.188586 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.188717 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.188850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.188986 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.189070 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.189140 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.189211 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.189275 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.189370 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 14:13:14.189483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.189686 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.189931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.190175 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.190419 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.190657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.190902 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.191481 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.191481 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.191953 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.191953 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.192316 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.192316 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.192576 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.192798 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.193030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.193275 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.193511 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.193747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.193985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.194228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.194476 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.194703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.194940 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.195176 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] resource.caching = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.195423 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.195674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.195937 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.196259 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.196510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.196746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.196992 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.197236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.197469 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.197710 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] role.caching = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.197952 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] role.driver = sql {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.198183 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.198431 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.198672 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.198917 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.199161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.199410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.199652 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.199921 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.200169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.200402 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.200646 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.200894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.201146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.201389 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.201827 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.202054 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.202306 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.202553 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.202802 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.203051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.203285 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.203540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.203814 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.204054 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.204285 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.204517 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.204747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.204994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.205254 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.205498 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.205732 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.205967 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.206198 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.206442 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] token.caching = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.206763 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.207020 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.207262 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.207516 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.207778 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.208025 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.208263 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.208488 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.208740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.208960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.209202 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.209426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.209670 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.209946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.210174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.210415 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.210680 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.210938 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] database.connection = **** {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.211181 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.211425 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.211660 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.211927 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.212171 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.212405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.212640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.212874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.213111 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.213355 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.213594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.213830 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.214074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.214310 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.214553 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.214784 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.215029 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.215258 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:13:14.215428 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 14:13:14.219664 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.219921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.220146 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.229395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.242260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.242484 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.242700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.251400 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.260051 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.260315 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.272086 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.272312 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.317571 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.324955 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.373824 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.374040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.385838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.386063 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.542149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.542427 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.542590 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.542811 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.543033 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.543224 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.546463 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.546706 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.546962 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.547187 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.547410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.547636 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.569171 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.569398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.569516 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.569737 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.569879 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.569998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.570117 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.570226 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.570334 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.570452 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.570565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.570674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.570881 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.571095 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.583643 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.583926 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.598340 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.598570 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.598658 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.598726 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.598813 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.598923 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.599039 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.599154 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.599268 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.599399 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.599519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.599636 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.599785 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.599903 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 14:13:14.617633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.617871 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.618061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 14:13:14.618239 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 14:13:14.618363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.618488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.618636 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 14:13:14.618750 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 14:13:14.618870 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.618986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.619101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.619227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.619338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.619453 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.619566 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.619685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.630101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.630392 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.630392 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.630618 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.630724 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.630806 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.630999 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.631088 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.638243 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.638594 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.641236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.641529 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.641617 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.641814 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.641936 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.642281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.642475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.642613 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.642741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.642870 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.642955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.643111 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.643256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.643395 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.643545 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.643624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.643782 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.643905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.643985 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.644138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.644818 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.645070 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.667798 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.668787 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.669310 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.669594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.670293 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.670578 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.674274 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.674573 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.674971 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.675475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.675883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.676608 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.681585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.681892 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.682506 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.682886 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.686065 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.686364 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.686655 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.689194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.689386 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.689536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.689704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.689846 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.689985 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.690123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.690265 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.690402 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.690555 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.690738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.691528 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.691822 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.708946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.709249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.713632 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.717312 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.717634 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.717798 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.717967 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.722149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.722417 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.726753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.726980 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.727432 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.730159 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.730469 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.730753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.731037 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.731316 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.731610 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.732006 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.736345 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.741741 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.742076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.742365 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.742783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.743078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.743375 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.747956 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.748259 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.748526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.748890 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.759143 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.760815 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.762375 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.762649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.765371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.765660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.765942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.766236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.766408 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.766550 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.766681 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.766816 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.767060 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.777313 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.778845 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.779053 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.779208 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.779413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.779700 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.780121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.780406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.780634 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.780812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.780956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.785569 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.785866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.786158 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.786452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.787550 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.796348 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.799391 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.802618 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.804116 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.804410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.804715 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.804998 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.805281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.805563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.805731 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.805941 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.806083 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.806224 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.806364 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.813005 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.814503 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.818082 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.818531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.818891 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.819305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.826322 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.827322 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.827631 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.827934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.834011 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.835681 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.836008 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.836289 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.836563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.836831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.837105 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.837370 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.837648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.837923 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.838197 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.838494 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.838753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.839023 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.839289 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.839996 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.842868 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.845784 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.846389 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.846883 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.859878 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.862723 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.868705 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.869218 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.869724 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.870335 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.874372 dv-cinder-860260-1-smb devstack@keystone.service[81467]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fd226859c0 pid: 81467 (default app) Oct 04 14:13:14.877914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999191d2-137b-4754-b2f8-1b039efdf712 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:14.878197 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999191d2-137b-4754-b2f8-1b039efdf712 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:14.878975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999191d2-137b-4754-b2f8-1b039efdf712 None None] PATH_INFO: `/v3` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:14.883337 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 791 bytes} [Tue Oct 4 14:13:14 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:14.887768 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.888322 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.888825 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.903525 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 14:13:14.904085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.904577 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.905082 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.905570 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.906030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.906518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.907016 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.907520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.908048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.908565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.909053 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.909548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.910676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 14:13:14.982361 dv-cinder-860260-1-smb devstack@keystone.service[81468]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fd226859c0 pid: 81468 (default app) Oct 04 14:13:22.300470 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf05b5-72f2-4764-8104-ff96beede3a6 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:22.301370 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf05b5-72f2-4764-8104-ff96beede3a6 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:22.301370 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf05b5-72f2-4764-8104-ff96beede3a6 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:22.302769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 2/2] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:13:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:13:22.311651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a949f-680a-456a-9e04-69bd53e9d574 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:22.312649 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a949f-680a-456a-9e04-69bd53e9d574 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:22.312649 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a949f-680a-456a-9e04-69bd53e9d574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:22.387780 dv-cinder-860260-1-smb devstack@keystone.service[81468]: INFO dbcounter [None req-de2a949f-680a-456a-9e04-69bd53e9d574 None None] Registered counter for database keystone Oct 04 14:13:22.409214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG oslo_db.sqlalchemy.engines [None req-de2a949f-680a-456a-9e04-69bd53e9d574 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81468) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 14:13:22.420614 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writer thread running {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 14:13:22.724640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG passlib.handlers.bcrypt [None req-de2a949f-680a-456a-9e04-69bd53e9d574 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81468) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 04 14:13:22.725030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG passlib.handlers.bcrypt [None req-de2a949f-680a-456a-9e04-69bd53e9d574 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81468) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 04 14:13:22.785623 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-de2a949f-680a-456a-9e04-69bd53e9d574 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:13:22.787260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-de2a949f-680a-456a-9e04-69bd53e9d574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:13:22.934632 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1/3] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:13:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 626 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 04 14:13:23.448622 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf05b5-72f2-4764-8104-ff96beede3a6 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:23.527690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: INFO dbcounter [None req-1baf05b5-72f2-4764-8104-ff96beede3a6 None None] Registered counter for database keystone Oct 04 14:13:23.555541 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG oslo_db.sqlalchemy.engines [None req-1baf05b5-72f2-4764-8104-ff96beede3a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 14:13:23.561711 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writer thread running {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 14:13:23.701058 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf05b5-72f2-4764-8104-ff96beede3a6 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:23.705922 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1432f-8b3e-40cc-a0d9-f8eeb2e6f20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:23.707418 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1432f-8b3e-40cc-a0d9-f8eeb2e6f20a admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:23.707884 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1432f-8b3e-40cc-a0d9-f8eeb2e6f20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:23.708189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1432f-8b3e-40cc-a0d9-f8eeb2e6f20a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:23.718639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1432f-8b3e-40cc-a0d9-f8eeb2e6f20a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:23.775033 dv-cinder-860260-1-smb devstack@keystone.service[81467]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6de1432f-8b3e-40cc-a0d9-f8eeb2e6f20a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 04 14:13:23.775369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1432f-8b3e-40cc-a0d9-f8eeb2e6f20a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:23.787845 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 3/4] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Oct 4 14:13:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 14:13:23.794253 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a949f-680a-456a-9e04-69bd53e9d574 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:23.813912 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a949f-680a-456a-9e04-69bd53e9d574 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:23.819462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd15f8e-177d-4f3e-8868-0cd6371697b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:23.820837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd15f8e-177d-4f3e-8868-0cd6371697b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:23.821119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd15f8e-177d-4f3e-8868-0cd6371697b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:23.821393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd15f8e-177d-4f3e-8868-0cd6371697b0 admin admin] PATH_INFO: `/v3/projects/d6e81a80a6484baf89f76501cdc63799` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:23.822979 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd15f8e-177d-4f3e-8868-0cd6371697b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=d6e81a80a6484baf89f76501cdc63799)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:23.877026 dv-cinder-860260-1-smb devstack@keystone.service[81468]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7bd15f8e-177d-4f3e-8868-0cd6371697b0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 04 14:13:23.877366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd15f8e-177d-4f3e-8868-0cd6371697b0 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:23.882718 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 2/5] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Oct 4 14:13:23 2022] GET /identity/v3/projects/d6e81a80a6484baf89f76501cdc63799 => generated 344 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:26.229576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c959a0-438f-4112-a03f-40cdb19cec89 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:26.230228 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c959a0-438f-4112-a03f-40cdb19cec89 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:26.230228 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c959a0-438f-4112-a03f-40cdb19cec89 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:26.234596 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 4/6] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:13:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:13:26.241269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f41a7d-daf0-40aa-a2a3-d12ce9e1392e None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:26.241850 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f41a7d-daf0-40aa-a2a3-d12ce9e1392e None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:26.241974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f41a7d-daf0-40aa-a2a3-d12ce9e1392e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:26.264516 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-c3f41a7d-daf0-40aa-a2a3-d12ce9e1392e None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:13:26.266260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-c3f41a7d-daf0-40aa-a2a3-d12ce9e1392e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:13:26.275804 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 3/7] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:13:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 04 14:13:26.750855 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c959a0-438f-4112-a03f-40cdb19cec89 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:26.764311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c959a0-438f-4112-a03f-40cdb19cec89 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:26.770119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8bbbeb-607f-4a08-9d58-8c8c2c4f6091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:26.770878 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bbbeb-607f-4a08-9d58-8c8c2c4f6091 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:26.771162 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bbbeb-607f-4a08-9d58-8c8c2c4f6091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:26.771458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bbbeb-607f-4a08-9d58-8c8c2c4f6091 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:26.780475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8bbbeb-607f-4a08-9d58-8c8c2c4f6091 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:26.782279 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8bbbeb-607f-4a08-9d58-8c8c2c4f6091 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:26.792808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 5/8] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Oct 4 14:13:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 14:13:26.798919 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f41a7d-daf0-40aa-a2a3-d12ce9e1392e None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:26.809521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f41a7d-daf0-40aa-a2a3-d12ce9e1392e None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:26.814282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19468c88-dd81-45c5-a213-a251e80c4737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:26.814948 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19468c88-dd81-45c5-a213-a251e80c4737 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:26.815230 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19468c88-dd81-45c5-a213-a251e80c4737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:26.815505 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19468c88-dd81-45c5-a213-a251e80c4737 admin admin] PATH_INFO: `/v3/users/ea10fbfe4b4e4d64acf7b2c318e4a8a1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:26.817735 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19468c88-dd81-45c5-a213-a251e80c4737 admin admin] RBAC: Authorizing `identity:get_user(user_id=ea10fbfe4b4e4d64acf7b2c318e4a8a1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:26.819630 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19468c88-dd81-45c5-a213-a251e80c4737 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:26.821513 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 4/9] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Oct 4 14:13:26 2022] GET /identity/v3/users/ea10fbfe4b4e4d64acf7b2c318e4a8a1 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:29.246028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec539c1e-f504-4013-bfd6-a477d10d92f0 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:29.247182 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec539c1e-f504-4013-bfd6-a477d10d92f0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:29.247690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec539c1e-f504-4013-bfd6-a477d10d92f0 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:29.249343 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 6/10] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:13:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:13:29.257824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56950460-794d-4391-9b14-36ddc10e79f9 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:29.258383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56950460-794d-4391-9b14-36ddc10e79f9 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:29.258883 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56950460-794d-4391-9b14-36ddc10e79f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:29.284956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-56950460-794d-4391-9b14-36ddc10e79f9 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:13:29.286187 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-56950460-794d-4391-9b14-36ddc10e79f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:13:29.384060 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c834f1b-c147-4c20-9a34-098b71b7883d None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:29.384505 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c834f1b-c147-4c20-9a34-098b71b7883d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:29.384878 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c834f1b-c147-4c20-9a34-098b71b7883d None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:29.386530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 7/11] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:13:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:13:29.388783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 5/12] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:13:29.394492 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6815dd-7c43-49cf-8c06-4d4c55960828 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:29.394765 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6815dd-7c43-49cf-8c06-4d4c55960828 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:29.395036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6815dd-7c43-49cf-8c06-4d4c55960828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:29.442059 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG passlib.handlers.bcrypt [None req-4d6815dd-7c43-49cf-8c06-4d4c55960828 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81467) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 04 14:13:29.442510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG passlib.handlers.bcrypt [None req-4d6815dd-7c43-49cf-8c06-4d4c55960828 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81467) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 04 14:13:29.492459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-4d6815dd-7c43-49cf-8c06-4d4c55960828 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:13:29.494080 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4d6815dd-7c43-49cf-8c06-4d4c55960828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:13:29.627287 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 8/13] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:13:29.674157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56950460-794d-4391-9b14-36ddc10e79f9 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:29.718257 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:29.836605 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56950460-794d-4391-9b14-36ddc10e79f9 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:29.879159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ad102-82c2-408e-8beb-3cf1292a1f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:29.879970 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ad102-82c2-408e-8beb-3cf1292a1f06 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:29.880336 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ad102-82c2-408e-8beb-3cf1292a1f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:29.880707 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ad102-82c2-408e-8beb-3cf1292a1f06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:29.895079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ad102-82c2-408e-8beb-3cf1292a1f06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:13:29.904727 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-757ad102-82c2-408e-8beb-3cf1292a1f06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:13:29.904727 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:13:29.904727 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:13:29.904727 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:13:29.904727 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:13:29.904727 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:13:29.904727 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:13:29.904727 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:13:29.904727 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:13:29.904727 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:13:29.904727 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:13:29.904727 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:13:29.904727 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:13:29.904727 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:13:29.904727 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:13:29.904727 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:13:29.906455 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:13:29.906455 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:13:29.906455 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:13:29.906455 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:13:29.906455 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:13:29.906455 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:13:29.906455 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:13:29.906455 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:13:29.906455 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:13:29.906455 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:13:29.906455 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:13:29.906455 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:13:29.906455 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:13:29.906455 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:13:29.906455 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:13:29.906455 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:13:29.907978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:13:29.907978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:13:29.907978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:13:29.907978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:13:29.907978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:13:29.907978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:13:29.907978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:13:29.907978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:13:29.907978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:13:29.907978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:13:29.907978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:13:29.907978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:13:29.907978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 6/14] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:13:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:13:29.915183 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6815dd-7c43-49cf-8c06-4d4c55960828 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:29.924593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ad102-82c2-408e-8beb-3cf1292a1f06 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:30.020861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:30.043383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ad102-82c2-408e-8beb-3cf1292a1f06 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:30.091984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6815dd-7c43-49cf-8c06-4d4c55960828 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:30.095917 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:30.104432 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec195bc5-6e2f-4d25-9717-29d8ebe56310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:30.105365 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec195bc5-6e2f-4d25-9717-29d8ebe56310 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:30.105742 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec195bc5-6e2f-4d25-9717-29d8ebe56310 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:30.106114 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec195bc5-6e2f-4d25-9717-29d8ebe56310 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:30.154187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01707d2a-adf6-4d3d-9547-729517f02056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:30.155485 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01707d2a-adf6-4d3d-9547-729517f02056 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:30.156044 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01707d2a-adf6-4d3d-9547-729517f02056 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:30.159686 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01707d2a-adf6-4d3d-9547-729517f02056 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:30.161415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01707d2a-adf6-4d3d-9547-729517f02056 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:13:30.168963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01707d2a-adf6-4d3d-9547-729517f02056 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:30.170874 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01707d2a-adf6-4d3d-9547-729517f02056 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:30.191942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 9/15] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:13:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:30.197743 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01707d2a-adf6-4d3d-9547-729517f02056 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:30.217442 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec195bc5-6e2f-4d25-9717-29d8ebe56310 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:30.218979 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec195bc5-6e2f-4d25-9717-29d8ebe56310 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:30.331422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:30.336558 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01707d2a-adf6-4d3d-9547-729517f02056 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:30.363430 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 7/16] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:13:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 14:13:30.370615 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec195bc5-6e2f-4d25-9717-29d8ebe56310 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:30.381646 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5030b-fa8a-4c99-8f4b-b227c1de860a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:30.383107 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5030b-fa8a-4c99-8f4b-b227c1de860a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:30.383599 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5030b-fa8a-4c99-8f4b-b227c1de860a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:30.384130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5030b-fa8a-4c99-8f4b-b227c1de860a None admin] PATH_INFO: `/v3/users/ea10fbfe4b4e4d64acf7b2c318e4a8a1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:30.386862 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5030b-fa8a-4c99-8f4b-b227c1de860a None admin] RBAC: Authorizing `identity:get_user(user_id=ea10fbfe4b4e4d64acf7b2c318e4a8a1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:30.390520 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5030b-fa8a-4c99-8f4b-b227c1de860a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:30.398850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 10/17] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:13:30 2022] GET /identity/v3/users/ea10fbfe4b4e4d64acf7b2c318e4a8a1 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:13:30.400811 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5030b-fa8a-4c99-8f4b-b227c1de860a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:30.445512 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:30.491586 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec195bc5-6e2f-4d25-9717-29d8ebe56310 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:30.535924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ac083-ab6d-4c53-ab93-bb40aec836a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:30.536932 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ac083-ab6d-4c53-ab93-bb40aec836a5 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:30.537331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ac083-ab6d-4c53-ab93-bb40aec836a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:30.538161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ac083-ab6d-4c53-ab93-bb40aec836a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:30.557900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ac083-ab6d-4c53-ab93-bb40aec836a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:30.560353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ac083-ab6d-4c53-ab93-bb40aec836a5 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:30.577758 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5030b-fa8a-4c99-8f4b-b227c1de860a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:30.584189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-9b6ac083-ab6d-4c53-ab93-bb40aec836a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:13:30.584189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:13:30.584189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:13:30.584189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:13:30.584189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:13:30.584189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:13:30.584189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:13:30.584189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:13:30.584189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:13:30.584189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:13:30.584189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:13:30.584189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:13:30.584189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:13:30.584189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:13:30.584189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:13:30.584189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:13:30.585366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:13:30.585366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:13:30.585366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:13:30.585366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:13:30.585366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:13:30.585366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:13:30.585366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:13:30.585366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:13:30.585366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:13:30.585366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:13:30.585366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:13:30.585366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:13:30.585366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:13:30.585366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:13:30.585366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:13:30.585366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:13:30.585366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:13:30.589769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:13:30.589769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:13:30.589769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:13:30.589769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 8/18] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:13:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:13:30.592105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ac083-ab6d-4c53-ab93-bb40aec836a5 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:30.630254 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42414dc-024f-415a-b162-f348195fe16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:30.631115 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42414dc-024f-415a-b162-f348195fe16a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:30.631592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42414dc-024f-415a-b162-f348195fe16a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:30.632046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42414dc-024f-415a-b162-f348195fe16a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:30.633931 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42414dc-024f-415a-b162-f348195fe16a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:30.635566 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42414dc-024f-415a-b162-f348195fe16a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:30.637292 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 11/19] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:13:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:13:30.645070 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:30.648192 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42414dc-024f-415a-b162-f348195fe16a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:30.740424 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ac083-ab6d-4c53-ab93-bb40aec836a5 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:30.778344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b58a06-dfa5-4a78-87f8-873f814db8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:30.778962 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b58a06-dfa5-4a78-87f8-873f814db8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:30.779240 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b58a06-dfa5-4a78-87f8-873f814db8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:30.779513 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b58a06-dfa5-4a78-87f8-873f814db8e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:30.780193 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b58a06-dfa5-4a78-87f8-873f814db8e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:13:30.780494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b58a06-dfa5-4a78-87f8-873f814db8e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:30.781925 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b58a06-dfa5-4a78-87f8-873f814db8e8 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:30.799529 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42414dc-024f-415a-b162-f348195fe16a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:30.801688 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 9/20] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:13:30.802850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:30.847764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea79195-fdc5-4b8e-9582-42b23118ed12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:30.848582 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea79195-fdc5-4b8e-9582-42b23118ed12 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:30.848860 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea79195-fdc5-4b8e-9582-42b23118ed12 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:30.849132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea79195-fdc5-4b8e-9582-42b23118ed12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:30.849935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea79195-fdc5-4b8e-9582-42b23118ed12 None admin] RBAC: Adding query filter params (role.id=a16b6daeda5b4a67992f3c12514ca90e, scope.domain.id=default, user.id=ea10fbfe4b4e4d64acf7b2c318e4a8a1) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:13:30.850213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea79195-fdc5-4b8e-9582-42b23118ed12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:30.851779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea79195-fdc5-4b8e-9582-42b23118ed12 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:30.862095 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 12/21] 10.222.0.62 () {56 vars in 1322 bytes} [Tue Oct 4 14:13:30 2022] GET /identity/v3/role_assignments?user.id=ea10fbfe4b4e4d64acf7b2c318e4a8a1&scope.domain.id=default&role.id=a16b6daeda5b4a67992f3c12514ca90e => generated 233 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:33.992853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c2256-beee-49b1-8215-02f60dd78394 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:33.993380 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c2256-beee-49b1-8215-02f60dd78394 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:33.993806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c2256-beee-49b1-8215-02f60dd78394 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:33.996320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 10/22] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:13:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:13:34.003991 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d99e2-109e-41a5-8269-4a14695ac1ff None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:34.004528 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d99e2-109e-41a5-8269-4a14695ac1ff None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:34.005000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d99e2-109e-41a5-8269-4a14695ac1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:34.039293 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c28d99e2-109e-41a5-8269-4a14695ac1ff None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:13:34.041480 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c28d99e2-109e-41a5-8269-4a14695ac1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:13:34.181737 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 13/23] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:13:34.252210 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f375a-cae2-48c9-a696-47dca7b0ee4b None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:34.252471 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f375a-cae2-48c9-a696-47dca7b0ee4b None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:34.252729 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f375a-cae2-48c9-a696-47dca7b0ee4b None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:34.254707 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 11/24] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:13:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:13:34.261826 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30d7dc-0562-48de-b673-4462288edc63 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:34.262446 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30d7dc-0562-48de-b673-4462288edc63 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:34.262905 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30d7dc-0562-48de-b673-4462288edc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:34.303149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-db30d7dc-0562-48de-b673-4462288edc63 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:13:34.305217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-db30d7dc-0562-48de-b673-4462288edc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:13:34.478742 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 14/25] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:13:34.741256 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199df33f-845d-406c-a20a-04fde7c2da55 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:34.741536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199df33f-845d-406c-a20a-04fde7c2da55 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:34.741905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199df33f-845d-406c-a20a-04fde7c2da55 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:34.743165 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 12/26] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:13:34.762709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73aec8-b947-4f92-b9cc-1fa22fb0e0ec None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:34.763154 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73aec8-b947-4f92-b9cc-1fa22fb0e0ec None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:34.763620 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73aec8-b947-4f92-b9cc-1fa22fb0e0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:34.800104 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-bf73aec8-b947-4f92-b9cc-1fa22fb0e0ec None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:13:34.802132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bf73aec8-b947-4f92-b9cc-1fa22fb0e0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:13:34.850321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:34.963042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199df33f-845d-406c-a20a-04fde7c2da55 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:34.967519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 15/27] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:13:35.135494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:35.143017 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73aec8-b947-4f92-b9cc-1fa22fb0e0ec None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:35.159874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199df33f-845d-406c-a20a-04fde7c2da55 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:35.250465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8179c1b-d291-4b0b-a46f-ff6cc3045407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:35.254087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8179c1b-d291-4b0b-a46f-ff6cc3045407 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:35.255503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8179c1b-d291-4b0b-a46f-ff6cc3045407 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:35.260524 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8179c1b-d291-4b0b-a46f-ff6cc3045407 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:35.287496 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8179c1b-d291-4b0b-a46f-ff6cc3045407 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:35.290834 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8179c1b-d291-4b0b-a46f-ff6cc3045407 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:35.322003 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-b8179c1b-d291-4b0b-a46f-ff6cc3045407 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:13:35.322003 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:13:35.322003 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:13:35.322003 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:13:35.322003 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:13:35.322003 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:13:35.322003 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:13:35.322003 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:13:35.322003 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:13:35.322003 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:13:35.322003 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:13:35.322003 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:13:35.322003 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:13:35.322003 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:13:35.322003 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:13:35.322003 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:13:35.323681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:13:35.323681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:13:35.323681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:13:35.323681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:13:35.323681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:13:35.323681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:13:35.323681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:13:35.323681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:13:35.323681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:13:35.323681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:13:35.323681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:13:35.323681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:13:35.323681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:13:35.323681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:13:35.323681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:13:35.323681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:13:35.323681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:13:35.325298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:13:35.325298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:13:35.325298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:13:35.336374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 13/28] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:13:35.346141 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8179c1b-d291-4b0b-a46f-ff6cc3045407 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:35.482691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73aec8-b947-4f92-b9cc-1fa22fb0e0ec None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:35.634277 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d09a87-6131-45e1-a629-c0ec198128fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:35.634925 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d09a87-6131-45e1-a629-c0ec198128fd None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:35.635215 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d09a87-6131-45e1-a629-c0ec198128fd None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:35.635472 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d09a87-6131-45e1-a629-c0ec198128fd None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:35.636366 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d09a87-6131-45e1-a629-c0ec198128fd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:35.637828 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d09a87-6131-45e1-a629-c0ec198128fd None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:35.672759 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8179c1b-d291-4b0b-a46f-ff6cc3045407 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:35.768560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e586f65-5486-4ca8-b83a-150e237f58b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:35.769162 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e586f65-5486-4ca8-b83a-150e237f58b1 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:35.769440 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e586f65-5486-4ca8-b83a-150e237f58b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:35.769758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e586f65-5486-4ca8-b83a-150e237f58b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:35.770432 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e586f65-5486-4ca8-b83a-150e237f58b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:13:35.770736 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e586f65-5486-4ca8-b83a-150e237f58b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:35.772171 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e586f65-5486-4ca8-b83a-150e237f58b1 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:35.798493 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 14/29] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:13:35.799394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e586f65-5486-4ca8-b83a-150e237f58b1 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:35.817044 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:35.896077 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 16/30] 10.222.0.62 () {60 vars in 1131 bytes} [Tue Oct 4 14:13:35 2022] POST /identity/v3/roles => generated 219 bytes in 754 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:13:35.897092 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d09a87-6131-45e1-a629-c0ec198128fd None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:35.928364 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:36.029890 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d09a87-6131-45e1-a629-c0ec198128fd None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:36.075751 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e586f65-5486-4ca8-b83a-150e237f58b1 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:36.082539 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bd16d-3421-4765-9cdc-3f4e27309597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:36.083518 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bd16d-3421-4765-9cdc-3f4e27309597 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:36.084008 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bd16d-3421-4765-9cdc-3f4e27309597 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:36.084463 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bd16d-3421-4765-9cdc-3f4e27309597 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:36.086335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bd16d-3421-4765-9cdc-3f4e27309597 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:36.089076 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bd16d-3421-4765-9cdc-3f4e27309597 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:36.144575 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431af5e-021a-46a0-9419-4dba05705eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:36.145521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431af5e-021a-46a0-9419-4dba05705eae None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:36.146037 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431af5e-021a-46a0-9419-4dba05705eae None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:36.146715 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431af5e-021a-46a0-9419-4dba05705eae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:36.164719 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 17/31] 10.222.0.62 () {60 vars in 1141 bytes} [Tue Oct 4 14:13:35 2022] POST /identity/v3/projects => generated 301 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:13:36.169979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd993a-8c73-4e37-b243-14cfbc0a3225 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:36.169979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd993a-8c73-4e37-b243-14cfbc0a3225 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:36.169979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd993a-8c73-4e37-b243-14cfbc0a3225 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:36.171696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 18/32] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:13:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:13:36.172685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431af5e-021a-46a0-9419-4dba05705eae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:13:36.179462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-5431af5e-021a-46a0-9419-4dba05705eae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:13:36.179462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:13:36.179462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:13:36.179462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:13:36.179462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:13:36.179462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:13:36.179462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:13:36.179462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:13:36.179462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:13:36.179462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:13:36.179462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:13:36.179462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:13:36.179462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:13:36.179462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:13:36.179462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:13:36.179462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:13:36.180445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:13:36.180445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:13:36.180445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:13:36.180445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:13:36.180445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:13:36.180445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:13:36.180445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:13:36.180445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:13:36.180445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:13:36.180445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:13:36.180445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:13:36.180445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:13:36.180445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:13:36.180445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:13:36.180445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:13:36.180445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:13:36.181212 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:13:36.181212 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:13:36.181212 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:13:36.181212 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:13:36.181212 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:13:36.181212 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:13:36.181212 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:13:36.181212 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:13:36.181212 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:13:36.181212 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:13:36.181212 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:13:36.181212 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:13:36.188647 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 15/33] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:13:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:13:36.191081 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40deaeea-28cd-4d5d-9196-89a99922a616 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:36.191569 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40deaeea-28cd-4d5d-9196-89a99922a616 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:36.192156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40deaeea-28cd-4d5d-9196-89a99922a616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:36.196704 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431af5e-021a-46a0-9419-4dba05705eae None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:36.242479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-40deaeea-28cd-4d5d-9196-89a99922a616 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:13:36.247955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-40deaeea-28cd-4d5d-9196-89a99922a616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:13:36.418068 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:36.468272 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:36.483944 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 19/34] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:13:36.501201 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431af5e-021a-46a0-9419-4dba05705eae None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:36.577186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75439554-c0a9-440a-93c5-3fd3b6fb69dc None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:36.577600 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75439554-c0a9-440a-93c5-3fd3b6fb69dc None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:36.577778 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75439554-c0a9-440a-93c5-3fd3b6fb69dc None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:36.579556 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 20/35] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:13:36.590200 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b7f2a-c32c-4004-b783-39a59be269c7 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:36.590995 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b7f2a-c32c-4004-b783-39a59be269c7 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:36.591468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b7f2a-c32c-4004-b783-39a59be269c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:36.603187 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f7e27-8121-4a91-8492-a3ad8045f8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:36.604260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f7e27-8121-4a91-8492-a3ad8045f8da None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:36.604747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f7e27-8121-4a91-8492-a3ad8045f8da None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:36.605212 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f7e27-8121-4a91-8492-a3ad8045f8da None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:36.606433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f7e27-8121-4a91-8492-a3ad8045f8da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:13:36.606945 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f7e27-8121-4a91-8492-a3ad8045f8da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:36.609704 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f7e27-8121-4a91-8492-a3ad8045f8da None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:36.618079 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-162b7f2a-c32c-4004-b783-39a59be269c7 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:13:36.619474 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-162b7f2a-c32c-4004-b783-39a59be269c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:13:36.634498 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 16/36] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:13:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:13:36.647606 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f7e27-8121-4a91-8492-a3ad8045f8da None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:36.741327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 21/37] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:13:36.861497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f7e27-8121-4a91-8492-a3ad8045f8da None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:36.920824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:36.937319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c0c65-d6e8-46a9-af7d-6b88a75107a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:36.939074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c0c65-d6e8-46a9-af7d-6b88a75107a2 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:36.940027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c0c65-d6e8-46a9-af7d-6b88a75107a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:36.941323 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c0c65-d6e8-46a9-af7d-6b88a75107a2 None admin] PATH_INFO: `/v3/users/ea10fbfe4b4e4d64acf7b2c318e4a8a1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:36.944166 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c0c65-d6e8-46a9-af7d-6b88a75107a2 None admin] RBAC: Authorizing `identity:get_user(user_id=ea10fbfe4b4e4d64acf7b2c318e4a8a1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:36.946950 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c0c65-d6e8-46a9-af7d-6b88a75107a2 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:36.950103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 17/38] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:13:36 2022] GET /identity/v3/users/ea10fbfe4b4e4d64acf7b2c318e4a8a1 => generated 247 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:36.959804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b7f2a-c32c-4004-b783-39a59be269c7 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:37.057345 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9890a-ef57-4762-bd52-07758c7e9e4d None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:37.057572 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9890a-ef57-4762-bd52-07758c7e9e4d None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:37.057803 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9890a-ef57-4762-bd52-07758c7e9e4d None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:37.059830 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 18/39] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:13:37.066769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8d318-dc45-4f1d-928c-9f48b017d899 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:37.067103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8d318-dc45-4f1d-928c-9f48b017d899 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:37.067488 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8d318-dc45-4f1d-928c-9f48b017d899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:37.096332 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-69c8d318-dc45-4f1d-928c-9f48b017d899 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:13:37.099498 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-69c8d318-dc45-4f1d-928c-9f48b017d899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:13:37.164939 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b7f2a-c32c-4004-b783-39a59be269c7 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:37.217853 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:37.231757 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 19/40] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 14:13:37.232282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8d318-dc45-4f1d-928c-9f48b017d899 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:37.240116 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebeaea-a3de-4875-a393-2b29b203cb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:37.241192 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebeaea-a3de-4875-a393-2b29b203cb0d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:37.241759 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebeaea-a3de-4875-a393-2b29b203cb0d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:37.242242 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebeaea-a3de-4875-a393-2b29b203cb0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:37.244035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebeaea-a3de-4875-a393-2b29b203cb0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:37.245892 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebeaea-a3de-4875-a393-2b29b203cb0d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:37.248813 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 22/41] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:13:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:37.258853 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebeaea-a3de-4875-a393-2b29b203cb0d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:37.408076 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebeaea-a3de-4875-a393-2b29b203cb0d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:37.423356 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8d318-dc45-4f1d-928c-9f48b017d899 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:37.455534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943622af-69a3-401f-9f3b-622c6a2b5677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:37.457455 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943622af-69a3-401f-9f3b-622c6a2b5677 None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:37.457898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943622af-69a3-401f-9f3b-622c6a2b5677 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:37.458420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943622af-69a3-401f-9f3b-622c6a2b5677 None admin] PATH_INFO: `/v3/domains/default/users/ea10fbfe4b4e4d64acf7b2c318e4a8a1/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:37.459121 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:37.461437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943622af-69a3-401f-9f3b-622c6a2b5677 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ea10fbfe4b4e4d64acf7b2c318e4a8a1, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:37.463658 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943622af-69a3-401f-9f3b-622c6a2b5677 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:37.470682 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee15a10-1867-43b0-bcca-2bd1cb8ed6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:37.471331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee15a10-1867-43b0-bcca-2bd1cb8ed6ad None admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:37.471671 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee15a10-1867-43b0-bcca-2bd1cb8ed6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:37.472050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee15a10-1867-43b0-bcca-2bd1cb8ed6ad None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:37.473199 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee15a10-1867-43b0-bcca-2bd1cb8ed6ad None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:37.474714 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee15a10-1867-43b0-bcca-2bd1cb8ed6ad None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:37.486503 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 23/42] 10.222.0.62 () {58 vars in 1361 bytes} [Tue Oct 4 14:13:37 2022] PUT /identity/v3/domains/default/users/ea10fbfe4b4e4d64acf7b2c318e4a8a1/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:13:37.488344 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943622af-69a3-401f-9f3b-622c6a2b5677 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:37.621832 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:37.710520 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943622af-69a3-401f-9f3b-622c6a2b5677 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:37.741146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 20/43] 10.222.0.62 () {60 vars in 1131 bytes} [Tue Oct 4 14:13:37 2022] POST /identity/v3/roles => generated 225 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:13:37.741146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee15a10-1867-43b0-bcca-2bd1cb8ed6ad None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:37.790542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63929dd-4c6f-478e-b12c-2ce9509c5b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:37.791510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63929dd-4c6f-478e-b12c-2ce9509c5b53 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:37.792021 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63929dd-4c6f-478e-b12c-2ce9509c5b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:37.792464 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63929dd-4c6f-478e-b12c-2ce9509c5b53 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:37.793675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63929dd-4c6f-478e-b12c-2ce9509c5b53 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:37.797293 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63929dd-4c6f-478e-b12c-2ce9509c5b53 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:37.828435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 24/44] 10.222.0.62 () {60 vars in 1131 bytes} [Tue Oct 4 14:13:37 2022] POST /identity/v3/roles => generated 223 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:13:37.941184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee15a10-1867-43b0-bcca-2bd1cb8ed6ad None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:38.014537 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad18e4-b38b-45b1-98c8-629c7d93a8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:38.015605 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad18e4-b38b-45b1-98c8-629c7d93a8d3 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:38.016107 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad18e4-b38b-45b1-98c8-629c7d93a8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:38.016581 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad18e4-b38b-45b1-98c8-629c7d93a8d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:38.018922 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad18e4-b38b-45b1-98c8-629c7d93a8d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:38.022374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad18e4-b38b-45b1-98c8-629c7d93a8d3 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:38.025979 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 21/45] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:13:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:38.032462 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63929dd-4c6f-478e-b12c-2ce9509c5b53 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:38.216982 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63929dd-4c6f-478e-b12c-2ce9509c5b53 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:38.250735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:38.288018 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7f5ca-605b-49fb-86c6-520a4a9fa2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:38.288955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7f5ca-605b-49fb-86c6-520a4a9fa2c8 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:38.289438 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7f5ca-605b-49fb-86c6-520a4a9fa2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:38.289926 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7f5ca-605b-49fb-86c6-520a4a9fa2c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:38.291158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7f5ca-605b-49fb-86c6-520a4a9fa2c8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:38.294044 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7f5ca-605b-49fb-86c6-520a4a9fa2c8 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:38.355749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 25/46] 10.222.0.62 () {60 vars in 1141 bytes} [Tue Oct 4 14:13:38 2022] POST /identity/v3/projects => generated 312 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:13:40.216575 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683691d2-5ac0-4073-95ea-51364649c7a7 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:40.217565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683691d2-5ac0-4073-95ea-51364649c7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:40.217565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683691d2-5ac0-4073-95ea-51364649c7a7 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:40.219103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 22/47] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:13:40.225395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205acf3-a17d-4df5-9dc8-a8c95533ab22 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:40.225919 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205acf3-a17d-4df5-9dc8-a8c95533ab22 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:40.226027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205acf3-a17d-4df5-9dc8-a8c95533ab22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:40.245686 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f205acf3-a17d-4df5-9dc8-a8c95533ab22 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:13:40.246897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f205acf3-a17d-4df5-9dc8-a8c95533ab22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:13:40.325955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 26/48] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:13:40.605376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683691d2-5ac0-4073-95ea-51364649c7a7 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:40.705021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:40.806692 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683691d2-5ac0-4073-95ea-51364649c7a7 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:40.864726 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c734c24-7aa0-42c0-a1e8-1f6aed13073c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:40.865375 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c734c24-7aa0-42c0-a1e8-1f6aed13073c None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:40.865765 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c734c24-7aa0-42c0-a1e8-1f6aed13073c None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:40.866044 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c734c24-7aa0-42c0-a1e8-1f6aed13073c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:40.881652 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c734c24-7aa0-42c0-a1e8-1f6aed13073c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:13:40.886779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-8c734c24-7aa0-42c0-a1e8-1f6aed13073c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:13:40.886779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:13:40.886779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:13:40.886779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:13:40.886779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:13:40.886779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:13:40.886779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:13:40.886779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:13:40.886779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:13:40.886779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:13:40.886779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:13:40.886779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:13:40.886779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:13:40.886779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:13:40.886779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:13:40.886779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:13:40.887693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:13:40.887693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:13:40.887693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:13:40.887693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:13:40.887693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:13:40.887693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:13:40.887693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:13:40.887693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:13:40.887693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:13:40.887693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:13:40.887693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:13:40.887693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:13:40.887693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:13:40.887693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:13:40.887693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:13:40.887693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:13:40.888475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:13:40.888475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:13:40.888475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:13:40.888475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:13:40.888475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:13:40.888475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:13:40.888475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:13:40.888475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:13:40.888475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:13:40.888475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:13:40.888475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:13:40.888475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:13:40.888475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 23/49] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:13:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:13:40.895182 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205acf3-a17d-4df5-9dc8-a8c95533ab22 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:41.005060 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:41.009799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205acf3-a17d-4df5-9dc8-a8c95533ab22 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:41.049262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebef02-f45e-40e0-838a-c05c3431bf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:41.049923 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebef02-f45e-40e0-838a-c05c3431bf7f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:41.050200 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebef02-f45e-40e0-838a-c05c3431bf7f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:41.050469 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebef02-f45e-40e0-838a-c05c3431bf7f None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:41.051161 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebef02-f45e-40e0-838a-c05c3431bf7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:13:41.051460 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebef02-f45e-40e0-838a-c05c3431bf7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:41.052906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebef02-f45e-40e0-838a-c05c3431bf7f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:41.062408 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 27/50] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:13:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:41.070429 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c734c24-7aa0-42c0-a1e8-1f6aed13073c None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:41.238992 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c734c24-7aa0-42c0-a1e8-1f6aed13073c None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:41.257325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:41.285992 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f51b6-1274-433e-9382-40b30cf04476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:41.286829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f51b6-1274-433e-9382-40b30cf04476 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:41.287178 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f51b6-1274-433e-9382-40b30cf04476 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:41.287519 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f51b6-1274-433e-9382-40b30cf04476 None admin] PATH_INFO: `/v3/users/ea10fbfe4b4e4d64acf7b2c318e4a8a1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:41.289153 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f51b6-1274-433e-9382-40b30cf04476 None admin] RBAC: Authorizing `identity:get_user(user_id=ea10fbfe4b4e4d64acf7b2c318e4a8a1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:41.290817 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f51b6-1274-433e-9382-40b30cf04476 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:41.293084 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 24/51] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:13:41 2022] GET /identity/v3/users/ea10fbfe4b4e4d64acf7b2c318e4a8a1 => generated 247 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:41.298965 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebef02-f45e-40e0-838a-c05c3431bf7f None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:41.412890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc449c5-9916-4581-b4d7-78b1791930a8 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:41.413343 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc449c5-9916-4581-b4d7-78b1791930a8 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:41.413806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc449c5-9916-4581-b4d7-78b1791930a8 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:41.415560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 25/52] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:13:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:13:41.421652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebef02-f45e-40e0-838a-c05c3431bf7f None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:41.422559 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d76e3-7cdb-442c-973b-f5683c30efd8 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:41.422906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d76e3-7cdb-442c-973b-f5683c30efd8 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:41.423308 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d76e3-7cdb-442c-973b-f5683c30efd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:41.447978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-043d76e3-7cdb-442c-973b-f5683c30efd8 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:13:41.450213 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-043d76e3-7cdb-442c-973b-f5683c30efd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:13:41.467969 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759942b-32c7-42d1-a17a-cf9d8d9d27ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:41.468633 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759942b-32c7-42d1-a17a-cf9d8d9d27ef None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:41.468911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759942b-32c7-42d1-a17a-cf9d8d9d27ef None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:41.469182 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759942b-32c7-42d1-a17a-cf9d8d9d27ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:41.470419 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759942b-32c7-42d1-a17a-cf9d8d9d27ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:41.472680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759942b-32c7-42d1-a17a-cf9d8d9d27ef None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:41.474379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 28/53] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:13:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:13:41.480564 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759942b-32c7-42d1-a17a-cf9d8d9d27ef None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:41.521256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:41.541694 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 26/54] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 14:13:41.616639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759942b-32c7-42d1-a17a-cf9d8d9d27ef None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:41.656967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48454d55-0cc7-4486-8d6b-f0b070e09d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:41.657696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48454d55-0cc7-4486-8d6b-f0b070e09d2f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:41.658070 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48454d55-0cc7-4486-8d6b-f0b070e09d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:41.658427 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48454d55-0cc7-4486-8d6b-f0b070e09d2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:41.659837 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48454d55-0cc7-4486-8d6b-f0b070e09d2f None admin] RBAC: Adding query filter params (role.id=a16b6daeda5b4a67992f3c12514ca90e, scope.domain.id=default, user.id=ea10fbfe4b4e4d64acf7b2c318e4a8a1) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:13:41.660262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48454d55-0cc7-4486-8d6b-f0b070e09d2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:41.661836 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48454d55-0cc7-4486-8d6b-f0b070e09d2f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:41.669139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 29/55] 10.222.0.62 () {56 vars in 1322 bytes} [Tue Oct 4 14:13:41 2022] GET /identity/v3/role_assignments?user.id=ea10fbfe4b4e4d64acf7b2c318e4a8a1&scope.domain.id=default&role.id=a16b6daeda5b4a67992f3c12514ca90e => generated 530 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:13:41.818940 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d76e3-7cdb-442c-973b-f5683c30efd8 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:41.947218 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d76e3-7cdb-442c-973b-f5683c30efd8 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:41.963955 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:41.997466 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f6096-8439-45d5-91a6-034384375f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:41.998119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f6096-8439-45d5-91a6-034384375f28 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:41.998398 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f6096-8439-45d5-91a6-034384375f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:41.998668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f6096-8439-45d5-91a6-034384375f28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:41.999865 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f6096-8439-45d5-91a6-034384375f28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:42.001365 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f6096-8439-45d5-91a6-034384375f28 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:42.003169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 27/56] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:13:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:42.009364 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48454d55-0cc7-4486-8d6b-f0b070e09d2f None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:42.233370 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:42.243614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48454d55-0cc7-4486-8d6b-f0b070e09d2f None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:42.280439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16771dbe-0186-4e02-a960-abc0d317d2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:42.281066 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16771dbe-0186-4e02-a960-abc0d317d2fd None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:42.281343 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16771dbe-0186-4e02-a960-abc0d317d2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:42.281606 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16771dbe-0186-4e02-a960-abc0d317d2fd None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:42.282273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16771dbe-0186-4e02-a960-abc0d317d2fd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:42.283735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16771dbe-0186-4e02-a960-abc0d317d2fd None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:42.311955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 30/57] 10.222.0.62 () {60 vars in 1140 bytes} [Tue Oct 4 14:13:42 2022] POST /identity/v3/projects => generated 298 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:13:44.580512 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f29516-1645-46ca-b8d1-374bcc228b35 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:44.581826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f29516-1645-46ca-b8d1-374bcc228b35 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:44.581826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f29516-1645-46ca-b8d1-374bcc228b35 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:44.583785 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 28/58] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:13:44.592553 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6944c52-a3b4-4a6e-a764-799fd8b6bf6b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:44.593333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6944c52-a3b4-4a6e-a764-799fd8b6bf6b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:44.593333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6944c52-a3b4-4a6e-a764-799fd8b6bf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:44.614281 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c6944c52-a3b4-4a6e-a764-799fd8b6bf6b None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:13:44.615522 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c6944c52-a3b4-4a6e-a764-799fd8b6bf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:13:44.696788 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 31/59] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 14:13:44.984191 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f29516-1645-46ca-b8d1-374bcc228b35 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:45.104169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f29516-1645-46ca-b8d1-374bcc228b35 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:45.142264 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb5d5c-9b2f-4c2d-b4b3-8b8fab1ba232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:45.142917 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb5d5c-9b2f-4c2d-b4b3-8b8fab1ba232 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:45.143221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb5d5c-9b2f-4c2d-b4b3-8b8fab1ba232 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:45.143500 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb5d5c-9b2f-4c2d-b4b3-8b8fab1ba232 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:45.144745 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb5d5c-9b2f-4c2d-b4b3-8b8fab1ba232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:45.146323 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb5d5c-9b2f-4c2d-b4b3-8b8fab1ba232 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:45.147988 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 29/60] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:13:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:13:45.153927 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6944c52-a3b4-4a6e-a764-799fd8b6bf6b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:45.238291 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:45.266690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6944c52-a3b4-4a6e-a764-799fd8b6bf6b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:45.309781 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823e9b5-1027-4964-b164-acf0ee352c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:45.310462 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823e9b5-1027-4964-b164-acf0ee352c69 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:45.310791 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823e9b5-1027-4964-b164-acf0ee352c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:45.311109 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823e9b5-1027-4964-b164-acf0ee352c69 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:45.311869 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823e9b5-1027-4964-b164-acf0ee352c69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:45.313646 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823e9b5-1027-4964-b164-acf0ee352c69 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:45.343725 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 32/61] 10.222.0.62 () {60 vars in 1132 bytes} [Tue Oct 4 14:13:45 2022] POST /identity/v3/users => generated 275 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:13:49.544930 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058af8c-e4cb-4a86-82dd-432f2186279b None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:49.544930 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058af8c-e4cb-4a86-82dd-432f2186279b None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:49.544930 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058af8c-e4cb-4a86-82dd-432f2186279b None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:49.544930 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 30/62] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:13:49.568631 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca7ffa-cfab-4e30-aec2-bd7adac9407a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:49.569176 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca7ffa-cfab-4e30-aec2-bd7adac9407a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:49.569645 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca7ffa-cfab-4e30-aec2-bd7adac9407a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:49.609574 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c8ca7ffa-cfab-4e30-aec2-bd7adac9407a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:13:49.611147 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c8ca7ffa-cfab-4e30-aec2-bd7adac9407a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:13:49.676002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07901a3-4fc2-4820-b509-80f58917cc63 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:49.676672 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07901a3-4fc2-4820-b509-80f58917cc63 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:49.677150 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07901a3-4fc2-4820-b509-80f58917cc63 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:49.678753 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 31/63] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:13:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:13:49.687131 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0568a4-1f8d-4e0b-b814-9140f3ae7b81 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:49.688021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0568a4-1f8d-4e0b-b814-9140f3ae7b81 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:49.688523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0568a4-1f8d-4e0b-b814-9140f3ae7b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:49.719454 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-3f0568a4-1f8d-4e0b-b814-9140f3ae7b81 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:13:49.722673 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-3f0568a4-1f8d-4e0b-b814-9140f3ae7b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:13:49.747969 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 33/64] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:13:49.838583 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:49.894401 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 32/65] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 14:13:50.039765 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d6192-96c2-4139-a7a6-add82bd9acf6 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:50.040191 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d6192-96c2-4139-a7a6-add82bd9acf6 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:50.040436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d6192-96c2-4139-a7a6-add82bd9acf6 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:50.042305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 34/66] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:13:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:13:50.048935 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5f771-ee53-4dbb-afc7-a33e3dd9146e None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:50.049547 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5f771-ee53-4dbb-afc7-a33e3dd9146e None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:50.050488 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5f771-ee53-4dbb-afc7-a33e3dd9146e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:50.087823 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-98c5f771-ee53-4dbb-afc7-a33e3dd9146e None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:13:50.090049 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-98c5f771-ee53-4dbb-afc7-a33e3dd9146e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:13:50.247611 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d6192-96c2-4139-a7a6-add82bd9acf6 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:50.259696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 33/67] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:13:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:13:50.398587 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:50.465829 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d6192-96c2-4139-a7a6-add82bd9acf6 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:50.524605 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9fdb9-56c9-43d3-82a0-1c8fa226ec46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:50.525292 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9fdb9-56c9-43d3-82a0-1c8fa226ec46 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:50.525600 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9fdb9-56c9-43d3-82a0-1c8fa226ec46 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:50.525841 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9fdb9-56c9-43d3-82a0-1c8fa226ec46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:50.528386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5f771-ee53-4dbb-afc7-a33e3dd9146e None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:50.565592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9fdb9-56c9-43d3-82a0-1c8fa226ec46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:13:50.576786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-f9a9fdb9-56c9-43d3-82a0-1c8fa226ec46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:13:50.576786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:13:50.576786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:13:50.576786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:13:50.576786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:13:50.576786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:13:50.576786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:13:50.576786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:13:50.576786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:13:50.576786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:13:50.576786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:13:50.576786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:13:50.576786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:13:50.576786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:13:50.576786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:13:50.576786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:13:50.578156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:13:50.578156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:13:50.578156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:13:50.578156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:13:50.578156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:13:50.578156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:13:50.578156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:13:50.578156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:13:50.578156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:13:50.578156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:13:50.578156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:13:50.578156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:13:50.578156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:13:50.578156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:13:50.578156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:13:50.578156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:13:50.578921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:13:50.578921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:13:50.578921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:13:50.578921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:13:50.578921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:13:50.578921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:13:50.578921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:13:50.578921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:13:50.578921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:13:50.578921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:13:50.578921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:13:50.578921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:13:50.582321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 35/68] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:13:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:13:50.599865 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9fdb9-56c9-43d3-82a0-1c8fa226ec46 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:50.740709 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5f771-ee53-4dbb-afc7-a33e3dd9146e None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:50.757121 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:50.806459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dfb21-1dc7-4eea-9fb4-84b34280ee69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:50.807977 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dfb21-1dc7-4eea-9fb4-84b34280ee69 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:50.808699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dfb21-1dc7-4eea-9fb4-84b34280ee69 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:50.809361 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dfb21-1dc7-4eea-9fb4-84b34280ee69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:50.810348 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9fdb9-56c9-43d3-82a0-1c8fa226ec46 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:50.831335 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059dfb21-1dc7-4eea-9fb4-84b34280ee69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:13:50.835245 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:50.841677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-059dfb21-1dc7-4eea-9fb4-84b34280ee69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:13:50.841677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:13:50.841677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:13:50.841677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:13:50.841677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:13:50.841677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:13:50.841677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:13:50.841677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:13:50.841677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:13:50.841677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:13:50.841677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:13:50.841677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:13:50.841677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:13:50.841677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:13:50.841677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:13:50.841677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:13:50.842640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:13:50.842640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:13:50.842640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:13:50.842640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:13:50.842640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:13:50.842640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:13:50.842640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:13:50.842640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:13:50.842640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:13:50.842640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:13:50.842640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:13:50.842640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:13:50.842640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:13:50.842640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:13:50.842640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:13:50.842640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:13:50.843547 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:13:50.843547 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:13:50.843547 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:13:50.843547 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:13:50.843547 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:13:50.843547 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:13:50.843547 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:13:50.843547 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:13:50.843547 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:13:50.843547 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:13:50.843547 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:13:50.843547 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:13:50.844170 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 34/69] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:13:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:13:50.847755 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6adef-519f-4d12-ac9e-a97f85c13907 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:50.848627 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6adef-519f-4d12-ac9e-a97f85c13907 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:50.849248 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6adef-519f-4d12-ac9e-a97f85c13907 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:50.851938 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd07e3e-227b-4909-a573-f40a736c7086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:50.852210 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 35/70] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:13:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:13:50.852880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd07e3e-227b-4909-a573-f40a736c7086 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:50.853165 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd07e3e-227b-4909-a573-f40a736c7086 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:50.853443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd07e3e-227b-4909-a573-f40a736c7086 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:50.854147 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd07e3e-227b-4909-a573-f40a736c7086 None admin] RBAC: Adding query filter params (name=member) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:13:50.854482 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd07e3e-227b-4909-a573-f40a736c7086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:50.856009 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd07e3e-227b-4909-a573-f40a736c7086 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:50.856962 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6adef-519f-4d12-ac9e-a97f85c13907 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:50.868278 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 36/71] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:13:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:13:50.869793 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb990ab4-e5e1-44ec-aa8e-f33a0476f0ba None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:50.870099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb990ab4-e5e1-44ec-aa8e-f33a0476f0ba None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:50.870381 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb990ab4-e5e1-44ec-aa8e-f33a0476f0ba None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:50.872109 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 37/72] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:13:50.872761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb990ab4-e5e1-44ec-aa8e-f33a0476f0ba None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:50.995629 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb990ab4-e5e1-44ec-aa8e-f33a0476f0ba None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:51.007542 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6adef-519f-4d12-ac9e-a97f85c13907 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:51.043647 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a3f49-8bd3-4900-86f8-4642f0c7691b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:51.044306 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a3f49-8bd3-4900-86f8-4642f0c7691b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:51.044585 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a3f49-8bd3-4900-86f8-4642f0c7691b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:51.044856 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a3f49-8bd3-4900-86f8-4642f0c7691b None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:51.045546 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a3f49-8bd3-4900-86f8-4642f0c7691b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:13:51.045856 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a3f49-8bd3-4900-86f8-4642f0c7691b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:51.047271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a3f49-8bd3-4900-86f8-4642f0c7691b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:51.058008 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 38/73] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:13:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:51.059936 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def19a8f-b0ca-4834-bf37-049b70c07a1d None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:51.059936 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def19a8f-b0ca-4834-bf37-049b70c07a1d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:51.059936 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def19a8f-b0ca-4834-bf37-049b70c07a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:51.063509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f35858-6016-4308-be62-7433ac371591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:51.064505 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f35858-6016-4308-be62-7433ac371591 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:51.064963 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f35858-6016-4308-be62-7433ac371591 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:51.066670 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f35858-6016-4308-be62-7433ac371591 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:51.079457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f35858-6016-4308-be62-7433ac371591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:13:51.085456 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-def19a8f-b0ca-4834-bf37-049b70c07a1d None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:13:51.085713 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-d3f35858-6016-4308-be62-7433ac371591 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:13:51.085713 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:13:51.085713 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:13:51.085713 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:13:51.085713 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:13:51.085713 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:13:51.085713 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:13:51.085713 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:13:51.085713 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:13:51.085713 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:13:51.085713 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:13:51.085713 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:13:51.085713 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:13:51.085713 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:13:51.085713 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:13:51.085713 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:13:51.092196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:13:51.092196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:13:51.092196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:13:51.092196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:13:51.092196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:13:51.092196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:13:51.092196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:13:51.092196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:13:51.092196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:13:51.092196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:13:51.092196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:13:51.092196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:13:51.092196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:13:51.092196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:13:51.092196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:13:51.092196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:13:51.093290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:13:51.093290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:13:51.093290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:13:51.093290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:13:51.093290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:13:51.093290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:13:51.093290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:13:51.093290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:13:51.093290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:13:51.093290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:13:51.093290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:13:51.093290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:13:51.093917 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-def19a8f-b0ca-4834-bf37-049b70c07a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:13:51.093998 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 36/74] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Oct 4 14:13:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:13:51.093998 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13592af0-1e9a-4d81-b84d-305c24737925 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:51.093998 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13592af0-1e9a-4d81-b84d-305c24737925 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:51.093998 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13592af0-1e9a-4d81-b84d-305c24737925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:51.119962 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-13592af0-1e9a-4d81-b84d-305c24737925 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:13:51.121301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-13592af0-1e9a-4d81-b84d-305c24737925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:13:51.141807 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:51.150766 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:51.170580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 39/75] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:13:51.171426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def19a8f-b0ca-4834-bf37-049b70c07a1d None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:51.225867 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 37/76] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:13:51.230349 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13592af0-1e9a-4d81-b84d-305c24737925 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:51.304812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def19a8f-b0ca-4834-bf37-049b70c07a1d None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:51.354380 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2824db2-6d76-47bf-8259-c01fc747c448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:51.355449 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2824db2-6d76-47bf-8259-c01fc747c448 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:51.356486 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2824db2-6d76-47bf-8259-c01fc747c448 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:51.357054 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2824db2-6d76-47bf-8259-c01fc747c448 None admin] PATH_INFO: `/v3/users/0edc99bb2191439ca8839bea31becd96` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:51.381411 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2824db2-6d76-47bf-8259-c01fc747c448 None admin] RBAC: Authorizing `identity:get_user(user_id=0edc99bb2191439ca8839bea31becd96)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:51.383563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2824db2-6d76-47bf-8259-c01fc747c448 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:51.386672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 40/77] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:13:51 2022] GET /identity/v3/users/0edc99bb2191439ca8839bea31becd96 => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:51.387888 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2824db2-6d76-47bf-8259-c01fc747c448 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:51.442137 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:51.456887 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13592af0-1e9a-4d81-b84d-305c24737925 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:51.527068 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652c1cc-a534-445b-be7f-4637c5f949ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:51.528416 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652c1cc-a534-445b-be7f-4637c5f949ff None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:51.528950 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652c1cc-a534-445b-be7f-4637c5f949ff None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:51.529549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652c1cc-a534-445b-be7f-4637c5f949ff None admin] PATH_INFO: `/v3/users/ea10fbfe4b4e4d64acf7b2c318e4a8a1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:51.531683 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652c1cc-a534-445b-be7f-4637c5f949ff None admin] RBAC: Authorizing `identity:get_user(user_id=ea10fbfe4b4e4d64acf7b2c318e4a8a1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:51.535441 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652c1cc-a534-445b-be7f-4637c5f949ff None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:51.542095 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 38/78] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:13:51 2022] GET /identity/v3/users/ea10fbfe4b4e4d64acf7b2c318e4a8a1 => generated 247 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:51.542095 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652c1cc-a534-445b-be7f-4637c5f949ff None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:51.563145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2824db2-6d76-47bf-8259-c01fc747c448 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:51.597500 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:51.622937 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b27b8a-0deb-420f-8c99-f03a8f9c91cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:51.624037 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b27b8a-0deb-420f-8c99-f03a8f9c91cc None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:51.624521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b27b8a-0deb-420f-8c99-f03a8f9c91cc None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:51.625628 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b27b8a-0deb-420f-8c99-f03a8f9c91cc None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:51.626739 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b27b8a-0deb-420f-8c99-f03a8f9c91cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:13:51.627051 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b27b8a-0deb-420f-8c99-f03a8f9c91cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:51.629474 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b27b8a-0deb-420f-8c99-f03a8f9c91cc None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:51.643472 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 41/79] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:13:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:51.644594 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b27b8a-0deb-420f-8c99-f03a8f9c91cc None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:51.705970 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652c1cc-a534-445b-be7f-4637c5f949ff None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:51.749682 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18456e9d-9d48-4296-8727-6e4b41b4aaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:51.750496 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18456e9d-9d48-4296-8727-6e4b41b4aaf6 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:51.750774 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18456e9d-9d48-4296-8727-6e4b41b4aaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:51.751096 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18456e9d-9d48-4296-8727-6e4b41b4aaf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:51.770711 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:51.781287 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b27b8a-0deb-420f-8c99-f03a8f9c91cc None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:51.818418 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2418f3-1f3f-4f5d-8ddb-88a1b94b02b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:51.818963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2418f3-1f3f-4f5d-8ddb-88a1b94b02b5 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:51.819243 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2418f3-1f3f-4f5d-8ddb-88a1b94b02b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:51.819514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2418f3-1f3f-4f5d-8ddb-88a1b94b02b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:51.831799 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18456e9d-9d48-4296-8727-6e4b41b4aaf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:51.834169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18456e9d-9d48-4296-8727-6e4b41b4aaf6 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:51.882512 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:51.908396 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2418f3-1f3f-4f5d-8ddb-88a1b94b02b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:51.911631 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2418f3-1f3f-4f5d-8ddb-88a1b94b02b5 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:51.969035 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 39/80] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:13:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:13:51.970171 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18456e9d-9d48-4296-8727-6e4b41b4aaf6 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:52.027378 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:52.040838 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 42/81] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:13:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:13:52.042264 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2418f3-1f3f-4f5d-8ddb-88a1b94b02b5 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:52.095363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18456e9d-9d48-4296-8727-6e4b41b4aaf6 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:52.125086 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:52.135456 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ac363-f220-4505-ac94-ef7e04f1cbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:52.136140 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ac363-f220-4505-ac94-ef7e04f1cbc5 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:52.136422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ac363-f220-4505-ac94-ef7e04f1cbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:52.136703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ac363-f220-4505-ac94-ef7e04f1cbc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:52.137868 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ac363-f220-4505-ac94-ef7e04f1cbc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:52.139351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ac363-f220-4505-ac94-ef7e04f1cbc5 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:52.141078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 40/82] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:13:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:52.141078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ac363-f220-4505-ac94-ef7e04f1cbc5 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:52.167142 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2418f3-1f3f-4f5d-8ddb-88a1b94b02b5 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:52.215542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494c81a-81d3-4363-b973-456779fa5496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:52.216627 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494c81a-81d3-4363-b973-456779fa5496 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:52.217038 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494c81a-81d3-4363-b973-456779fa5496 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:52.217500 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494c81a-81d3-4363-b973-456779fa5496 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:52.229920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494c81a-81d3-4363-b973-456779fa5496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:13:52.234986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-b494c81a-81d3-4363-b973-456779fa5496 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:13:52.234986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:13:52.234986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:13:52.234986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:13:52.234986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:13:52.234986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:13:52.234986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:13:52.234986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:13:52.234986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:13:52.234986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:13:52.234986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:13:52.234986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:13:52.234986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:13:52.234986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:13:52.234986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:13:52.234986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:13:52.236284 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:13:52.236284 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:13:52.236284 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:13:52.236284 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:13:52.236284 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:13:52.236284 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:13:52.236284 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:13:52.236284 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:13:52.236284 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:13:52.236284 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:13:52.236284 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:13:52.236284 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:13:52.236284 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:13:52.236284 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:13:52.236284 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:13:52.236284 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:13:52.237122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:13:52.237122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:13:52.237122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:13:52.237122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:13:52.237122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:13:52.237122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:13:52.237122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:13:52.237122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:13:52.237122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:13:52.237122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:13:52.237122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:13:52.237122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:13:52.237122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 43/83] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:13:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:13:52.237122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494c81a-81d3-4363-b973-456779fa5496 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:52.274122 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ac363-f220-4505-ac94-ef7e04f1cbc5 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:52.314180 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:52.314381 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cc1c2-eaf4-4ada-b91d-4d7aa1f094b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:52.315150 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cc1c2-eaf4-4ada-b91d-4d7aa1f094b3 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:52.315424 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cc1c2-eaf4-4ada-b91d-4d7aa1f094b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:52.315736 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cc1c2-eaf4-4ada-b91d-4d7aa1f094b3 None admin] PATH_INFO: `/v3/users/0edc99bb2191439ca8839bea31becd96` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:52.317230 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cc1c2-eaf4-4ada-b91d-4d7aa1f094b3 None admin] RBAC: Authorizing `identity:get_user(user_id=0edc99bb2191439ca8839bea31becd96)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:52.318743 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cc1c2-eaf4-4ada-b91d-4d7aa1f094b3 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:52.320470 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 41/84] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:13:52 2022] GET /identity/v3/users/0edc99bb2191439ca8839bea31becd96 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:52.320470 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cc1c2-eaf4-4ada-b91d-4d7aa1f094b3 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:52.380579 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494c81a-81d3-4363-b973-456779fa5496 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:52.407514 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:52.431913 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcf9fd-07cc-434a-8b08-4ace787ef7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:52.432575 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcf9fd-07cc-434a-8b08-4ace787ef7ec None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:52.432905 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcf9fd-07cc-434a-8b08-4ace787ef7ec None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:52.433292 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcf9fd-07cc-434a-8b08-4ace787ef7ec None admin] PATH_INFO: `/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:52.434605 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bcf9fd-07cc-434a-8b08-4ace787ef7ec None admin] RBAC: Authorizing `identity:get_project(project_id=0c72ec4a5e6f40ac84de3c903eedf1d3)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:52.436110 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bcf9fd-07cc-434a-8b08-4ace787ef7ec None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:52.438068 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 44/85] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:13:52 2022] GET /identity/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:52.438820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcf9fd-07cc-434a-8b08-4ace787ef7ec None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:52.478222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cc1c2-eaf4-4ada-b91d-4d7aa1f094b3 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:52.517662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f92284-8dd4-445f-ba69-d92e13dfd493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:52.519502 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f92284-8dd4-445f-ba69-d92e13dfd493 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:52.519878 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f92284-8dd4-445f-ba69-d92e13dfd493 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:52.520276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f92284-8dd4-445f-ba69-d92e13dfd493 None admin] PATH_INFO: `/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:52.521729 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f92284-8dd4-445f-ba69-d92e13dfd493 None admin] RBAC: Authorizing `identity:get_project(project_id=0c72ec4a5e6f40ac84de3c903eedf1d3)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:52.523461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f92284-8dd4-445f-ba69-d92e13dfd493 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:52.531126 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 42/86] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:13:52 2022] GET /identity/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:52.531126 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f92284-8dd4-445f-ba69-d92e13dfd493 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:52.573186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcf9fd-07cc-434a-8b08-4ace787ef7ec None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:52.600085 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:52.613644 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf088bf7-c7e0-4025-8d7e-3be1473f480a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:52.614311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf088bf7-c7e0-4025-8d7e-3be1473f480a None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:52.614587 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf088bf7-c7e0-4025-8d7e-3be1473f480a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:52.614855 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf088bf7-c7e0-4025-8d7e-3be1473f480a None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:52.615538 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf088bf7-c7e0-4025-8d7e-3be1473f480a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:52.617063 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf088bf7-c7e0-4025-8d7e-3be1473f480a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:52.655797 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 45/87] 10.222.0.62 () {60 vars in 1132 bytes} [Tue Oct 4 14:13:52 2022] POST /identity/v3/users => generated 289 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:13:52.655797 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf088bf7-c7e0-4025-8d7e-3be1473f480a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:52.656573 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f92284-8dd4-445f-ba69-d92e13dfd493 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:52.695672 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:52.704291 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74379c-89b8-4fae-91f8-f48330022ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:52.705307 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74379c-89b8-4fae-91f8-f48330022ffa None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:52.705895 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74379c-89b8-4fae-91f8-f48330022ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:52.706350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74379c-89b8-4fae-91f8-f48330022ffa None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:52.707194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74379c-89b8-4fae-91f8-f48330022ffa None admin] RBAC: Adding query filter params (name=member) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:13:52.707655 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74379c-89b8-4fae-91f8-f48330022ffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:52.709474 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74379c-89b8-4fae-91f8-f48330022ffa None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:52.720450 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 43/88] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:13:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:52.728215 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74379c-89b8-4fae-91f8-f48330022ffa None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:52.833572 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf088bf7-c7e0-4025-8d7e-3be1473f480a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:52.872325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74379c-89b8-4fae-91f8-f48330022ffa None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:52.886412 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562588e9-1616-4ffe-aa09-6620cc2c4974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:52.887054 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562588e9-1616-4ffe-aa09-6620cc2c4974 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:52.887347 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562588e9-1616-4ffe-aa09-6620cc2c4974 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:52.887620 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562588e9-1616-4ffe-aa09-6620cc2c4974 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:52.945254 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9103a-72ca-494b-b4ee-7bcee84ca548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:52.946226 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9103a-72ca-494b-b4ee-7bcee84ca548 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:52.946732 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9103a-72ca-494b-b4ee-7bcee84ca548 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:52.947232 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9103a-72ca-494b-b4ee-7bcee84ca548 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:52.948687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9103a-72ca-494b-b4ee-7bcee84ca548 None admin] RBAC: Adding query filter params (role.id=eb2435bb443d4469899fb3830f4ee5b1, scope.project.id=0c72ec4a5e6f40ac84de3c903eedf1d3, user.id=0edc99bb2191439ca8839bea31becd96) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:13:52.949255 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9103a-72ca-494b-b4ee-7bcee84ca548 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:52.952274 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9103a-72ca-494b-b4ee-7bcee84ca548 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:52.964897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:52.968849 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 44/89] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:13:52 2022] GET /identity/v3/role_assignments?user.id=0edc99bb2191439ca8839bea31becd96&scope.project.id=0c72ec4a5e6f40ac84de3c903eedf1d3&role.id=eb2435bb443d4469899fb3830f4ee5b1 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:52.968849 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9103a-72ca-494b-b4ee-7bcee84ca548 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:53.032490 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562588e9-1616-4ffe-aa09-6620cc2c4974 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:53.035563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562588e9-1616-4ffe-aa09-6620cc2c4974 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:53.107590 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:53.225585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9103a-72ca-494b-b4ee-7bcee84ca548 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:53.232332 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 46/90] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:13:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:13:53.233780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562588e9-1616-4ffe-aa09-6620cc2c4974 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:53.316597 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62972577-137b-40bd-bc27-c1c9faa33db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:53.319545 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62972577-137b-40bd-bc27-c1c9faa33db0 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:53.320406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62972577-137b-40bd-bc27-c1c9faa33db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:53.321138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62972577-137b-40bd-bc27-c1c9faa33db0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:53.323082 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62972577-137b-40bd-bc27-c1c9faa33db0 None admin] RBAC: Adding query filter params (role.id=a16b6daeda5b4a67992f3c12514ca90e, scope.project.id=0c72ec4a5e6f40ac84de3c903eedf1d3, user.id=ea10fbfe4b4e4d64acf7b2c318e4a8a1) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:13:53.323979 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62972577-137b-40bd-bc27-c1c9faa33db0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:53.327134 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62972577-137b-40bd-bc27-c1c9faa33db0 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:53.338300 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 45/91] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:13:52 2022] GET /identity/v3/role_assignments?user.id=ea10fbfe4b4e4d64acf7b2c318e4a8a1&scope.project.id=0c72ec4a5e6f40ac84de3c903eedf1d3&role.id=a16b6daeda5b4a67992f3c12514ca90e => generated 259 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:53.340310 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62972577-137b-40bd-bc27-c1c9faa33db0 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:53.348708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:53.379809 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562588e9-1616-4ffe-aa09-6620cc2c4974 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:53.426240 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64f167-21b3-49af-9687-5c0bde5bf53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:53.427177 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64f167-21b3-49af-9687-5c0bde5bf53a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:53.428925 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64f167-21b3-49af-9687-5c0bde5bf53a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:53.428925 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64f167-21b3-49af-9687-5c0bde5bf53a None admin] PATH_INFO: `/v3/users/0edc99bb2191439ca8839bea31becd96` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:53.429465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64f167-21b3-49af-9687-5c0bde5bf53a None admin] RBAC: Authorizing `identity:get_user(user_id=0edc99bb2191439ca8839bea31becd96)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:53.430974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64f167-21b3-49af-9687-5c0bde5bf53a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:53.435752 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 47/92] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:13:53 2022] GET /identity/v3/users/0edc99bb2191439ca8839bea31becd96 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:53.439128 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64f167-21b3-49af-9687-5c0bde5bf53a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:53.573235 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64f167-21b3-49af-9687-5c0bde5bf53a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:53.653389 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62972577-137b-40bd-bc27-c1c9faa33db0 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:53.668179 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3c767-ce1a-40f6-9d1d-801da010187c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:53.669187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3c767-ce1a-40f6-9d1d-801da010187c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:53.669613 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3c767-ce1a-40f6-9d1d-801da010187c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:53.670071 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3c767-ce1a-40f6-9d1d-801da010187c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:53.722413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:53.737957 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:53.768828 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f438472-7f07-4526-9b3e-5d1cc4e8722d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:53.769501 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f438472-7f07-4526-9b3e-5d1cc4e8722d None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:53.769788 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f438472-7f07-4526-9b3e-5d1cc4e8722d None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:53.770071 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f438472-7f07-4526-9b3e-5d1cc4e8722d None admin] PATH_INFO: `/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:53.771408 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f438472-7f07-4526-9b3e-5d1cc4e8722d None admin] RBAC: Authorizing `identity:get_project(project_id=0c72ec4a5e6f40ac84de3c903eedf1d3)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:53.772992 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f438472-7f07-4526-9b3e-5d1cc4e8722d None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:53.776784 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 46/93] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:13:53 2022] GET /identity/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3 => generated 298 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:53.781060 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f438472-7f07-4526-9b3e-5d1cc4e8722d None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:53.857076 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a3c767-ce1a-40f6-9d1d-801da010187c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:53.859945 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a3c767-ce1a-40f6-9d1d-801da010187c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:54.026086 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f438472-7f07-4526-9b3e-5d1cc4e8722d None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:54.116363 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 48/94] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:13:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:13:54.125744 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3c767-ce1a-40f6-9d1d-801da010187c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:54.149078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0343a-97b7-4c61-9579-919279c1f81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:54.150175 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0343a-97b7-4c61-9579-919279c1f81f None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:54.150678 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0343a-97b7-4c61-9579-919279c1f81f None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:54.151186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0343a-97b7-4c61-9579-919279c1f81f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:54.152761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0343a-97b7-4c61-9579-919279c1f81f None admin] RBAC: Adding query filter params (role.id=c3d8f302f6714108ac91c25b8a32d36b, scope.project.id=0c72ec4a5e6f40ac84de3c903eedf1d3, user.id=0edc99bb2191439ca8839bea31becd96) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:13:54.153333 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0343a-97b7-4c61-9579-919279c1f81f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:54.156420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0343a-97b7-4c61-9579-919279c1f81f None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:54.183372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 47/95] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:13:53 2022] GET /identity/v3/role_assignments?user.id=0edc99bb2191439ca8839bea31becd96&scope.project.id=0c72ec4a5e6f40ac84de3c903eedf1d3&role.id=c3d8f302f6714108ac91c25b8a32d36b => generated 259 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:54.272532 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:54.402262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3c767-ce1a-40f6-9d1d-801da010187c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:54.464753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84490fb6-2727-444f-ad74-a573f6d6978a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:54.466205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84490fb6-2727-444f-ad74-a573f6d6978a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:54.466904 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84490fb6-2727-444f-ad74-a573f6d6978a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:54.467588 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84490fb6-2727-444f-ad74-a573f6d6978a None admin] PATH_INFO: `/v3/projects/5ab3676208e64c22b75790caead587b8` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:54.469850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84490fb6-2727-444f-ad74-a573f6d6978a None admin] RBAC: Authorizing `identity:get_project(project_id=5ab3676208e64c22b75790caead587b8)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:54.473133 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84490fb6-2727-444f-ad74-a573f6d6978a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:54.476699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 49/96] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:13:54 2022] GET /identity/v3/projects/5ab3676208e64c22b75790caead587b8 => generated 312 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:54.490349 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0343a-97b7-4c61-9579-919279c1f81f None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:54.619597 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:54.692895 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0343a-97b7-4c61-9579-919279c1f81f None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:54.734137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7aa850-4d88-4f04-88fc-a4df1a20c1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:54.735119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7aa850-4d88-4f04-88fc-a4df1a20c1ce None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:54.735625 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7aa850-4d88-4f04-88fc-a4df1a20c1ce None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:54.736133 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7aa850-4d88-4f04-88fc-a4df1a20c1ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:54.737700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7aa850-4d88-4f04-88fc-a4df1a20c1ce None admin] RBAC: Adding query filter params (role.id=eb2435bb443d4469899fb3830f4ee5b1, scope.project.id=5ab3676208e64c22b75790caead587b8, user.id=0edc99bb2191439ca8839bea31becd96) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:13:54.738244 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7aa850-4d88-4f04-88fc-a4df1a20c1ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:54.739989 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7aa850-4d88-4f04-88fc-a4df1a20c1ce None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:54.750770 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 48/97] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:13:54 2022] GET /identity/v3/role_assignments?user.id=0edc99bb2191439ca8839bea31becd96&scope.project.id=5ab3676208e64c22b75790caead587b8&role.id=eb2435bb443d4469899fb3830f4ee5b1 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:56.878324 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747ed0a-d204-4880-baf2-d750fc0d6dcf None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:56.879377 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747ed0a-d204-4880-baf2-d750fc0d6dcf None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:56.879896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747ed0a-d204-4880-baf2-d750fc0d6dcf None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:56.881568 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 50/98] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:13:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:13:56.887542 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90585183-0396-4d33-8461-90b1450c209f None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:56.888518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90585183-0396-4d33-8461-90b1450c209f None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:56.888999 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90585183-0396-4d33-8461-90b1450c209f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:56.914092 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-90585183-0396-4d33-8461-90b1450c209f None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:13:56.915672 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-90585183-0396-4d33-8461-90b1450c209f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:13:56.942802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ffb8c-7f24-4fd7-bdf2-f8b13c036c47 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:56.943418 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ffb8c-7f24-4fd7-bdf2-f8b13c036c47 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:56.943955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ffb8c-7f24-4fd7-bdf2-f8b13c036c47 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:56.945568 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 51/99] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:13:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:13:56.951971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf37e8-2760-42a1-ac92-4d0d13065e1a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:56.952574 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf37e8-2760-42a1-ac92-4d0d13065e1a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:56.953043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf37e8-2760-42a1-ac92-4d0d13065e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:56.985912 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-39bf37e8-2760-42a1-ac92-4d0d13065e1a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:13:56.988499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-39bf37e8-2760-42a1-ac92-4d0d13065e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:13:57.062155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 49/100] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:13:57.165546 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 52/101] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 14:13:57.492263 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddbddc-f20c-4aae-a20e-45ea9f8fc9f6 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:57.492746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddbddc-f20c-4aae-a20e-45ea9f8fc9f6 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:57.493311 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddbddc-f20c-4aae-a20e-45ea9f8fc9f6 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:57.495800 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 50/102] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:13:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:13:57.504784 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503d344-bf14-4bf0-9b33-339e464b6227 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:57.505264 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503d344-bf14-4bf0-9b33-339e464b6227 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:57.505730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503d344-bf14-4bf0-9b33-339e464b6227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:57.542437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-b503d344-bf14-4bf0-9b33-339e464b6227 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:13:57.544067 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b503d344-bf14-4bf0-9b33-339e464b6227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:13:57.563993 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddbddc-f20c-4aae-a20e-45ea9f8fc9f6 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:57.630901 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:57.672048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:57.714471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 53/103] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:13:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 14:13:57.745577 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503d344-bf14-4bf0-9b33-339e464b6227 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:57.854251 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddbddc-f20c-4aae-a20e-45ea9f8fc9f6 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:57.961727 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3a772-7a2d-4f72-9f6a-af744fb5a0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:57.962748 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3a772-7a2d-4f72-9f6a-af744fb5a0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:57.962748 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3a772-7a2d-4f72-9f6a-af744fb5a0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:57.962988 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3a772-7a2d-4f72-9f6a-af744fb5a0c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:57.991775 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3a772-7a2d-4f72-9f6a-af744fb5a0c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:13:58.000959 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503d344-bf14-4bf0-9b33-339e464b6227 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:58.006222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-deb3a772-7a2d-4f72-9f6a-af744fb5a0c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:13:58.006222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:13:58.006222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:13:58.006222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:13:58.006222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:13:58.006222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:13:58.006222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:13:58.006222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:13:58.006222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:13:58.006222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:13:58.006222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:13:58.006222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:13:58.006222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:13:58.006222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:13:58.006222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:13:58.006222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:13:58.007157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:13:58.007157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:13:58.007157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:13:58.007157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:13:58.007157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:13:58.007157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:13:58.007157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:13:58.007157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:13:58.007157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:13:58.007157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:13:58.007157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:13:58.007157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:13:58.007157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:13:58.007157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:13:58.007157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:13:58.007157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:13:58.007952 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:13:58.007952 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:13:58.007952 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:13:58.007952 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:13:58.007952 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:13:58.007952 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:13:58.007952 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:13:58.007952 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:13:58.007952 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:13:58.007952 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:13:58.007952 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:13:58.007952 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:13:58.007952 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 51/104] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:13:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 444 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:13:58.014254 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3a772-7a2d-4f72-9f6a-af744fb5a0c4 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:58.078649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374dc8b-ca1b-460a-b01b-8a4e541d3b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:58.079917 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374dc8b-ca1b-460a-b01b-8a4e541d3b4e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:58.080445 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374dc8b-ca1b-460a-b01b-8a4e541d3b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:58.080934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374dc8b-ca1b-460a-b01b-8a4e541d3b4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:58.083907 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374dc8b-ca1b-460a-b01b-8a4e541d3b4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:58.086834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374dc8b-ca1b-460a-b01b-8a4e541d3b4e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:58.090175 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 54/105] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:13:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:13:58.100021 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374dc8b-ca1b-460a-b01b-8a4e541d3b4e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:58.195638 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:58.246175 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3a772-7a2d-4f72-9f6a-af744fb5a0c4 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:58.255774 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:58.316153 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f65f0-d416-468c-91de-05825cf9df38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:58.317147 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f65f0-d416-468c-91de-05825cf9df38 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:58.317581 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f65f0-d416-468c-91de-05825cf9df38 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:58.318087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f65f0-d416-468c-91de-05825cf9df38 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:58.319393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f65f0-d416-468c-91de-05825cf9df38 None admin] RBAC: Adding query filter params (name=member) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:13:58.319921 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f65f0-d416-468c-91de-05825cf9df38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:58.322067 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f65f0-d416-468c-91de-05825cf9df38 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:58.326035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374dc8b-ca1b-460a-b01b-8a4e541d3b4e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:58.333510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 52/106] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:13:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:13:58.334827 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8ee08-6139-4227-88bd-505445264d9a None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:58.335107 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8ee08-6139-4227-88bd-505445264d9a None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:58.335377 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8ee08-6139-4227-88bd-505445264d9a None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:58.341499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 53/107] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:13:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:13:58.342481 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa4b8e-3901-4d79-9183-e8be5c881209 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:58.342822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa4b8e-3901-4d79-9183-e8be5c881209 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:58.343206 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa4b8e-3901-4d79-9183-e8be5c881209 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:58.351827 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 54/108] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:13:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:13:58.351827 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa4b8e-3901-4d79-9183-e8be5c881209 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:58.393717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dc55f-202e-4eae-a963-e6e4937ef114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:58.395138 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dc55f-202e-4eae-a963-e6e4937ef114 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:58.395857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dc55f-202e-4eae-a963-e6e4937ef114 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:58.396521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dc55f-202e-4eae-a963-e6e4937ef114 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:58.398004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dc55f-202e-4eae-a963-e6e4937ef114 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:58.401881 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dc55f-202e-4eae-a963-e6e4937ef114 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:58.454568 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 55/109] 10.222.0.62 () {60 vars in 1141 bytes} [Tue Oct 4 14:13:58 2022] POST /identity/v3/projects => generated 302 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:13:58.471555 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd7c4d-1e6b-46cc-b13c-ae3dfac93910 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:58.472229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd7c4d-1e6b-46cc-b13c-ae3dfac93910 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:58.472721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd7c4d-1e6b-46cc-b13c-ae3dfac93910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:58.509314 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-b7cd7c4d-1e6b-46cc-b13c-ae3dfac93910 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:13:58.513780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b7cd7c4d-1e6b-46cc-b13c-ae3dfac93910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:13:58.603013 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa4b8e-3901-4d79-9183-e8be5c881209 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:58.625370 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 56/110] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:13:58.626944 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0333c9-ec92-45ae-b645-0bf0c6b00ac9 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:58.630045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0333c9-ec92-45ae-b645-0bf0c6b00ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:58.630720 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0333c9-ec92-45ae-b645-0bf0c6b00ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:58.653135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-9d0333c9-ec92-45ae-b645-0bf0c6b00ac9 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:13:58.654807 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9d0333c9-ec92-45ae-b645-0bf0c6b00ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:13:58.659942 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b2adf-f8b0-4498-b89b-5cd5ccc384d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:58.661235 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b2adf-f8b0-4498-b89b-5cd5ccc384d6 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:58.661868 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b2adf-f8b0-4498-b89b-5cd5ccc384d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:58.662312 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b2adf-f8b0-4498-b89b-5cd5ccc384d6 None admin] PATH_INFO: `/v3/users/0edc99bb2191439ca8839bea31becd96` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:58.664079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b2adf-f8b0-4498-b89b-5cd5ccc384d6 None admin] RBAC: Authorizing `identity:get_user(user_id=0edc99bb2191439ca8839bea31becd96)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:58.667041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b2adf-f8b0-4498-b89b-5cd5ccc384d6 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:58.669510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 55/111] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:13:58 2022] GET /identity/v3/users/0edc99bb2191439ca8839bea31becd96 => generated 275 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:58.670684 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b2adf-f8b0-4498-b89b-5cd5ccc384d6 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:58.684343 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:58.741413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:58.815826 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 57/112] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:13:58.815826 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0333c9-ec92-45ae-b645-0bf0c6b00ac9 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:58.866954 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b2adf-f8b0-4498-b89b-5cd5ccc384d6 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:58.972731 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0333c9-ec92-45ae-b645-0bf0c6b00ac9 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:59.010682 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116d0dd-a1e6-4cc8-a014-7b6157e37a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:59.011873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116d0dd-a1e6-4cc8-a014-7b6157e37a58 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:59.012346 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116d0dd-a1e6-4cc8-a014-7b6157e37a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:59.012805 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116d0dd-a1e6-4cc8-a014-7b6157e37a58 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:59.025642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336dbd9-4096-476d-baac-16e09ed36718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:59.026804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336dbd9-4096-476d-baac-16e09ed36718 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:59.027262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336dbd9-4096-476d-baac-16e09ed36718 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:59.027730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336dbd9-4096-476d-baac-16e09ed36718 None admin] PATH_INFO: `/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:59.030310 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336dbd9-4096-476d-baac-16e09ed36718 None admin] RBAC: Authorizing `identity:get_project(project_id=0c72ec4a5e6f40ac84de3c903eedf1d3)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:59.031822 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336dbd9-4096-476d-baac-16e09ed36718 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:59.034570 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 58/113] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:13:58 2022] GET /identity/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:59.040101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336dbd9-4096-476d-baac-16e09ed36718 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:59.053473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116d0dd-a1e6-4cc8-a014-7b6157e37a58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:13:59.059338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-d116d0dd-a1e6-4cc8-a014-7b6157e37a58 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 14:13:59.059338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:13:59.059338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:13:59.059338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:13:59.059338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:13:59.059338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:13:59.059338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:13:59.059338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:13:59.059338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:13:59.059338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:13:59.059338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:13:59.059338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:13:59.059338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:13:59.059338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:13:59.059338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:13:59.059338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:13:59.061163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:13:59.061163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:13:59.061163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:13:59.061163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:13:59.061163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:13:59.061163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:13:59.061163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:13:59.061163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:13:59.061163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:13:59.061163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:13:59.061163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:13:59.061163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:13:59.061163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:13:59.061163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:13:59.061163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:13:59.061163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:13:59.062939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:13:59.062939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:13:59.062939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:13:59.062939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:13:59.062939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:13:59.062939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:13:59.062939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:13:59.062939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:13:59.062939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:13:59.062939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:13:59.062939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 14:13:59.062939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:13:59.069080 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 56/114] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:13:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:13:59.076792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116d0dd-a1e6-4cc8-a014-7b6157e37a58 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:59.078625 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:59.236185 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:59.243680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336dbd9-4096-476d-baac-16e09ed36718 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:59.244891 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116d0dd-a1e6-4cc8-a014-7b6157e37a58 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:59.289803 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd6970-5b73-4f32-b841-ddca23e2c188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:59.290737 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd6970-5b73-4f32-b841-ddca23e2c188 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:59.291384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd6970-5b73-4f32-b841-ddca23e2c188 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:59.291846 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd6970-5b73-4f32-b841-ddca23e2c188 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:59.293412 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd6970-5b73-4f32-b841-ddca23e2c188 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:13:59.293911 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd6970-5b73-4f32-b841-ddca23e2c188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:59.295876 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd6970-5b73-4f32-b841-ddca23e2c188 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:59.309581 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 57/115] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:13:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:59.314610 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776a15c-b183-4209-a18d-2341d2f96b11 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:59.314610 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776a15c-b183-4209-a18d-2341d2f96b11 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:59.314610 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776a15c-b183-4209-a18d-2341d2f96b11 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:59.314610 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 58/116] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:13:59.318670 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684926fc-7536-464a-834e-205c877f6024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:59.319758 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684926fc-7536-464a-834e-205c877f6024 None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:59.320195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684926fc-7536-464a-834e-205c877f6024 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:59.320617 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684926fc-7536-464a-834e-205c877f6024 None admin] PATH_INFO: `/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3/users/0edc99bb2191439ca8839bea31becd96/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:59.323392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684926fc-7536-464a-834e-205c877f6024 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c72ec4a5e6f40ac84de3c903eedf1d3, user_id=0edc99bb2191439ca8839bea31becd96, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:59.324424 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776a15c-b183-4209-a18d-2341d2f96b11 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:59.324947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684926fc-7536-464a-834e-205c877f6024 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:59.342534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 59/117] 10.222.0.62 () {58 vars in 1439 bytes} [Tue Oct 4 14:13:59 2022] PUT /identity/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3/users/0edc99bb2191439ca8839bea31becd96/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:13:59.343435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684926fc-7536-464a-834e-205c877f6024 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:59.539128 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:59.575548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684926fc-7536-464a-834e-205c877f6024 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:59.603356 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776a15c-b183-4209-a18d-2341d2f96b11 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:59.630820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc300724-5308-4f28-8788-12cae9cff42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:59.631485 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc300724-5308-4f28-8788-12cae9cff42a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:59.631826 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc300724-5308-4f28-8788-12cae9cff42a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:59.632103 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc300724-5308-4f28-8788-12cae9cff42a None admin] PATH_INFO: `/v3/users/db0bb520bef74888b1acc290d9cc9db9` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:59.653104 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc300724-5308-4f28-8788-12cae9cff42a None admin] RBAC: Authorizing `identity:get_user(user_id=db0bb520bef74888b1acc290d9cc9db9)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:13:59.654621 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc300724-5308-4f28-8788-12cae9cff42a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:13:59.656758 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 60/118] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:13:59 2022] GET /identity/v3/users/db0bb520bef74888b1acc290d9cc9db9 => generated 289 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:13:59.663783 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a3dfd-8506-4487-b131-6aa7860697e9 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:59.663783 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a3dfd-8506-4487-b131-6aa7860697e9 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:59.663783 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a3dfd-8506-4487-b131-6aa7860697e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:59.683330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc3335-35d0-408c-8950-db8251843cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:13:59.684297 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc3335-35d0-408c-8950-db8251843cfe None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:13:59.684751 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc3335-35d0-408c-8950-db8251843cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:13:59.685160 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc3335-35d0-408c-8950-db8251843cfe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:13:59.692254 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-d67a3dfd-8506-4487-b131-6aa7860697e9 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:13:59.694534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d67a3dfd-8506-4487-b131-6aa7860697e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:13:59.700931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc3335-35d0-408c-8950-db8251843cfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:13:59.706384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-96cc3335-35d0-408c-8950-db8251843cfe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:13:59.706384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:13:59.706384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:13:59.706384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:13:59.706384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:13:59.706384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:13:59.706384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:13:59.706384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:13:59.706384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:13:59.706384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:13:59.706384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:13:59.706384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:13:59.706384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:13:59.706384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:13:59.706384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:13:59.706384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:13:59.707309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:13:59.707309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:13:59.707309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:13:59.707309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:13:59.707309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:13:59.707309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:13:59.707309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:13:59.707309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:13:59.707309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:13:59.707309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:13:59.707309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:13:59.707309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:13:59.707309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:13:59.707309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:13:59.707309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:13:59.707309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:13:59.708120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:13:59.708120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:13:59.708120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:13:59.708120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:13:59.708120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:13:59.708120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:13:59.708120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:13:59.708120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:13:59.708120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:13:59.708120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:13:59.708120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:13:59.708120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:13:59.710381 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 59/119] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:13:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:13:59.712234 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc3335-35d0-408c-8950-db8251843cfe None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:59.753240 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:59.843050 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 61/120] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:13:59.844781 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a3dfd-8506-4487-b131-6aa7860697e9 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:13:59.913812 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc3335-35d0-408c-8950-db8251843cfe None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:13:59.954913 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:13:59.997246 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a3dfd-8506-4487-b131-6aa7860697e9 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:00.032476 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f775d23-6241-4902-a916-96069ac547cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:00.033219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f775d23-6241-4902-a916-96069ac547cc None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:00.033531 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f775d23-6241-4902-a916-96069ac547cc None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:00.034471 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f775d23-6241-4902-a916-96069ac547cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:00.042547 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29583516-1c08-4b51-a289-2bae47fd3929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:00.043972 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29583516-1c08-4b51-a289-2bae47fd3929 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:00.044494 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29583516-1c08-4b51-a289-2bae47fd3929 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:00.044957 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29583516-1c08-4b51-a289-2bae47fd3929 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:00.068804 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f775d23-6241-4902-a916-96069ac547cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:00.074186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-7f775d23-6241-4902-a916-96069ac547cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:14:00.074186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:00.074186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:00.074186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:00.074186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:00.074186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:00.074186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:00.074186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:00.074186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:00.074186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:00.074186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:00.074186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:00.074186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:00.074186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:00.074186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:00.074186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:00.075100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:00.075100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:00.075100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:00.075100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:00.075100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:00.075100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:00.075100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:00.075100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:00.075100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:00.075100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:00.075100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:00.075100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:00.075100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:00.075100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:00.075100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:00.075100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:00.075893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:00.075893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:00.075893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:00.075893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:00.075893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:00.075893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:00.075893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:00.075893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:00.075893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:00.075893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:00.075893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:14:00.075893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:14:00.075893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 60/121] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Oct 4 14:13:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:00.084480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f775d23-6241-4902-a916-96069ac547cc None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:00.135302 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29583516-1c08-4b51-a289-2bae47fd3929 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:00.137316 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29583516-1c08-4b51-a289-2bae47fd3929 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:00.281816 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:00.358541 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 62/122] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:13:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:14:00.360236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29583516-1c08-4b51-a289-2bae47fd3929 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:00.396369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:00.473863 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f775d23-6241-4902-a916-96069ac547cc None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:00.543989 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a56fb-8bda-49f1-b561-4e07a62f1e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:00.545023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a56fb-8bda-49f1-b561-4e07a62f1e06 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:00.545518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a56fb-8bda-49f1-b561-4e07a62f1e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:00.546005 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a56fb-8bda-49f1-b561-4e07a62f1e06 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:00.547436 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a56fb-8bda-49f1-b561-4e07a62f1e06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:00.548024 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a56fb-8bda-49f1-b561-4e07a62f1e06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:00.551312 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a56fb-8bda-49f1-b561-4e07a62f1e06 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:00.571544 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 61/123] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 496 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:00.573085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a56fb-8bda-49f1-b561-4e07a62f1e06 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:00.621065 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29583516-1c08-4b51-a289-2bae47fd3929 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:00.697838 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee5a70-473f-45d3-8269-1abebd9d3c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:00.698811 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee5a70-473f-45d3-8269-1abebd9d3c3e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:00.699586 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee5a70-473f-45d3-8269-1abebd9d3c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:00.699928 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee5a70-473f-45d3-8269-1abebd9d3c3e None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:00.701635 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee5a70-473f-45d3-8269-1abebd9d3c3e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:00.701954 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee5a70-473f-45d3-8269-1abebd9d3c3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:00.704177 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee5a70-473f-45d3-8269-1abebd9d3c3e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:00.715704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 63/124] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:14:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:00.716347 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee5a70-473f-45d3-8269-1abebd9d3c3e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:00.759350 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:00.792928 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a56fb-8bda-49f1-b561-4e07a62f1e06 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:00.847811 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee5a70-473f-45d3-8269-1abebd9d3c3e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:00.863700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a922b4-16c8-426a-88a7-1ec39db934a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:00.864385 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a922b4-16c8-426a-88a7-1ec39db934a1 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:00.864681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a922b4-16c8-426a-88a7-1ec39db934a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:00.864947 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a922b4-16c8-426a-88a7-1ec39db934a1 None admin] PATH_INFO: `/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:00.866732 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a922b4-16c8-426a-88a7-1ec39db934a1 None admin] RBAC: Authorizing `identity:get_project(project_id=0c72ec4a5e6f40ac84de3c903eedf1d3)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:00.868562 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a922b4-16c8-426a-88a7-1ec39db934a1 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:00.870332 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 62/125] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:00 2022] GET /identity/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3 => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:00.871118 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a922b4-16c8-426a-88a7-1ec39db934a1 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:00.886119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:00.916245 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e6953-fea1-4e63-9bcb-3f6b7aca2002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:00.918041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6953-fea1-4e63-9bcb-3f6b7aca2002 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:00.918558 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6953-fea1-4e63-9bcb-3f6b7aca2002 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:00.919171 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6953-fea1-4e63-9bcb-3f6b7aca2002 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:00.942224 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e6953-fea1-4e63-9bcb-3f6b7aca2002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:00.954415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-ed3e6953-fea1-4e63-9bcb-3f6b7aca2002 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:00.954415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:00.954415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:00.954415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:00.954415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:00.954415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:00.954415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:00.954415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:00.954415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:00.954415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:00.954415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:00.954415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:00.954415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:00.954415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:00.954415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:00.954415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:00.955948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:00.955948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:00.955948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:00.955948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:00.955948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:00.955948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:00.955948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:00.955948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:00.955948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:00.955948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:00.955948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:00.955948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:00.955948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:00.955948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:00.955948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:00.955948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:00.956717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:00.956717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:00.956717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:00.956717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:00.956717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:00.956717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:00.956717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:00.956717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:00.956717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:00.956717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:00.956717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:00.956717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:14:00.957388 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 64/126] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:00.964150 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e6953-fea1-4e63-9bcb-3f6b7aca2002 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:01.045386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a922b4-16c8-426a-88a7-1ec39db934a1 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:01.107111 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb765d-821c-4f53-a11b-5f92b8aea82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:01.107924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb765d-821c-4f53-a11b-5f92b8aea82b None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:01.108276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb765d-821c-4f53-a11b-5f92b8aea82b None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:01.108630 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb765d-821c-4f53-a11b-5f92b8aea82b None admin] PATH_INFO: `/v3/users/ea10fbfe4b4e4d64acf7b2c318e4a8a1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:01.110038 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb765d-821c-4f53-a11b-5f92b8aea82b None admin] RBAC: Authorizing `identity:get_user(user_id=ea10fbfe4b4e4d64acf7b2c318e4a8a1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:01.111672 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb765d-821c-4f53-a11b-5f92b8aea82b None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:01.113748 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 63/127] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:00 2022] GET /identity/v3/users/ea10fbfe4b4e4d64acf7b2c318e4a8a1 => generated 247 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:01.114480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb765d-821c-4f53-a11b-5f92b8aea82b None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:01.153720 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:01.166808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e6953-fea1-4e63-9bcb-3f6b7aca2002 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:01.212084 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3637a8a-3fbc-4e74-a5b0-b17944b185de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:01.213265 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3637a8a-3fbc-4e74-a5b0-b17944b185de None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:01.213265 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3637a8a-3fbc-4e74-a5b0-b17944b185de None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:01.213594 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3637a8a-3fbc-4e74-a5b0-b17944b185de None admin] PATH_INFO: `/v3/users/0edc99bb2191439ca8839bea31becd96` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:01.214982 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3637a8a-3fbc-4e74-a5b0-b17944b185de None admin] RBAC: Authorizing `identity:get_user(user_id=0edc99bb2191439ca8839bea31becd96)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:01.216630 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3637a8a-3fbc-4e74-a5b0-b17944b185de None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:01.218506 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 65/128] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:00 2022] GET /identity/v3/users/0edc99bb2191439ca8839bea31becd96 => generated 275 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:01.219442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3637a8a-3fbc-4e74-a5b0-b17944b185de None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:01.323810 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:01.344670 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3637a8a-3fbc-4e74-a5b0-b17944b185de None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:01.379297 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb765d-821c-4f53-a11b-5f92b8aea82b None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:01.386260 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c5e0a-9a0d-4e24-9c7f-5124114b9eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:01.387014 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c5e0a-9a0d-4e24-9c7f-5124114b9eeb None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:01.387349 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c5e0a-9a0d-4e24-9c7f-5124114b9eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:01.387692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c5e0a-9a0d-4e24-9c7f-5124114b9eeb None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:01.388475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c5e0a-9a0d-4e24-9c7f-5124114b9eeb None admin] RBAC: Adding query filter params (name=member) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:01.388848 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c5e0a-9a0d-4e24-9c7f-5124114b9eeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:01.390309 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c5e0a-9a0d-4e24-9c7f-5124114b9eeb None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:01.400141 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 66/129] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:14:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:01.405534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c5e0a-9a0d-4e24-9c7f-5124114b9eeb None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:01.438918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:01.456037 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad0053-0908-433b-b3f4-90b4d4e91c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:01.457351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad0053-0908-433b-b3f4-90b4d4e91c93 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:01.457975 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad0053-0908-433b-b3f4-90b4d4e91c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:01.458586 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad0053-0908-433b-b3f4-90b4d4e91c93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:01.460715 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad0053-0908-433b-b3f4-90b4d4e91c93 None admin] RBAC: Adding query filter params (role.id=d1857bfa9b524282b38b5bf1160e2473, scope.project.id=0c72ec4a5e6f40ac84de3c903eedf1d3, user.id=db0bb520bef74888b1acc290d9cc9db9) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:01.461005 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad0053-0908-433b-b3f4-90b4d4e91c93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:01.464053 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad0053-0908-433b-b3f4-90b4d4e91c93 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:01.477386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 64/130] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:14:01 2022] GET /identity/v3/role_assignments?user.id=db0bb520bef74888b1acc290d9cc9db9&scope.project.id=0c72ec4a5e6f40ac84de3c903eedf1d3&role.id=d1857bfa9b524282b38b5bf1160e2473 => generated 259 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:01.488443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad0053-0908-433b-b3f4-90b4d4e91c93 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:01.545742 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c5e0a-9a0d-4e24-9c7f-5124114b9eeb None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:01.590173 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ce866-bb57-4a21-8967-29fc751af691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:01.591240 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ce866-bb57-4a21-8967-29fc751af691 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:01.591879 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ce866-bb57-4a21-8967-29fc751af691 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:01.592365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ce866-bb57-4a21-8967-29fc751af691 None admin] PATH_INFO: `/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:01.593942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ce866-bb57-4a21-8967-29fc751af691 None admin] RBAC: Authorizing `identity:get_project(project_id=0c72ec4a5e6f40ac84de3c903eedf1d3)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:01.595921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ce866-bb57-4a21-8967-29fc751af691 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:01.598200 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 67/131] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:01 2022] GET /identity/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:01.599390 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ce866-bb57-4a21-8967-29fc751af691 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:01.716993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:01.730785 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ce866-bb57-4a21-8967-29fc751af691 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:01.755972 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad0053-0908-433b-b3f4-90b4d4e91c93 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:01.775117 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3670b1b-ec56-4838-877d-6dcdaaed841b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:01.776257 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3670b1b-ec56-4838-877d-6dcdaaed841b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:01.776759 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3670b1b-ec56-4838-877d-6dcdaaed841b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:01.777240 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3670b1b-ec56-4838-877d-6dcdaaed841b None admin] PATH_INFO: `/v3/users/0edc99bb2191439ca8839bea31becd96` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:01.778962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3670b1b-ec56-4838-877d-6dcdaaed841b None admin] RBAC: Authorizing `identity:get_user(user_id=0edc99bb2191439ca8839bea31becd96)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:01.780751 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3670b1b-ec56-4838-877d-6dcdaaed841b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:01.782842 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 68/132] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:01 2022] GET /identity/v3/users/0edc99bb2191439ca8839bea31becd96 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:01.785104 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3670b1b-ec56-4838-877d-6dcdaaed841b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:01.819399 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f1bcf-f620-4d3c-a5cb-0362a6458ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:01.820616 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f1bcf-f620-4d3c-a5cb-0362a6458ccb None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:01.820993 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f1bcf-f620-4d3c-a5cb-0362a6458ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:01.821464 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f1bcf-f620-4d3c-a5cb-0362a6458ccb None admin] PATH_INFO: `/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:01.823658 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f1bcf-f620-4d3c-a5cb-0362a6458ccb None admin] RBAC: Authorizing `identity:get_project(project_id=0c72ec4a5e6f40ac84de3c903eedf1d3)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:01.826477 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f1bcf-f620-4d3c-a5cb-0362a6458ccb None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:01.829600 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 65/133] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:01 2022] GET /identity/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3 => generated 298 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:01.831661 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f1bcf-f620-4d3c-a5cb-0362a6458ccb None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:01.850540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:01.929520 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3670b1b-ec56-4838-877d-6dcdaaed841b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:02.017526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18a18c-bdc1-4b10-ab6b-d18d801d227c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:02.019578 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18a18c-bdc1-4b10-ab6b-d18d801d227c None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:02.019901 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18a18c-bdc1-4b10-ab6b-d18d801d227c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:02.020189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18a18c-bdc1-4b10-ab6b-d18d801d227c None admin] PATH_INFO: `/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3/users/ea10fbfe4b4e4d64acf7b2c318e4a8a1/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:02.022331 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18a18c-bdc1-4b10-ab6b-d18d801d227c None admin] RBAC: Authorizing `identity:create_grant(project_id=0c72ec4a5e6f40ac84de3c903eedf1d3, user_id=ea10fbfe4b4e4d64acf7b2c318e4a8a1, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:02.030649 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f1bcf-f620-4d3c-a5cb-0362a6458ccb None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:02.031942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18a18c-bdc1-4b10-ab6b-d18d801d227c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:02.075998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 69/134] 10.222.0.62 () {58 vars in 1439 bytes} [Tue Oct 4 14:14:01 2022] PUT /identity/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3/users/ea10fbfe4b4e4d64acf7b2c318e4a8a1/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:14:02.077069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18a18c-bdc1-4b10-ab6b-d18d801d227c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:02.103383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dc918-110a-4a88-a18b-aed9c28e3dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:02.104594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dc918-110a-4a88-a18b-aed9c28e3dac None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:02.105083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dc918-110a-4a88-a18b-aed9c28e3dac None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:02.105584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dc918-110a-4a88-a18b-aed9c28e3dac None admin] PATH_INFO: `/v3/projects/5ab3676208e64c22b75790caead587b8` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:02.108006 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96dc918-110a-4a88-a18b-aed9c28e3dac None admin] RBAC: Authorizing `identity:get_project(project_id=5ab3676208e64c22b75790caead587b8)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:02.111064 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96dc918-110a-4a88-a18b-aed9c28e3dac None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:02.115500 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 66/135] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:01 2022] GET /identity/v3/projects/5ab3676208e64c22b75790caead587b8 => generated 312 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:02.129041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:02.130291 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dc918-110a-4a88-a18b-aed9c28e3dac None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:02.270782 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18a18c-bdc1-4b10-ab6b-d18d801d227c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:02.313650 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:02.365433 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14a7b4-3016-4988-aad3-92a01bd9d37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:02.366580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14a7b4-3016-4988-aad3-92a01bd9d37e None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:02.367326 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14a7b4-3016-4988-aad3-92a01bd9d37e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:02.367937 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14a7b4-3016-4988-aad3-92a01bd9d37e None admin] PATH_INFO: `/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3/users/0edc99bb2191439ca8839bea31becd96/roles/c3d8f302f6714108ac91c25b8a32d36b` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:02.371319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dc918-110a-4a88-a18b-aed9c28e3dac None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:02.371799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14a7b4-3016-4988-aad3-92a01bd9d37e None admin] RBAC: Authorizing `identity:create_grant(project_id=0c72ec4a5e6f40ac84de3c903eedf1d3, user_id=0edc99bb2191439ca8839bea31becd96, role_id=c3d8f302f6714108ac91c25b8a32d36b)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:02.373674 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14a7b4-3016-4988-aad3-92a01bd9d37e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:02.400616 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 70/136] 10.222.0.62 () {58 vars in 1439 bytes} [Tue Oct 4 14:14:02 2022] PUT /identity/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3/users/0edc99bb2191439ca8839bea31becd96/roles/c3d8f302f6714108ac91c25b8a32d36b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:14:02.402342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1717fe-a37a-44ce-b1b9-eff7592c8e77 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:02.402873 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1717fe-a37a-44ce-b1b9-eff7592c8e77 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:02.405383 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1717fe-a37a-44ce-b1b9-eff7592c8e77 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:02.413807 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 71/137] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:02.415624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514376ff-35c8-4174-abcb-5dd322a222b3 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:02.418175 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514376ff-35c8-4174-abcb-5dd322a222b3 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:02.419855 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514376ff-35c8-4174-abcb-5dd322a222b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:02.460881 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-514376ff-35c8-4174-abcb-5dd322a222b3 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:02.462873 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-514376ff-35c8-4174-abcb-5dd322a222b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:02.466978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc080d-c10b-4ec4-a2e1-fce326a02287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:02.467880 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc080d-c10b-4ec4-a2e1-fce326a02287 None admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:02.468287 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc080d-c10b-4ec4-a2e1-fce326a02287 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:02.468676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc080d-c10b-4ec4-a2e1-fce326a02287 None admin] PATH_INFO: `/v3/projects/5ab3676208e64c22b75790caead587b8/users/0edc99bb2191439ca8839bea31becd96/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:02.472564 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc080d-c10b-4ec4-a2e1-fce326a02287 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ab3676208e64c22b75790caead587b8, user_id=0edc99bb2191439ca8839bea31becd96, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:02.474292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc080d-c10b-4ec4-a2e1-fce326a02287 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:02.507315 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 67/138] 10.222.0.62 () {58 vars in 1439 bytes} [Tue Oct 4 14:14:02 2022] PUT /identity/v3/projects/5ab3676208e64c22b75790caead587b8/users/0edc99bb2191439ca8839bea31becd96/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:14:02.508656 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668724c2-e661-4779-93da-1eaae4397d5a None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:02.509034 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668724c2-e661-4779-93da-1eaae4397d5a None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:02.509378 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668724c2-e661-4779-93da-1eaae4397d5a None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:02.510928 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 68/139] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:02.517145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c2f12-595a-437f-9668-f70e57fdc860 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:02.517431 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c2f12-595a-437f-9668-f70e57fdc860 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:02.518615 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c2f12-595a-437f-9668-f70e57fdc860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:02.542604 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-628c2f12-595a-437f-9668-f70e57fdc860 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:02.544521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-628c2f12-595a-437f-9668-f70e57fdc860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:02.648398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 72/140] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:02.675442 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 69/141] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 14:14:03.090727 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514376ff-35c8-4174-abcb-5dd322a222b3 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:03.112778 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:03.311037 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514376ff-35c8-4174-abcb-5dd322a222b3 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:03.352910 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c2f12-595a-437f-9668-f70e57fdc860 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:03.360276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63904ab3-ea65-4df1-8844-41a6a2d993d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:03.360940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63904ab3-ea65-4df1-8844-41a6a2d993d2 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:03.361215 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63904ab3-ea65-4df1-8844-41a6a2d993d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:03.362024 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63904ab3-ea65-4df1-8844-41a6a2d993d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:03.363765 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63904ab3-ea65-4df1-8844-41a6a2d993d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:03.365236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63904ab3-ea65-4df1-8844-41a6a2d993d2 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:03.367210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 73/142] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:14:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:03.372785 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63904ab3-ea65-4df1-8844-41a6a2d993d2 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:03.471742 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:03.500523 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63904ab3-ea65-4df1-8844-41a6a2d993d2 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:03.543792 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe749aa-ba01-45aa-98dc-30ba32f11de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:03.544432 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe749aa-ba01-45aa-98dc-30ba32f11de7 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:03.544709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe749aa-ba01-45aa-98dc-30ba32f11de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:03.544977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe749aa-ba01-45aa-98dc-30ba32f11de7 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:03.545647 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe749aa-ba01-45aa-98dc-30ba32f11de7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:03.547249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe749aa-ba01-45aa-98dc-30ba32f11de7 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:03.552930 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:03.578168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 74/143] 10.222.0.62 () {60 vars in 1132 bytes} [Tue Oct 4 14:14:03 2022] POST /identity/v3/users => generated 283 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:14:03.637282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c2f12-595a-437f-9668-f70e57fdc860 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:03.735562 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70844c-a6a7-48bf-883f-968881f29696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:03.736781 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70844c-a6a7-48bf-883f-968881f29696 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:03.737285 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70844c-a6a7-48bf-883f-968881f29696 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:03.737774 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70844c-a6a7-48bf-883f-968881f29696 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:03.762832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70844c-a6a7-48bf-883f-968881f29696 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:03.777457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-8c70844c-a6a7-48bf-883f-968881f29696 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:03.777457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:03.777457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:03.777457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:03.777457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:03.777457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:03.777457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:03.777457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:03.777457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:03.777457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:03.777457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:03.777457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:03.777457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:03.777457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:03.777457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:03.777457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:03.778359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:03.778359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:03.778359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:03.778359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:03.778359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:03.778359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:03.778359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:03.778359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:03.778359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:03.778359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:03.778359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:03.778359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:03.778359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:03.778359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:03.778359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:03.778359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:03.779101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:03.779101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:03.779101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:03.779101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:03.779101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:03.779101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:03.779101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:03.779101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:03.779101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:03.779101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:03.779101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:03.779101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:14:03.780053 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 70/144] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:03.789528 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe749aa-ba01-45aa-98dc-30ba32f11de7 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:03.954306 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe749aa-ba01-45aa-98dc-30ba32f11de7 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:03.994773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:04.004579 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e047a4-9c41-424b-b592-8d2f443e7a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:04.005249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e047a4-9c41-424b-b592-8d2f443e7a14 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:04.006251 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e047a4-9c41-424b-b592-8d2f443e7a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:04.006479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e047a4-9c41-424b-b592-8d2f443e7a14 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:04.007328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e047a4-9c41-424b-b592-8d2f443e7a14 None admin] RBAC: Adding query filter params (name=member) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:04.007979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e047a4-9c41-424b-b592-8d2f443e7a14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:04.009506 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e047a4-9c41-424b-b592-8d2f443e7a14 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:04.023405 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 75/145] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:14:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:04.029444 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70844c-a6a7-48bf-883f-968881f29696 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:04.206609 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70844c-a6a7-48bf-883f-968881f29696 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:04.246627 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:04.257521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a977a-50ae-408c-a099-6d373fdd81fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:04.258183 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a977a-50ae-408c-a099-6d373fdd81fb None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:04.258464 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a977a-50ae-408c-a099-6d373fdd81fb None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:04.258737 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a977a-50ae-408c-a099-6d373fdd81fb None admin] PATH_INFO: `/v3/users/0edc99bb2191439ca8839bea31becd96` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:04.259974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a977a-50ae-408c-a099-6d373fdd81fb None admin] RBAC: Authorizing `identity:get_user(user_id=0edc99bb2191439ca8839bea31becd96)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:04.261462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a977a-50ae-408c-a099-6d373fdd81fb None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:04.263456 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 71/146] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:04 2022] GET /identity/v3/users/0edc99bb2191439ca8839bea31becd96 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:04.270226 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e047a4-9c41-424b-b592-8d2f443e7a14 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:04.410400 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e047a4-9c41-424b-b592-8d2f443e7a14 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:04.459091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e195751-ed7d-4c5e-96e4-a342df66fa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:04.459648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e195751-ed7d-4c5e-96e4-a342df66fa9f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:04.459962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e195751-ed7d-4c5e-96e4-a342df66fa9f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:04.460231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e195751-ed7d-4c5e-96e4-a342df66fa9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:04.564419 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:04.569725 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e195751-ed7d-4c5e-96e4-a342df66fa9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:04.571230 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e195751-ed7d-4c5e-96e4-a342df66fa9f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:04.700337 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 76/147] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:14:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:14:04.709606 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a977a-50ae-408c-a099-6d373fdd81fb None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:04.944817 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a977a-50ae-408c-a099-6d373fdd81fb None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:05.015358 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f703a2-9868-42b8-845a-c17595965e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:05.016420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f703a2-9868-42b8-845a-c17595965e38 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:05.016867 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f703a2-9868-42b8-845a-c17595965e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:05.017337 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f703a2-9868-42b8-845a-c17595965e38 None admin] PATH_INFO: `/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:05.020600 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f703a2-9868-42b8-845a-c17595965e38 None admin] RBAC: Authorizing `identity:get_project(project_id=0c72ec4a5e6f40ac84de3c903eedf1d3)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:05.023233 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f703a2-9868-42b8-845a-c17595965e38 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:05.026134 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 72/148] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:04 2022] GET /identity/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3 => generated 298 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:05.035758 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e195751-ed7d-4c5e-96e4-a342df66fa9f None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:05.231692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:05.246221 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e195751-ed7d-4c5e-96e4-a342df66fa9f None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:05.315933 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd44478-8eaa-4d0c-9234-dcdab90009e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:05.317187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd44478-8eaa-4d0c-9234-dcdab90009e1 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:05.317681 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd44478-8eaa-4d0c-9234-dcdab90009e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:05.318155 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd44478-8eaa-4d0c-9234-dcdab90009e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:05.319518 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd44478-8eaa-4d0c-9234-dcdab90009e1 None admin] RBAC: Adding query filter params (role.id=eb2435bb443d4469899fb3830f4ee5b1, scope.project.id=0c72ec4a5e6f40ac84de3c903eedf1d3, user.id=0edc99bb2191439ca8839bea31becd96) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:05.320098 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd44478-8eaa-4d0c-9234-dcdab90009e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:05.322917 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd44478-8eaa-4d0c-9234-dcdab90009e1 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:05.335183 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 77/149] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:14:05 2022] GET /identity/v3/role_assignments?user.id=0edc99bb2191439ca8839bea31becd96&scope.project.id=0c72ec4a5e6f40ac84de3c903eedf1d3&role.id=eb2435bb443d4469899fb3830f4ee5b1 => generated 608 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:05.947290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70e617-b86c-44f9-b65b-94b0125c119f None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:05.947834 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70e617-b86c-44f9-b65b-94b0125c119f None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:05.948168 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70e617-b86c-44f9-b65b-94b0125c119f None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:05.950799 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 73/150] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:05.958407 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f44fc-9ca3-4b30-a744-628c1cdc3961 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:05.958913 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f44fc-9ca3-4b30-a744-628c1cdc3961 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:05.959375 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f44fc-9ca3-4b30-a744-628c1cdc3961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:05.996594 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-8b0f44fc-9ca3-4b30-a744-628c1cdc3961 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:05.998767 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8b0f44fc-9ca3-4b30-a744-628c1cdc3961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:06.072207 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06bb15-8842-4e8f-a46c-3cc9f54597fd None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:06.072658 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06bb15-8842-4e8f-a46c-3cc9f54597fd None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:06.072837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06bb15-8842-4e8f-a46c-3cc9f54597fd None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:06.074685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 74/151] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:06.093096 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624713ee-989f-4b86-925f-2e324b3bb671 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:06.093096 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624713ee-989f-4b86-925f-2e324b3bb671 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:06.093096 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624713ee-989f-4b86-925f-2e324b3bb671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:06.137839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-624713ee-989f-4b86-925f-2e324b3bb671 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:06.140757 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-624713ee-989f-4b86-925f-2e324b3bb671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:06.142670 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 78/152] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:06.242627 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:06.257966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 75/153] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 14:14:06.761635 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f44fc-9ca3-4b30-a744-628c1cdc3961 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:06.853048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624713ee-989f-4b86-925f-2e324b3bb671 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:06.952223 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:07.007455 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f44fc-9ca3-4b30-a744-628c1cdc3961 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:07.043843 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624713ee-989f-4b86-925f-2e324b3bb671 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:07.116849 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d7009-f346-4a94-8836-6984cd2e980b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:07.117445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d7009-f346-4a94-8836-6984cd2e980b None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:07.117884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d7009-f346-4a94-8836-6984cd2e980b None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:07.118171 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d7009-f346-4a94-8836-6984cd2e980b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:07.133697 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5f45e-3a7f-4ea0-840f-5f9778b55669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:07.134796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5f45e-3a7f-4ea0-840f-5f9778b55669 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:07.135266 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5f45e-3a7f-4ea0-840f-5f9778b55669 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:07.135731 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5f45e-3a7f-4ea0-840f-5f9778b55669 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:07.138798 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d7009-f346-4a94-8836-6984cd2e980b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:07.144875 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-442d7009-f346-4a94-8836-6984cd2e980b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 14:14:07.144875 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:07.144875 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:07.144875 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:07.144875 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:07.144875 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:07.144875 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:07.144875 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:07.144875 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:07.144875 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:07.144875 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:07.144875 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:07.144875 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:07.144875 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:07.144875 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:07.144875 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:07.145791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:07.145791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:07.145791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:07.145791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:07.145791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:07.145791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:07.145791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:07.145791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:07.145791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:07.145791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:07.145791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:07.145791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:07.145791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:07.145791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:07.145791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:07.145791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:07.146540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:07.146540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:07.146540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:07.146540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:07.146540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:07.146540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:07.146540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:07.146540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:07.146540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:07.146540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:07.146540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 14:14:07.146540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:14:07.147151 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 76/154] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:14:07.154547 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d7009-f346-4a94-8836-6984cd2e980b None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:07.173477 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5f45e-3a7f-4ea0-840f-5f9778b55669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:07.188513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-0bd5f45e-3a7f-4ea0-840f-5f9778b55669 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:14:07.188513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:07.188513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:07.188513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:07.188513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:07.188513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:07.188513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:07.188513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:07.188513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:07.188513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:07.188513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:07.188513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:07.188513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:07.188513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:07.188513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:07.188513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:07.189648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:07.189648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:07.189648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:07.189648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:07.189648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:07.189648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:07.189648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:07.189648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:07.189648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:07.189648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:07.189648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:07.189648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:07.189648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:07.189648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:07.189648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:07.189648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:07.190767 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:07.190767 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:07.190767 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:07.190767 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:07.190767 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:07.190767 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:07.190767 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:07.190767 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:07.190767 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:07.190767 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:07.190767 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:14:07.190767 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:14:07.190767 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 79/155] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:14:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:14:07.200296 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5f45e-3a7f-4ea0-840f-5f9778b55669 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:07.266005 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:07.359598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d7009-f346-4a94-8836-6984cd2e980b None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:07.472412 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea9142-559b-4580-81c0-f320fc183732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:07.473365 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea9142-559b-4580-81c0-f320fc183732 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:07.473838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea9142-559b-4580-81c0-f320fc183732 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:07.474315 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea9142-559b-4580-81c0-f320fc183732 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:07.475543 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea9142-559b-4580-81c0-f320fc183732 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:07.476109 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea9142-559b-4580-81c0-f320fc183732 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:07.478808 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea9142-559b-4580-81c0-f320fc183732 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:07.515860 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 77/156] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:14:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:14:07.518572 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d606d3-28e4-4d5d-9d87-d1226195d0d4 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:07.519086 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d606d3-28e4-4d5d-9d87-d1226195d0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:07.519562 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d606d3-28e4-4d5d-9d87-d1226195d0d4 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:07.522139 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 78/157] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:07.527625 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d606d3-28e4-4d5d-9d87-d1226195d0d4 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:07.630512 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5f45e-3a7f-4ea0-840f-5f9778b55669 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:07.758545 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f95caf-f8b5-4059-bbdb-baf8b6b255d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:07.759606 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f95caf-f8b5-4059-bbdb-baf8b6b255d8 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:07.760118 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f95caf-f8b5-4059-bbdb-baf8b6b255d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:07.760606 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f95caf-f8b5-4059-bbdb-baf8b6b255d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:07.761887 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f95caf-f8b5-4059-bbdb-baf8b6b255d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:07.762433 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f95caf-f8b5-4059-bbdb-baf8b6b255d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:07.765284 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f95caf-f8b5-4059-bbdb-baf8b6b255d8 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:07.808471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 80/158] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 609 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:07.811053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb0092-3ea1-4e18-91d5-32130b680f60 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:07.821721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb0092-3ea1-4e18-91d5-32130b680f60 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:07.822557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb0092-3ea1-4e18-91d5-32130b680f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:07.881368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-4dfb0092-3ea1-4e18-91d5-32130b680f60 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:07.886463 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4dfb0092-3ea1-4e18-91d5-32130b680f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:07.898822 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:07.928356 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d606d3-28e4-4d5d-9d87-d1226195d0d4 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:07.983912 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:08.052996 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a359c25-ba4b-4652-aea2-79b47a94a105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:08.055494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a359c25-ba4b-4652-aea2-79b47a94a105 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:08.058524 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a359c25-ba4b-4652-aea2-79b47a94a105 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:08.059561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a359c25-ba4b-4652-aea2-79b47a94a105 None admin] PATH_INFO: `/v3/users/db0bb520bef74888b1acc290d9cc9db9` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:08.064533 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a359c25-ba4b-4652-aea2-79b47a94a105 None admin] RBAC: Authorizing `identity:get_user(user_id=db0bb520bef74888b1acc290d9cc9db9)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:08.067857 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a359c25-ba4b-4652-aea2-79b47a94a105 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:08.072979 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 79/159] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:07 2022] GET /identity/v3/users/db0bb520bef74888b1acc290d9cc9db9 => generated 289 bytes in 546 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:08.079549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c59f6-492f-4d54-b72c-27a9a8292cd7 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:08.081960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c59f6-492f-4d54-b72c-27a9a8292cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:08.083885 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c59f6-492f-4d54-b72c-27a9a8292cd7 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:08.087033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 80/160] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:08 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:08.091339 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c59f6-492f-4d54-b72c-27a9a8292cd7 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:08.105838 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 81/161] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:08.107979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb0092-3ea1-4e18-91d5-32130b680f60 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:08.425262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb0092-3ea1-4e18-91d5-32130b680f60 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:08.426424 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c59f6-492f-4d54-b72c-27a9a8292cd7 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:08.497657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ad464-aefb-4def-b77f-225b36dfd047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:08.499083 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ad464-aefb-4def-b77f-225b36dfd047 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:08.499806 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ad464-aefb-4def-b77f-225b36dfd047 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:08.500483 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ad464-aefb-4def-b77f-225b36dfd047 None admin] PATH_INFO: `/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:08.503476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ad464-aefb-4def-b77f-225b36dfd047 None admin] RBAC: Authorizing `identity:get_project(project_id=0c72ec4a5e6f40ac84de3c903eedf1d3)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:08.506605 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ad464-aefb-4def-b77f-225b36dfd047 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:08.510100 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 82/162] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:08 2022] GET /identity/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3 => generated 298 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:08.512616 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef74d9-0775-4490-ada1-3d392155f612 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:08.513333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef74d9-0775-4490-ada1-3d392155f612 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:08.514012 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef74d9-0775-4490-ada1-3d392155f612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:08.529687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207bf41-dcac-4d9d-983d-a1e231bdf0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:08.530353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207bf41-dcac-4d9d-983d-a1e231bdf0c6 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:08.530630 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207bf41-dcac-4d9d-983d-a1e231bdf0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:08.530903 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207bf41-dcac-4d9d-983d-a1e231bdf0c6 None admin] PATH_INFO: `/v3/users/ea10fbfe4b4e4d64acf7b2c318e4a8a1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:08.536701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207bf41-dcac-4d9d-983d-a1e231bdf0c6 None admin] RBAC: Authorizing `identity:get_user(user_id=ea10fbfe4b4e4d64acf7b2c318e4a8a1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:08.538257 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207bf41-dcac-4d9d-983d-a1e231bdf0c6 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:08.540471 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 81/163] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:08 2022] GET /identity/v3/users/ea10fbfe4b4e4d64acf7b2c318e4a8a1 => generated 247 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:08.541433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207bf41-dcac-4d9d-983d-a1e231bdf0c6 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:08.551204 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-17ef74d9-0775-4490-ada1-3d392155f612 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:08.553928 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-17ef74d9-0775-4490-ada1-3d392155f612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:08.559963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:08.645332 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:08.708163 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 83/164] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:08.710156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef74d9-0775-4490-ada1-3d392155f612 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:08.740506 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207bf41-dcac-4d9d-983d-a1e231bdf0c6 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:08.799875 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee16b5-70e4-4bb5-b42a-b4875e8a0b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:08.800809 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee16b5-70e4-4bb5-b42a-b4875e8a0b99 None admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:08.801228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee16b5-70e4-4bb5-b42a-b4875e8a0b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:08.801635 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee16b5-70e4-4bb5-b42a-b4875e8a0b99 None admin] PATH_INFO: `/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3/users/db0bb520bef74888b1acc290d9cc9db9/roles/d1857bfa9b524282b38b5bf1160e2473` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:08.803905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee16b5-70e4-4bb5-b42a-b4875e8a0b99 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c72ec4a5e6f40ac84de3c903eedf1d3, user_id=db0bb520bef74888b1acc290d9cc9db9, role_id=d1857bfa9b524282b38b5bf1160e2473)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:08.805600 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee16b5-70e4-4bb5-b42a-b4875e8a0b99 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:08.823157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 82/165] 10.222.0.62 () {58 vars in 1439 bytes} [Tue Oct 4 14:14:08 2022] PUT /identity/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3/users/db0bb520bef74888b1acc290d9cc9db9/roles/d1857bfa9b524282b38b5bf1160e2473 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:14:08.828855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee16b5-70e4-4bb5-b42a-b4875e8a0b99 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:08.976208 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee16b5-70e4-4bb5-b42a-b4875e8a0b99 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:08.991466 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:09.029903 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5097d-4e0f-47b7-8816-52d6777febab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:09.030822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5097d-4e0f-47b7-8816-52d6777febab None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:09.031272 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5097d-4e0f-47b7-8816-52d6777febab None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:09.031694 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5097d-4e0f-47b7-8816-52d6777febab None admin] PATH_INFO: `/v3/roles/member` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:09.043473 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef74d9-0775-4490-ada1-3d392155f612 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:09.046801 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5097d-4e0f-47b7-8816-52d6777febab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:09.054594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-1da5097d-4e0f-47b7-8816-52d6777febab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:09.054594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:09.054594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:09.054594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:09.054594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:09.054594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:09.054594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:09.054594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:09.054594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:09.054594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:09.054594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:09.054594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:09.054594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:09.054594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:09.054594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:09.054594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:09.056156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:09.056156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:09.056156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:09.056156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:09.056156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:09.056156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:09.056156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:09.056156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:09.056156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:09.056156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:09.056156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:09.056156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:09.056156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:09.056156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:09.056156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:09.056156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:09.057209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:09.057209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:09.057209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:09.057209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:09.057209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:09.057209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:09.057209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:09.057209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:09.057209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:09.057209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:09.057209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:09.057209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:14:09.059660 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 83/166] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:09.061231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6b9ee-53ef-4c57-8926-52ff1e56ef9f None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:09.061665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6b9ee-53ef-4c57-8926-52ff1e56ef9f None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:09.062066 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6b9ee-53ef-4c57-8926-52ff1e56ef9f None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:09.066000 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 84/167] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:09.067189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6b9ee-53ef-4c57-8926-52ff1e56ef9f None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:09.116136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8db9c-bed4-4ef4-93c4-d64f6e56e583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:09.118725 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8db9c-bed4-4ef4-93c4-d64f6e56e583 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:09.121338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8db9c-bed4-4ef4-93c4-d64f6e56e583 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:09.121338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8db9c-bed4-4ef4-93c4-d64f6e56e583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:09.139096 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:09.211103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6b9ee-53ef-4c57-8926-52ff1e56ef9f None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:09.253748 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8db9c-bed4-4ef4-93c4-d64f6e56e583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:09.255370 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8db9c-bed4-4ef4-93c4-d64f6e56e583 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:09.287616 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b392b2f-74fe-4caf-8bcb-1cb8ffb0e600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:09.289041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b392b2f-74fe-4caf-8bcb-1cb8ffb0e600 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:09.289535 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b392b2f-74fe-4caf-8bcb-1cb8ffb0e600 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:09.289949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b392b2f-74fe-4caf-8bcb-1cb8ffb0e600 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:09.291031 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b392b2f-74fe-4caf-8bcb-1cb8ffb0e600 None admin] RBAC: Adding query filter params (name=member) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:09.291789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b392b2f-74fe-4caf-8bcb-1cb8ffb0e600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:09.294748 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b392b2f-74fe-4caf-8bcb-1cb8ffb0e600 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:09.311266 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 85/168] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:14:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:09.313999 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0aa6e-3df2-46bf-816e-b4b14b52b273 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:09.314761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0aa6e-3df2-46bf-816e-b4b14b52b273 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:09.315423 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0aa6e-3df2-46bf-816e-b4b14b52b273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:09.348264 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-8ef0aa6e-3df2-46bf-816e-b4b14b52b273 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:09.350750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-8ef0aa6e-3df2-46bf-816e-b4b14b52b273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:09.402938 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:09.445363 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 84/169] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:14:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 736 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:14:09.447574 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c43565-e9a9-4356-8193-b00b7c48a4a8 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:09.448243 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c43565-e9a9-4356-8193-b00b7c48a4a8 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:09.448791 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c43565-e9a9-4356-8193-b00b7c48a4a8 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:09.451442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 85/170] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:09.452776 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c43565-e9a9-4356-8193-b00b7c48a4a8 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:09.472961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 86/171] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:09.473861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0aa6e-3df2-46bf-816e-b4b14b52b273 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:09.540208 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:09.666539 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c43565-e9a9-4356-8193-b00b7c48a4a8 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:09.741169 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7765305-3004-4d74-b596-143aa5604ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:09.742190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7765305-3004-4d74-b596-143aa5604ddf None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:09.742637 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7765305-3004-4d74-b596-143aa5604ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:09.743695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7765305-3004-4d74-b596-143aa5604ddf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:09.764416 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7765305-3004-4d74-b596-143aa5604ddf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:09.770065 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-d7765305-3004-4d74-b596-143aa5604ddf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:14:09.770065 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:09.770065 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:09.770065 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:09.770065 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:09.770065 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:09.770065 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:09.770065 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:09.770065 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:09.770065 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:09.770065 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:09.770065 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:09.770065 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:09.770065 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:09.770065 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:09.770065 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:09.771947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:09.771947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:09.771947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:09.771947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:09.771947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:09.771947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:09.771947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:09.771947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:09.771947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:09.771947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:09.771947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:09.771947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:09.771947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:09.771947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:09.771947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:09.771947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:09.773526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:09.773526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:09.773526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:09.773526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:09.773526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:09.773526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:09.773526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:09.773526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:09.773526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:09.773526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:09.773526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:14:09.773526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:14:09.777077 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 86/172] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Oct 4 14:14:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:09.782620 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7765305-3004-4d74-b596-143aa5604ddf None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:09.783006 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0aa6e-3df2-46bf-816e-b4b14b52b273 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:09.828816 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98f2c7-d12a-40f4-830e-9857a880fd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:09.829389 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98f2c7-d12a-40f4-830e-9857a880fd80 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:09.829679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98f2c7-d12a-40f4-830e-9857a880fd80 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:09.829963 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98f2c7-d12a-40f4-830e-9857a880fd80 None admin] PATH_INFO: `/v3/users/0edc99bb2191439ca8839bea31becd96` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:09.831805 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98f2c7-d12a-40f4-830e-9857a880fd80 None admin] RBAC: Authorizing `identity:get_user(user_id=0edc99bb2191439ca8839bea31becd96)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:09.833913 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98f2c7-d12a-40f4-830e-9857a880fd80 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:09.835673 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 87/173] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:09 2022] GET /identity/v3/users/0edc99bb2191439ca8839bea31becd96 => generated 275 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:09.836936 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab384f4c-8876-4720-8504-830e91ef0141 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:09.837266 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab384f4c-8876-4720-8504-830e91ef0141 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:09.837536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab384f4c-8876-4720-8504-830e91ef0141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:09.869802 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-ab384f4c-8876-4720-8504-830e91ef0141 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:09.871042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-ab384f4c-8876-4720-8504-830e91ef0141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:09.919139 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:09.967960 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:09.973558 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7765305-3004-4d74-b596-143aa5604ddf None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:10.009680 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 88/174] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:10.011754 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77547d72-3bfd-4fb2-9dcd-621ed97785d9 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:10.012227 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77547d72-3bfd-4fb2-9dcd-621ed97785d9 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:10.012699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77547d72-3bfd-4fb2-9dcd-621ed97785d9 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:10.015519 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 89/175] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:10.021051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77547d72-3bfd-4fb2-9dcd-621ed97785d9 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:10.037291 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934a62c-6949-4629-a5ad-f57d25724664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:10.038458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934a62c-6949-4629-a5ad-f57d25724664 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:10.038933 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934a62c-6949-4629-a5ad-f57d25724664 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:10.039404 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934a62c-6949-4629-a5ad-f57d25724664 None admin] PATH_INFO: `/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:10.041550 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934a62c-6949-4629-a5ad-f57d25724664 None admin] RBAC: Authorizing `identity:get_project(project_id=0c72ec4a5e6f40ac84de3c903eedf1d3)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:10.044555 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934a62c-6949-4629-a5ad-f57d25724664 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:10.047912 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 87/176] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:09 2022] GET /identity/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:10.057241 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934a62c-6949-4629-a5ad-f57d25724664 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:10.240646 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77547d72-3bfd-4fb2-9dcd-621ed97785d9 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:10.262277 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934a62c-6949-4629-a5ad-f57d25724664 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:10.283402 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b4239-516a-4da5-8137-2d86472939b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:10.284215 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b4239-516a-4da5-8137-2d86472939b3 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:10.284508 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b4239-516a-4da5-8137-2d86472939b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:10.284773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b4239-516a-4da5-8137-2d86472939b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:10.285460 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b4239-516a-4da5-8137-2d86472939b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:10.285978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b4239-516a-4da5-8137-2d86472939b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:10.287909 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b4239-516a-4da5-8137-2d86472939b3 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:10.298524 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 90/177] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:14:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:10.299570 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b4239-516a-4da5-8137-2d86472939b3 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:10.343913 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e08cb-1791-4914-ad22-e067a754bf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:10.344588 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e08cb-1791-4914-ad22-e067a754bf8e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:10.344914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e08cb-1791-4914-ad22-e067a754bf8e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:10.345184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e08cb-1791-4914-ad22-e067a754bf8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:10.349527 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:10.393061 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:10.450383 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e08cb-1791-4914-ad22-e067a754bf8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:10.453201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e08cb-1791-4914-ad22-e067a754bf8e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:10.500496 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b4239-516a-4da5-8137-2d86472939b3 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:10.568715 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc11cd-56fc-4a17-81b1-28a758ba882a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:10.570106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc11cd-56fc-4a17-81b1-28a758ba882a None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:10.570297 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc11cd-56fc-4a17-81b1-28a758ba882a None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:10.570691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc11cd-56fc-4a17-81b1-28a758ba882a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:10.589326 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc11cd-56fc-4a17-81b1-28a758ba882a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:10.598557 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-79cc11cd-56fc-4a17-81b1-28a758ba882a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:14:10.598557 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:10.598557 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:10.598557 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:10.598557 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:10.598557 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:10.598557 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:10.598557 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:10.598557 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:10.598557 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:10.598557 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:10.598557 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:10.598557 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:10.598557 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:10.598557 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:10.598557 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:10.600372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:10.600372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:10.600372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:10.600372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:10.600372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:10.600372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:10.600372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:10.600372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:10.600372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:10.600372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:10.600372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:10.600372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:10.600372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:10.600372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:10.600372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:10.600372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:10.605521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:10.605521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:10.605521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:10.605521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:10.605521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:10.605521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:10.605521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:10.605521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:10.605521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:10.605521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:10.605521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:14:10.605521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:14:10.605521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 91/178] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Oct 4 14:14:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:10.605521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed689e-0283-44fb-ba3f-de445bd83311 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:10.607034 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed689e-0283-44fb-ba3f-de445bd83311 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:10.607034 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed689e-0283-44fb-ba3f-de445bd83311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:10.638612 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-92ed689e-0283-44fb-ba3f-de445bd83311 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:10.640531 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-92ed689e-0283-44fb-ba3f-de445bd83311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:10.655523 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 88/179] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:14:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:14:10.656823 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e08cb-1791-4914-ad22-e067a754bf8e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:10.762783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 92/180] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:10.763868 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed689e-0283-44fb-ba3f-de445bd83311 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:10.797202 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:10.804533 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:10.879917 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e08cb-1791-4914-ad22-e067a754bf8e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:10.960674 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92304db-7458-466e-9e2e-53dceebc5129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:10.961914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92304db-7458-466e-9e2e-53dceebc5129 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:10.962416 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92304db-7458-466e-9e2e-53dceebc5129 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:10.962895 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92304db-7458-466e-9e2e-53dceebc5129 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:10.964429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92304db-7458-466e-9e2e-53dceebc5129 None admin] RBAC: Adding query filter params (role.id=a16b6daeda5b4a67992f3c12514ca90e, scope.project.id=0c72ec4a5e6f40ac84de3c903eedf1d3, user.id=ea10fbfe4b4e4d64acf7b2c318e4a8a1) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:10.964997 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92304db-7458-466e-9e2e-53dceebc5129 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:10.968337 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92304db-7458-466e-9e2e-53dceebc5129 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:10.981765 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed689e-0283-44fb-ba3f-de445bd83311 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:10.982537 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 89/181] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:14:10 2022] GET /identity/v3/role_assignments?user.id=ea10fbfe4b4e4d64acf7b2c318e4a8a1&scope.project.id=0c72ec4a5e6f40ac84de3c903eedf1d3&role.id=a16b6daeda5b4a67992f3c12514ca90e => generated 608 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:10.989467 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92304db-7458-466e-9e2e-53dceebc5129 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:11.104196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3435e-acd0-43bc-b8e9-3dcc5fa00a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:11.105206 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3435e-acd0-43bc-b8e9-3dcc5fa00a0f None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:11.105687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3435e-acd0-43bc-b8e9-3dcc5fa00a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:11.106168 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3435e-acd0-43bc-b8e9-3dcc5fa00a0f None admin] PATH_INFO: `/v3/users/0edc99bb2191439ca8839bea31becd96` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:11.110871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3435e-acd0-43bc-b8e9-3dcc5fa00a0f None admin] RBAC: Authorizing `identity:get_user(user_id=0edc99bb2191439ca8839bea31becd96)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:11.116237 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3435e-acd0-43bc-b8e9-3dcc5fa00a0f None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:11.119543 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 93/182] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:10 2022] GET /identity/v3/users/0edc99bb2191439ca8839bea31becd96 => generated 275 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:11.121119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3435e-acd0-43bc-b8e9-3dcc5fa00a0f None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:11.253292 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92304db-7458-466e-9e2e-53dceebc5129 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:11.294552 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:11.307841 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7707a-3a03-47f4-8489-508c1689203f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:11.308986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7707a-3a03-47f4-8489-508c1689203f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:11.309536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7707a-3a03-47f4-8489-508c1689203f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:11.310002 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7707a-3a03-47f4-8489-508c1689203f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:11.312462 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7707a-3a03-47f4-8489-508c1689203f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:11.317428 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7707a-3a03-47f4-8489-508c1689203f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:11.320900 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 90/183] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:14:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:11.328203 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7707a-3a03-47f4-8489-508c1689203f None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:11.328597 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:11.368037 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3435e-acd0-43bc-b8e9-3dcc5fa00a0f None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:11.438808 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff57a0-21f3-4987-9995-44b77a4d56e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:11.440192 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff57a0-21f3-4987-9995-44b77a4d56e6 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:11.440709 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff57a0-21f3-4987-9995-44b77a4d56e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:11.441126 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff57a0-21f3-4987-9995-44b77a4d56e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:11.441866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff57a0-21f3-4987-9995-44b77a4d56e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:11.442172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff57a0-21f3-4987-9995-44b77a4d56e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:11.443615 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff57a0-21f3-4987-9995-44b77a4d56e6 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:11.461797 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 94/184] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:14:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:11.462724 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff57a0-21f3-4987-9995-44b77a4d56e6 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:11.562554 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7707a-3a03-47f4-8489-508c1689203f None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:11.609275 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315c0fe-ad38-49d9-b1bb-9dc01d6b0015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:11.609936 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315c0fe-ad38-49d9-b1bb-9dc01d6b0015 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:11.610214 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315c0fe-ad38-49d9-b1bb-9dc01d6b0015 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:11.610491 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315c0fe-ad38-49d9-b1bb-9dc01d6b0015 None admin] PATH_INFO: `/v3/projects/5ab3676208e64c22b75790caead587b8` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:11.613171 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315c0fe-ad38-49d9-b1bb-9dc01d6b0015 None admin] RBAC: Authorizing `identity:get_project(project_id=5ab3676208e64c22b75790caead587b8)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:11.614745 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315c0fe-ad38-49d9-b1bb-9dc01d6b0015 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:11.616809 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 91/185] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:11 2022] GET /identity/v3/projects/5ab3676208e64c22b75790caead587b8 => generated 312 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:11.617359 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315c0fe-ad38-49d9-b1bb-9dc01d6b0015 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:11.680972 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff57a0-21f3-4987-9995-44b77a4d56e6 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:11.724722 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:11.734960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f160b-f3f6-4ef9-b3c8-3f6290660084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:11.736075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f160b-f3f6-4ef9-b3c8-3f6290660084 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:11.737268 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f160b-f3f6-4ef9-b3c8-3f6290660084 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:11.737753 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f160b-f3f6-4ef9-b3c8-3f6290660084 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:11.769669 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:11.777289 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315c0fe-ad38-49d9-b1bb-9dc01d6b0015 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:11.828089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41217615-2595-4762-b9f6-bcb2f0a4d0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:11.828740 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41217615-2595-4762-b9f6-bcb2f0a4d0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:11.829013 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41217615-2595-4762-b9f6-bcb2f0a4d0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:11.829275 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41217615-2595-4762-b9f6-bcb2f0a4d0b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:11.842128 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41217615-2595-4762-b9f6-bcb2f0a4d0b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:11.847920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-41217615-2595-4762-b9f6-bcb2f0a4d0b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:14:11.847920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:11.847920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:11.847920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:11.847920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:11.847920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:11.847920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:11.847920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:11.847920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:11.847920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:11.847920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:11.847920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:11.847920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:11.847920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:11.847920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:11.847920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:11.849380 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:11.849380 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:11.849380 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:11.849380 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:11.849380 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:11.849380 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:11.849380 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:11.849380 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:11.849380 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:11.849380 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:11.849380 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:11.849380 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:11.849380 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:11.849380 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:11.849380 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:11.849380 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:11.850911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:11.850911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:11.850911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:11.850911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:11.850911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:11.850911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:11.850911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:11.850911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:11.850911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:11.850911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:11.850911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:14:11.850911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:14:11.850911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 92/186] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:14:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:11.850911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41217615-2595-4762-b9f6-bcb2f0a4d0b2 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:11.862317 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f160b-f3f6-4ef9-b3c8-3f6290660084 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:11.865203 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f160b-f3f6-4ef9-b3c8-3f6290660084 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:11.974810 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41217615-2595-4762-b9f6-bcb2f0a4d0b2 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:12.005766 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:12.016821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2517f-0a4c-4d01-847c-a72b17028bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:12.018127 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2517f-0a4c-4d01-847c-a72b17028bc5 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:12.018468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2517f-0a4c-4d01-847c-a72b17028bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:12.018789 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2517f-0a4c-4d01-847c-a72b17028bc5 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:12.019557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2517f-0a4c-4d01-847c-a72b17028bc5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:12.021435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2517f-0a4c-4d01-847c-a72b17028bc5 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:12.043443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 95/187] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:14:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:14:12.045642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f160b-f3f6-4ef9-b3c8-3f6290660084 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:12.048512 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 93/188] 10.222.0.62 () {60 vars in 1132 bytes} [Tue Oct 4 14:14:11 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:14:12.052831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2517f-0a4c-4d01-847c-a72b17028bc5 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:12.133381 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:12.229194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f160b-f3f6-4ef9-b3c8-3f6290660084 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:12.230460 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2517f-0a4c-4d01-847c-a72b17028bc5 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:12.293875 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e158a6-8e69-484e-83ef-f5254f6de0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:12.294576 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e158a6-8e69-484e-83ef-f5254f6de0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:12.294928 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e158a6-8e69-484e-83ef-f5254f6de0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:12.295103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e158a6-8e69-484e-83ef-f5254f6de0c5 None admin] PATH_INFO: `/v3/users/6704cb4f961045458060802ff3e3b3b2` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:12.299128 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4e3c7-bfb0-4a3e-b084-e9470c21f662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:12.299128 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4e3c7-bfb0-4a3e-b084-e9470c21f662 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:12.300030 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4e3c7-bfb0-4a3e-b084-e9470c21f662 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:12.300030 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4e3c7-bfb0-4a3e-b084-e9470c21f662 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:12.301405 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4e3c7-bfb0-4a3e-b084-e9470c21f662 None admin] RBAC: Adding query filter params (role.id=eb2435bb443d4469899fb3830f4ee5b1, scope.project.id=5ab3676208e64c22b75790caead587b8, user.id=0edc99bb2191439ca8839bea31becd96) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:12.301959 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4e3c7-bfb0-4a3e-b084-e9470c21f662 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:12.305162 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4e3c7-bfb0-4a3e-b084-e9470c21f662 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:12.315612 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e158a6-8e69-484e-83ef-f5254f6de0c5 None admin] RBAC: Authorizing `identity:get_user(user_id=6704cb4f961045458060802ff3e3b3b2)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:12.322003 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 94/189] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:14:12 2022] GET /identity/v3/role_assignments?user.id=0edc99bb2191439ca8839bea31becd96&scope.project.id=5ab3676208e64c22b75790caead587b8&role.id=eb2435bb443d4469899fb3830f4ee5b1 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:12.322238 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e158a6-8e69-484e-83ef-f5254f6de0c5 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:12.322318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd380d9e-d70c-4c00-97e9-82df0a3385d2 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:12.322318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd380d9e-d70c-4c00-97e9-82df0a3385d2 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:12.322318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd380d9e-d70c-4c00-97e9-82df0a3385d2 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:12.322489 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 96/190] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:12 2022] GET /identity/v3/users/6704cb4f961045458060802ff3e3b3b2 => generated 283 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:12.322771 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 95/191] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:12.324154 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e158a6-8e69-484e-83ef-f5254f6de0c5 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:12.324296 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd380d9e-d70c-4c00-97e9-82df0a3385d2 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:12.449740 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:12.522322 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:12.526807 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e158a6-8e69-484e-83ef-f5254f6de0c5 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:12.579440 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd380d9e-d70c-4c00-97e9-82df0a3385d2 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:12.607861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef66d80-a0ff-48cd-8bb7-8fb323dd1970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:12.608939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef66d80-a0ff-48cd-8bb7-8fb323dd1970 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:12.609430 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef66d80-a0ff-48cd-8bb7-8fb323dd1970 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:12.609919 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef66d80-a0ff-48cd-8bb7-8fb323dd1970 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:12.618388 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef66d80-a0ff-48cd-8bb7-8fb323dd1970 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:12.619121 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef66d80-a0ff-48cd-8bb7-8fb323dd1970 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:12.621878 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef66d80-a0ff-48cd-8bb7-8fb323dd1970 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:12.635610 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f47f03-683e-4b23-970d-94b3709bc0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:12.636715 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f47f03-683e-4b23-970d-94b3709bc0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:12.637188 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f47f03-683e-4b23-970d-94b3709bc0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:12.637662 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f47f03-683e-4b23-970d-94b3709bc0a4 None admin] PATH_INFO: `/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:12.640780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f47f03-683e-4b23-970d-94b3709bc0a4 None admin] RBAC: Authorizing `identity:get_project(project_id=0c72ec4a5e6f40ac84de3c903eedf1d3)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:12.641716 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 97/192] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:12.643347 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f47f03-683e-4b23-970d-94b3709bc0a4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:12.646033 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 96/193] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:12 2022] GET /identity/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3 => generated 298 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:12.648375 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed22fd-3b88-476a-b130-c01549add4ea None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:12.648973 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed22fd-3b88-476a-b130-c01549add4ea None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:12.649358 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed22fd-3b88-476a-b130-c01549add4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:12.649541 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef66d80-a0ff-48cd-8bb7-8fb323dd1970 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:12.680631 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-5fed22fd-3b88-476a-b130-c01549add4ea None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:12.682733 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5fed22fd-3b88-476a-b130-c01549add4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:12.836557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 97/194] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:12.838403 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed22fd-3b88-476a-b130-c01549add4ea None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:12.890168 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef66d80-a0ff-48cd-8bb7-8fb323dd1970 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:12.939565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:12.978953 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595a3e8-19f2-4ae3-b599-90cdcafac05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:12.980076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595a3e8-19f2-4ae3-b599-90cdcafac05a None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:12.980629 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595a3e8-19f2-4ae3-b599-90cdcafac05a None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:12.981067 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595a3e8-19f2-4ae3-b599-90cdcafac05a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:13.052168 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:13.110135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed22fd-3b88-476a-b130-c01549add4ea None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:13.157986 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595a3e8-19f2-4ae3-b599-90cdcafac05a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:13.160406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595a3e8-19f2-4ae3-b599-90cdcafac05a None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:13.184938 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99598c0-9c16-499e-be41-73936b1f1735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:13.185684 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99598c0-9c16-499e-be41-73936b1f1735 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:13.185971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99598c0-9c16-499e-be41-73936b1f1735 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:13.186210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99598c0-9c16-499e-be41-73936b1f1735 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:13.187095 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99598c0-9c16-499e-be41-73936b1f1735 None admin] RBAC: Adding query filter params (role.id=c3d8f302f6714108ac91c25b8a32d36b, scope.project.id=0c72ec4a5e6f40ac84de3c903eedf1d3, user.id=0edc99bb2191439ca8839bea31becd96) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:13.187392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99598c0-9c16-499e-be41-73936b1f1735 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:13.189185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99598c0-9c16-499e-be41-73936b1f1735 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:13.204367 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 98/195] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:14:12 2022] GET /identity/v3/role_assignments?user.id=0edc99bb2191439ca8839bea31becd96&scope.project.id=0c72ec4a5e6f40ac84de3c903eedf1d3&role.id=c3d8f302f6714108ac91c25b8a32d36b => generated 608 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:13.206203 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99598c0-9c16-499e-be41-73936b1f1735 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:13.360509 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99598c0-9c16-499e-be41-73936b1f1735 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:13.372797 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:13.407220 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731abf79-f57d-4c59-954b-2136c8172b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:13.407910 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731abf79-f57d-4c59-954b-2136c8172b03 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:13.408951 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731abf79-f57d-4c59-954b-2136c8172b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:13.409227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731abf79-f57d-4c59-954b-2136c8172b03 None admin] PATH_INFO: `/v3/users/6704cb4f961045458060802ff3e3b3b2` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:13.411833 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731abf79-f57d-4c59-954b-2136c8172b03 None admin] RBAC: Authorizing `identity:get_user(user_id=6704cb4f961045458060802ff3e3b3b2)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:13.414375 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731abf79-f57d-4c59-954b-2136c8172b03 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:13.416199 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 99/196] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:13 2022] GET /identity/v3/users/6704cb4f961045458060802ff3e3b3b2 => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:13.420703 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731abf79-f57d-4c59-954b-2136c8172b03 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:13.430721 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 98/197] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:14:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 782 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:14:13.431838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595a3e8-19f2-4ae3-b599-90cdcafac05a None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:13.575261 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:13.647359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595a3e8-19f2-4ae3-b599-90cdcafac05a None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:13.678479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731abf79-f57d-4c59-954b-2136c8172b03 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:13.690096 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a4e60-46ae-41f6-b156-8cd14bcbee30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:13.690534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a4e60-46ae-41f6-b156-8cd14bcbee30 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:13.690912 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a4e60-46ae-41f6-b156-8cd14bcbee30 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:13.691305 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a4e60-46ae-41f6-b156-8cd14bcbee30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:13.754233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65751a-fd9b-493b-ad8a-ad2526ab13c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:13.755421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65751a-fd9b-493b-ad8a-ad2526ab13c9 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:13.756006 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65751a-fd9b-493b-ad8a-ad2526ab13c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:13.756482 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65751a-fd9b-493b-ad8a-ad2526ab13c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:13.770299 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a4e60-46ae-41f6-b156-8cd14bcbee30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:13.771461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a4e60-46ae-41f6-b156-8cd14bcbee30 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:13.777294 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65751a-fd9b-493b-ad8a-ad2526ab13c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:13.783730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-ff65751a-fd9b-493b-ad8a-ad2526ab13c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 14:14:13.783730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:13.783730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:13.783730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:13.783730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:13.783730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:13.783730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:13.783730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:13.783730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:13.783730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:13.783730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:13.783730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:13.783730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:13.783730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:13.783730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:13.783730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:13.785395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:13.785395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:13.785395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:13.785395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:13.785395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:13.785395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:13.785395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:13.785395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:13.785395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:13.785395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:13.785395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:13.785395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:13.785395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:13.785395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:13.785395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:13.785395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:13.786270 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:13.786270 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:13.786270 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:13.786270 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:13.786270 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:13.786270 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:13.786270 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:13.786270 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:13.786270 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:13.786270 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:13.786270 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 14:14:13.786270 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:14:13.789095 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 100/198] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:13.790279 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65751a-fd9b-493b-ad8a-ad2526ab13c9 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:13.843894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:13.865597 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:13.898220 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 99/199] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:14:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:14:13.899104 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a4e60-46ae-41f6-b156-8cd14bcbee30 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:13.979143 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65751a-fd9b-493b-ad8a-ad2526ab13c9 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:14.026472 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a4e60-46ae-41f6-b156-8cd14bcbee30 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:14.028425 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ec2d6-a81b-4ee8-a39e-e5284af87064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:14.029184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ec2d6-a81b-4ee8-a39e-e5284af87064 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:14.029508 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ec2d6-a81b-4ee8-a39e-e5284af87064 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:14.029776 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ec2d6-a81b-4ee8-a39e-e5284af87064 None admin] PATH_INFO: `/v3/projects/660126a36fe74ee0b2c60ecb51c62269` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:14.031147 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ec2d6-a81b-4ee8-a39e-e5284af87064 None admin] RBAC: Authorizing `identity:get_project(project_id=660126a36fe74ee0b2c60ecb51c62269)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:14.032565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ec2d6-a81b-4ee8-a39e-e5284af87064 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:14.035998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 101/200] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:13 2022] GET /identity/v3/projects/660126a36fe74ee0b2c60ecb51c62269 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:14.046041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ec2d6-a81b-4ee8-a39e-e5284af87064 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:14.072313 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2ef56-7b65-4917-8954-3bb9186a3ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:14.072981 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2ef56-7b65-4917-8954-3bb9186a3ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:14.073266 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2ef56-7b65-4917-8954-3bb9186a3ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:14.073528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2ef56-7b65-4917-8954-3bb9186a3ae7 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:14.074225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2ef56-7b65-4917-8954-3bb9186a3ae7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:14.074527 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2ef56-7b65-4917-8954-3bb9186a3ae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:14.076016 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2ef56-7b65-4917-8954-3bb9186a3ae7 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:14.086748 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 100/201] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:14:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:14.087348 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2ef56-7b65-4917-8954-3bb9186a3ae7 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:14.121776 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:14.189235 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ec2d6-a81b-4ee8-a39e-e5284af87064 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:14.192166 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:14.218523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2ef56-7b65-4917-8954-3bb9186a3ae7 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:14.236216 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f73168-87c2-46b3-8cd6-d96a85bada93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:14.237519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f73168-87c2-46b3-8cd6-d96a85bada93 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:14.237926 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f73168-87c2-46b3-8cd6-d96a85bada93 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:14.238864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f73168-87c2-46b3-8cd6-d96a85bada93 None admin] PATH_INFO: `/v3/projects/660126a36fe74ee0b2c60ecb51c62269` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:14.239635 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f73168-87c2-46b3-8cd6-d96a85bada93 None admin] RBAC: Authorizing `identity:get_project(project_id=660126a36fe74ee0b2c60ecb51c62269)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:14.241272 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f73168-87c2-46b3-8cd6-d96a85bada93 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:14.243184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 102/202] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:14 2022] GET /identity/v3/projects/660126a36fe74ee0b2c60ecb51c62269 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:14.244042 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f73168-87c2-46b3-8cd6-d96a85bada93 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:14.269376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e5169-aea5-48c7-9dea-b8e5a72f1e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:14.270049 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e5169-aea5-48c7-9dea-b8e5a72f1e0d None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:14.270332 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e5169-aea5-48c7-9dea-b8e5a72f1e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:14.270686 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e5169-aea5-48c7-9dea-b8e5a72f1e0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:14.271360 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e5169-aea5-48c7-9dea-b8e5a72f1e0d None admin] RBAC: Adding query filter params (role.id=c3d8f302f6714108ac91c25b8a32d36b, scope.project.id=660126a36fe74ee0b2c60ecb51c62269, user.id=6704cb4f961045458060802ff3e3b3b2) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:14.275743 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e5169-aea5-48c7-9dea-b8e5a72f1e0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:14.275743 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e5169-aea5-48c7-9dea-b8e5a72f1e0d None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:14.281485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 101/203] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:14:14 2022] GET /identity/v3/role_assignments?user.id=6704cb4f961045458060802ff3e3b3b2&scope.project.id=660126a36fe74ee0b2c60ecb51c62269&role.id=c3d8f302f6714108ac91c25b8a32d36b => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:14.282346 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e5169-aea5-48c7-9dea-b8e5a72f1e0d None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:14.382980 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f73168-87c2-46b3-8cd6-d96a85bada93 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:14.437177 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e0e2e-0938-4322-9d34-6f0beaf4b940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:14.438487 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e0e2e-0938-4322-9d34-6f0beaf4b940 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:14.438982 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e0e2e-0938-4322-9d34-6f0beaf4b940 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:14.441277 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e0e2e-0938-4322-9d34-6f0beaf4b940 None admin] PATH_INFO: `/v3/users/db0bb520bef74888b1acc290d9cc9db9` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:14.443039 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e0e2e-0938-4322-9d34-6f0beaf4b940 None admin] RBAC: Authorizing `identity:get_user(user_id=db0bb520bef74888b1acc290d9cc9db9)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:14.446083 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e0e2e-0938-4322-9d34-6f0beaf4b940 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:14.449606 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 103/204] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:14 2022] GET /identity/v3/users/db0bb520bef74888b1acc290d9cc9db9 => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:14.459485 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e0e2e-0938-4322-9d34-6f0beaf4b940 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:14.512198 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:14.541821 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e5169-aea5-48c7-9dea-b8e5a72f1e0d None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:14.585452 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:14.636635 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8c8fe-af0c-4fa6-bb18-32586ca085dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:14.637440 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8c8fe-af0c-4fa6-bb18-32586ca085dd None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:14.637614 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8c8fe-af0c-4fa6-bb18-32586ca085dd None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:14.637975 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8c8fe-af0c-4fa6-bb18-32586ca085dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:14.638546 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8c8fe-af0c-4fa6-bb18-32586ca085dd None admin] RBAC: Adding query filter params (role.id=a16b6daeda5b4a67992f3c12514ca90e, scope.project.id=660126a36fe74ee0b2c60ecb51c62269, user.id=6704cb4f961045458060802ff3e3b3b2) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:14.638858 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8c8fe-af0c-4fa6-bb18-32586ca085dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:14.640407 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8c8fe-af0c-4fa6-bb18-32586ca085dd None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:14.664252 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 102/205] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:14:14 2022] GET /identity/v3/role_assignments?user.id=6704cb4f961045458060802ff3e3b3b2&scope.project.id=660126a36fe74ee0b2c60ecb51c62269&role.id=a16b6daeda5b4a67992f3c12514ca90e => generated 259 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:14.742719 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e0e2e-0938-4322-9d34-6f0beaf4b940 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:14.828888 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5863a5c-6c7b-4559-a75f-7027b83b4c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:14.831524 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5863a5c-6c7b-4559-a75f-7027b83b4c81 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:14.832433 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5863a5c-6c7b-4559-a75f-7027b83b4c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:14.833163 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5863a5c-6c7b-4559-a75f-7027b83b4c81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:14.979087 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5863a5c-6c7b-4559-a75f-7027b83b4c81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:14.982374 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5863a5c-6c7b-4559-a75f-7027b83b4c81 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:15.080078 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:15.200831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 104/206] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:14:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 742 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 14:14:15.208746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8c8fe-af0c-4fa6-bb18-32586ca085dd None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:15.512828 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8c8fe-af0c-4fa6-bb18-32586ca085dd None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:15.608955 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9031d5-dc65-4d13-965d-1164aff70426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:15.610454 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9031d5-dc65-4d13-965d-1164aff70426 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:15.611858 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9031d5-dc65-4d13-965d-1164aff70426 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:15.612586 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9031d5-dc65-4d13-965d-1164aff70426 None admin] PATH_INFO: `/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:15.615130 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9031d5-dc65-4d13-965d-1164aff70426 None admin] RBAC: Authorizing `identity:get_project(project_id=0c72ec4a5e6f40ac84de3c903eedf1d3)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:15.618204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9031d5-dc65-4d13-965d-1164aff70426 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:15.621638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 103/207] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:15 2022] GET /identity/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3 => generated 298 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:15.631890 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5863a5c-6c7b-4559-a75f-7027b83b4c81 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:15.863268 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5863a5c-6c7b-4559-a75f-7027b83b4c81 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:15.915734 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb685c-b27c-46a0-b063-584578300f17 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:15.916748 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb685c-b27c-46a0-b063-584578300f17 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:15.918689 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb685c-b27c-46a0-b063-584578300f17 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:15.920774 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 104/208] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:14:15.926877 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1f33d-b7aa-4746-8fe6-ac6d2ba3dcaa None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:15.927488 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1f33d-b7aa-4746-8fe6-ac6d2ba3dcaa None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:15.928006 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1f33d-b7aa-4746-8fe6-ac6d2ba3dcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:15.946505 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65aa12-5331-40f5-8744-297f0c26333c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:15.947513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65aa12-5331-40f5-8744-297f0c26333c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:15.948025 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65aa12-5331-40f5-8744-297f0c26333c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:15.948485 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65aa12-5331-40f5-8744-297f0c26333c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:15.949428 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65aa12-5331-40f5-8744-297f0c26333c None admin] RBAC: Adding query filter params (role.id=d1857bfa9b524282b38b5bf1160e2473, scope.project.id=0c72ec4a5e6f40ac84de3c903eedf1d3, user.id=db0bb520bef74888b1acc290d9cc9db9) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:15.949935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65aa12-5331-40f5-8744-297f0c26333c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:15.951677 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65aa12-5331-40f5-8744-297f0c26333c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:15.956933 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-39b1f33d-b7aa-4746-8fe6-ac6d2ba3dcaa None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:15.958495 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-39b1f33d-b7aa-4746-8fe6-ac6d2ba3dcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:15.966459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 105/209] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:14:15 2022] GET /identity/v3/role_assignments?user.id=db0bb520bef74888b1acc290d9cc9db9&scope.project.id=0c72ec4a5e6f40ac84de3c903eedf1d3&role.id=d1857bfa9b524282b38b5bf1160e2473 => generated 608 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:16.003152 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:16.071309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 105/210] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 14:14:16.300243 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1685e-f96b-4efb-b680-e6ae42de90d3 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:16.300736 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1685e-f96b-4efb-b680-e6ae42de90d3 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:16.301223 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1685e-f96b-4efb-b680-e6ae42de90d3 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:16.304142 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 106/211] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:16.316235 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe287ad-81e1-41af-9171-45c60e28782d None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:16.316528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe287ad-81e1-41af-9171-45c60e28782d None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:16.316839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe287ad-81e1-41af-9171-45c60e28782d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:16.341569 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-8fe287ad-81e1-41af-9171-45c60e28782d None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:16.342767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-8fe287ad-81e1-41af-9171-45c60e28782d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:16.483780 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 106/212] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 14:14:16.628805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1685e-f96b-4efb-b680-e6ae42de90d3 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:16.638171 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:16.844657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1685e-f96b-4efb-b680-e6ae42de90d3 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:16.911395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b903db7-e8b2-4766-8e03-e30710bc3c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:16.912413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b903db7-e8b2-4766-8e03-e30710bc3c55 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:16.912876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b903db7-e8b2-4766-8e03-e30710bc3c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:16.913329 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b903db7-e8b2-4766-8e03-e30710bc3c55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:16.934048 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b903db7-e8b2-4766-8e03-e30710bc3c55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:16.945125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-5b903db7-e8b2-4766-8e03-e30710bc3c55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:16.945125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:16.945125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:16.945125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:16.945125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:16.945125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:16.945125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:16.945125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:16.945125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:16.945125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:16.945125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:16.945125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:16.945125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:16.945125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:16.945125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:16.945125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:16.946227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:16.946227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:16.946227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:16.946227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:16.946227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:16.946227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:16.946227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:16.946227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:16.946227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:16.946227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:16.946227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:16.946227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:16.946227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:16.946227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:16.946227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:16.946227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:16.947137 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:16.947137 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:16.947137 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:16.947137 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:16.947137 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:16.947137 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:16.947137 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:16.947137 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:16.947137 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:16.947137 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:16.947137 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:16.947137 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:14:16.947791 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 107/213] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:16.956981 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe287ad-81e1-41af-9171-45c60e28782d None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:16.968994 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b903db7-e8b2-4766-8e03-e30710bc3c55 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:17.112458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b903db7-e8b2-4766-8e03-e30710bc3c55 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:17.116157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:17.164186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:17.164379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdfb7a-e3d9-4f4d-812d-2e2aba0360a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:17.165072 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdfb7a-e3d9-4f4d-812d-2e2aba0360a1 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:17.165359 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdfb7a-e3d9-4f4d-812d-2e2aba0360a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:17.165628 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdfb7a-e3d9-4f4d-812d-2e2aba0360a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:17.166870 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdfb7a-e3d9-4f4d-812d-2e2aba0360a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:17.168563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdfb7a-e3d9-4f4d-812d-2e2aba0360a1 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:17.175843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 108/214] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:14:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:17.178715 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdfb7a-e3d9-4f4d-812d-2e2aba0360a1 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:17.209230 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe287ad-81e1-41af-9171-45c60e28782d None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:17.294807 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee305523-d622-4bbc-b463-8265d8bbd8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:17.295933 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee305523-d622-4bbc-b463-8265d8bbd8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:17.296673 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee305523-d622-4bbc-b463-8265d8bbd8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:17.297159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee305523-d622-4bbc-b463-8265d8bbd8b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:17.300431 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee305523-d622-4bbc-b463-8265d8bbd8b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:17.300982 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee305523-d622-4bbc-b463-8265d8bbd8b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:17.303686 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee305523-d622-4bbc-b463-8265d8bbd8b2 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:17.326301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 107/215] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:14:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:17.335238 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee305523-d622-4bbc-b463-8265d8bbd8b2 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:17.344580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdfb7a-e3d9-4f4d-812d-2e2aba0360a1 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:17.403590 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:17.413072 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f2a1a-1d03-4b9e-af15-05b127f4c68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:17.414902 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f2a1a-1d03-4b9e-af15-05b127f4c68c None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:17.415422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f2a1a-1d03-4b9e-af15-05b127f4c68c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:17.416335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f2a1a-1d03-4b9e-af15-05b127f4c68c None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:17.417274 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f2a1a-1d03-4b9e-af15-05b127f4c68c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:17.419574 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f2a1a-1d03-4b9e-af15-05b127f4c68c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:17.458611 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 109/216] 10.222.0.62 () {60 vars in 1132 bytes} [Tue Oct 4 14:14:17 2022] POST /identity/v3/users => generated 297 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:14:17.541981 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee305523-d622-4bbc-b463-8265d8bbd8b2 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:17.587984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dce19b-b471-44ee-ad37-5cb9a388ae09 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:17.588278 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dce19b-b471-44ee-ad37-5cb9a388ae09 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:17.588549 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dce19b-b471-44ee-ad37-5cb9a388ae09 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:17.590387 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 110/217] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:14:17.596288 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01dcee-349c-494b-a0cb-5f8f528fdccd None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:17.596628 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01dcee-349c-494b-a0cb-5f8f528fdccd None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:17.596804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01dcee-349c-494b-a0cb-5f8f528fdccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:17.615505 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c5a4b-febb-4cbd-8d67-22e13815c8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:17.617146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c5a4b-febb-4cbd-8d67-22e13815c8bc None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:17.617940 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c5a4b-febb-4cbd-8d67-22e13815c8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:17.618701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c5a4b-febb-4cbd-8d67-22e13815c8bc None admin] PATH_INFO: `/v3/users/d8b41367ae0f4a21808f1d2a4b14e2b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:17.618949 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-1b01dcee-349c-494b-a0cb-5f8f528fdccd None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:17.620241 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1b01dcee-349c-494b-a0cb-5f8f528fdccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:17.644436 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:17.649515 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c5a4b-febb-4cbd-8d67-22e13815c8bc None admin] RBAC: Authorizing `identity:get_user(user_id=d8b41367ae0f4a21808f1d2a4b14e2b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:17.652955 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c5a4b-febb-4cbd-8d67-22e13815c8bc None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:17.657313 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 108/218] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:17 2022] GET /identity/v3/users/d8b41367ae0f4a21808f1d2a4b14e2b1 => generated 297 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:17.668189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c5a4b-febb-4cbd-8d67-22e13815c8bc None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:17.723837 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 111/219] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 14:14:17.890355 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c5a4b-febb-4cbd-8d67-22e13815c8bc None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:17.972376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a23d9f-63b8-45bb-9c63-a09cfa642a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:17.974655 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a23d9f-63b8-45bb-9c63-a09cfa642a67 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:17.975153 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a23d9f-63b8-45bb-9c63-a09cfa642a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:17.975629 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a23d9f-63b8-45bb-9c63-a09cfa642a67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:18.011312 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01dcee-349c-494b-a0cb-5f8f528fdccd None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:18.119690 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a23d9f-63b8-45bb-9c63-a09cfa642a67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:18.123484 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a23d9f-63b8-45bb-9c63-a09cfa642a67 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:18.131997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:18.266004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01dcee-349c-494b-a0cb-5f8f528fdccd None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:18.309563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:18.352047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4a78a-b7c9-4f06-9197-4fb3925fc9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:18.353516 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4a78a-b7c9-4f06-9197-4fb3925fc9f8 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:18.353983 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4a78a-b7c9-4f06-9197-4fb3925fc9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:18.354440 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4a78a-b7c9-4f06-9197-4fb3925fc9f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:18.356468 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 109/220] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:14:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:14:18.358243 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533aed12-945e-4a64-8e25-d16edc1e67bd None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:18.358779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533aed12-945e-4a64-8e25-d16edc1e67bd None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:18.359289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533aed12-945e-4a64-8e25-d16edc1e67bd None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:18.361558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 110/221] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:18.372848 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533aed12-945e-4a64-8e25-d16edc1e67bd None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:18.374943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4a78a-b7c9-4f06-9197-4fb3925fc9f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:18.387665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-22f4a78a-b7c9-4f06-9197-4fb3925fc9f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:14:18.387665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:18.387665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:18.387665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:18.387665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:18.387665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:18.387665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:18.387665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:18.387665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:18.387665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:18.387665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:18.387665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:18.387665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:18.387665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:18.387665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:18.387665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:18.388675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:18.388675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:18.388675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:18.388675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:18.388675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:18.388675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:18.388675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:18.388675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:18.388675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:18.388675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:18.388675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:18.388675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:18.388675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:18.388675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:18.388675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:18.388675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:18.389465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:18.389465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:18.389465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:18.389465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:18.389465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:18.389465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:18.389465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:18.389465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:18.389465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:18.389465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:18.389465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:14:18.389465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:14:18.390580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 112/222] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Oct 4 14:14:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:18.393267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88495b0b-589a-4d6d-af53-2cd31e79b599 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:18.393737 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88495b0b-589a-4d6d-af53-2cd31e79b599 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:18.394581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88495b0b-589a-4d6d-af53-2cd31e79b599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:18.427090 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-88495b0b-589a-4d6d-af53-2cd31e79b599 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:18.428517 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-88495b0b-589a-4d6d-af53-2cd31e79b599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:18.519544 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 113/223] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:18.520570 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88495b0b-589a-4d6d-af53-2cd31e79b599 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:18.575637 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:18.594413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533aed12-945e-4a64-8e25-d16edc1e67bd None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:18.697888 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12953d9-7c82-4f54-833c-ed0a23f88c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:18.698984 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12953d9-7c82-4f54-833c-ed0a23f88c7d None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:18.699470 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12953d9-7c82-4f54-833c-ed0a23f88c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:18.699984 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12953d9-7c82-4f54-833c-ed0a23f88c7d None admin] PATH_INFO: `/v3/projects/660126a36fe74ee0b2c60ecb51c62269` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:18.704799 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12953d9-7c82-4f54-833c-ed0a23f88c7d None admin] RBAC: Authorizing `identity:get_project(project_id=660126a36fe74ee0b2c60ecb51c62269)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:18.707513 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12953d9-7c82-4f54-833c-ed0a23f88c7d None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:18.709356 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 111/224] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:18 2022] GET /identity/v3/projects/660126a36fe74ee0b2c60ecb51c62269 => generated 302 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:18.719032 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12953d9-7c82-4f54-833c-ed0a23f88c7d None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:18.773291 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88495b0b-589a-4d6d-af53-2cd31e79b599 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:18.809501 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:18.863492 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12953d9-7c82-4f54-833c-ed0a23f88c7d None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:18.906595 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ade4e-b193-459c-8e24-ab5f8a62e1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:18.907326 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ade4e-b193-459c-8e24-ab5f8a62e1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:18.907607 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ade4e-b193-459c-8e24-ab5f8a62e1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:18.907971 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ade4e-b193-459c-8e24-ab5f8a62e1e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:18.909247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ade4e-b193-459c-8e24-ab5f8a62e1e7 None admin] RBAC: Adding query filter params (role.id=eb2435bb443d4469899fb3830f4ee5b1, scope.project.id=660126a36fe74ee0b2c60ecb51c62269, user.id=d8b41367ae0f4a21808f1d2a4b14e2b1) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:18.909550 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ade4e-b193-459c-8e24-ab5f8a62e1e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:18.911076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ade4e-b193-459c-8e24-ab5f8a62e1e7 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:18.914992 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f2791-cc4d-4105-865f-f6bcb36bc15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:18.916120 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f2791-cc4d-4105-865f-f6bcb36bc15f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:18.916571 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f2791-cc4d-4105-865f-f6bcb36bc15f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:18.917018 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f2791-cc4d-4105-865f-f6bcb36bc15f None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:18.917904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 112/225] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:14:18 2022] GET /identity/v3/role_assignments?user.id=d8b41367ae0f4a21808f1d2a4b14e2b1&scope.project.id=660126a36fe74ee0b2c60ecb51c62269&role.id=eb2435bb443d4469899fb3830f4ee5b1 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:14:18.924783 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f2791-cc4d-4105-865f-f6bcb36bc15f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:18.925381 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f2791-cc4d-4105-865f-f6bcb36bc15f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:18.928181 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f2791-cc4d-4105-865f-f6bcb36bc15f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:18.948844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 114/226] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:14:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:18.954544 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ade4e-b193-459c-8e24-ab5f8a62e1e7 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:19.015859 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:19.130058 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f2791-cc4d-4105-865f-f6bcb36bc15f None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:19.140841 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ade4e-b193-459c-8e24-ab5f8a62e1e7 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:19.279753 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f6aa4-2cd9-4459-9385-9fe56b9c35e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:19.280883 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f6aa4-2cd9-4459-9385-9fe56b9c35e7 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:19.281374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f6aa4-2cd9-4459-9385-9fe56b9c35e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:19.281962 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f6aa4-2cd9-4459-9385-9fe56b9c35e7 None admin] PATH_INFO: `/v3/users/6704cb4f961045458060802ff3e3b3b2` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:19.288668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f6aa4-2cd9-4459-9385-9fe56b9c35e7 None admin] RBAC: Authorizing `identity:get_user(user_id=6704cb4f961045458060802ff3e3b3b2)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:19.290756 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f6aa4-2cd9-4459-9385-9fe56b9c35e7 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:19.292938 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 113/227] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:18 2022] GET /identity/v3/users/6704cb4f961045458060802ff3e3b3b2 => generated 283 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:19.299523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f6aa4-2cd9-4459-9385-9fe56b9c35e7 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:19.324558 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f2791-cc4d-4105-865f-f6bcb36bc15f None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:19.406341 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fea69-3e8f-4709-8f09-9b22adfdb48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:19.407400 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fea69-3e8f-4709-8f09-9b22adfdb48c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:19.408467 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fea69-3e8f-4709-8f09-9b22adfdb48c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:19.408989 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fea69-3e8f-4709-8f09-9b22adfdb48c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:19.448135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fea69-3e8f-4709-8f09-9b22adfdb48c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:19.465135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-324fea69-3e8f-4709-8f09-9b22adfdb48c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:14:19.465135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:19.465135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:19.465135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:19.465135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:19.465135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:19.465135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:19.465135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:19.465135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:19.465135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:19.465135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:19.465135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:19.465135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:19.465135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:19.465135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:19.465135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:19.466651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:19.466651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:19.466651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:19.466651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:19.466651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:19.466651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:19.466651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:19.466651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:19.466651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:19.466651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:19.466651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:19.466651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:19.466651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:19.466651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:19.466651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:19.466651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:19.468000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:19.468000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:19.468000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:19.468000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:19.468000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:19.468000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:19.468000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:19.468000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:19.468000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:19.468000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:19.468000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:14:19.468000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:14:19.473939 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 115/228] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:14:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:14:19.483417 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fea69-3e8f-4709-8f09-9b22adfdb48c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:19.523488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:19.557508 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:19.562578 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f6aa4-2cd9-4459-9385-9fe56b9c35e7 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:19.641498 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86257280-aa08-41a6-81ca-979884b0c473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:19.642683 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86257280-aa08-41a6-81ca-979884b0c473 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:19.642963 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86257280-aa08-41a6-81ca-979884b0c473 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:19.643232 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86257280-aa08-41a6-81ca-979884b0c473 None admin] PATH_INFO: `/v3/projects/660126a36fe74ee0b2c60ecb51c62269` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:19.649268 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86257280-aa08-41a6-81ca-979884b0c473 None admin] RBAC: Authorizing `identity:get_project(project_id=660126a36fe74ee0b2c60ecb51c62269)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:19.652240 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86257280-aa08-41a6-81ca-979884b0c473 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:19.655895 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 114/229] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:19 2022] GET /identity/v3/projects/660126a36fe74ee0b2c60ecb51c62269 => generated 302 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:14:19.665451 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86257280-aa08-41a6-81ca-979884b0c473 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:19.691111 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fea69-3e8f-4709-8f09-9b22adfdb48c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:19.777243 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e19e9-df14-4e93-ad59-5952f9214f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:19.777914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e19e9-df14-4e93-ad59-5952f9214f42 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:19.778181 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e19e9-df14-4e93-ad59-5952f9214f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:19.778520 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e19e9-df14-4e93-ad59-5952f9214f42 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:19.779237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e19e9-df14-4e93-ad59-5952f9214f42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:19.779537 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e19e9-df14-4e93-ad59-5952f9214f42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:19.781220 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e19e9-df14-4e93-ad59-5952f9214f42 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:19.806080 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 116/230] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:14:19.813370 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e19e9-df14-4e93-ad59-5952f9214f42 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:19.971189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86257280-aa08-41a6-81ca-979884b0c473 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:20.105500 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456bcfb-bea0-43c6-8b1e-820792ff3b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:20.106704 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456bcfb-bea0-43c6-8b1e-820792ff3b20 None admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:20.107200 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456bcfb-bea0-43c6-8b1e-820792ff3b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:20.107697 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456bcfb-bea0-43c6-8b1e-820792ff3b20 None admin] PATH_INFO: `/v3/projects/660126a36fe74ee0b2c60ecb51c62269/users/6704cb4f961045458060802ff3e3b3b2/roles/c3d8f302f6714108ac91c25b8a32d36b` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:20.112092 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:20.117361 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456bcfb-bea0-43c6-8b1e-820792ff3b20 None admin] RBAC: Authorizing `identity:create_grant(project_id=660126a36fe74ee0b2c60ecb51c62269, user_id=6704cb4f961045458060802ff3e3b3b2, role_id=c3d8f302f6714108ac91c25b8a32d36b)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:20.119236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456bcfb-bea0-43c6-8b1e-820792ff3b20 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:20.137300 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 115/231] 10.222.0.62 () {58 vars in 1439 bytes} [Tue Oct 4 14:14:19 2022] PUT /identity/v3/projects/660126a36fe74ee0b2c60ecb51c62269/users/6704cb4f961045458060802ff3e3b3b2/roles/c3d8f302f6714108ac91c25b8a32d36b => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:14:20.145266 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e19e9-df14-4e93-ad59-5952f9214f42 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:20.218738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea44ad-60e3-4d3c-b900-972042a3c428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:20.219594 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea44ad-60e3-4d3c-b900-972042a3c428 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:20.220027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea44ad-60e3-4d3c-b900-972042a3c428 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:20.221051 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea44ad-60e3-4d3c-b900-972042a3c428 None admin] PATH_INFO: `/v3/users/6704cb4f961045458060802ff3e3b3b2` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:20.229288 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea44ad-60e3-4d3c-b900-972042a3c428 None admin] RBAC: Authorizing `identity:get_user(user_id=6704cb4f961045458060802ff3e3b3b2)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:20.232241 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea44ad-60e3-4d3c-b900-972042a3c428 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:20.235976 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 117/232] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:19 2022] GET /identity/v3/users/6704cb4f961045458060802ff3e3b3b2 => generated 283 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:20.245645 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456bcfb-bea0-43c6-8b1e-820792ff3b20 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:20.293451 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:20.426655 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456bcfb-bea0-43c6-8b1e-820792ff3b20 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:20.469393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f07da-9564-4eb5-96ce-65f2590a5c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:20.470096 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f07da-9564-4eb5-96ce-65f2590a5c20 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:20.470436 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f07da-9564-4eb5-96ce-65f2590a5c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:20.470720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f07da-9564-4eb5-96ce-65f2590a5c20 None admin] PATH_INFO: `/v3/projects/660126a36fe74ee0b2c60ecb51c62269` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:20.472202 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f07da-9564-4eb5-96ce-65f2590a5c20 None admin] RBAC: Authorizing `identity:get_project(project_id=660126a36fe74ee0b2c60ecb51c62269)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:20.473707 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f07da-9564-4eb5-96ce-65f2590a5c20 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:20.475834 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 116/233] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:20 2022] GET /identity/v3/projects/660126a36fe74ee0b2c60ecb51c62269 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:20.481797 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea44ad-60e3-4d3c-b900-972042a3c428 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:20.683575 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea44ad-60e3-4d3c-b900-972042a3c428 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:20.757811 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1d9cd-ccee-4b8a-8490-00ef9a9df7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:20.758860 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1d9cd-ccee-4b8a-8490-00ef9a9df7d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:20.759339 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1d9cd-ccee-4b8a-8490-00ef9a9df7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:20.759854 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1d9cd-ccee-4b8a-8490-00ef9a9df7d7 None admin] PATH_INFO: `/v3/projects/660126a36fe74ee0b2c60ecb51c62269/users/6704cb4f961045458060802ff3e3b3b2/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:20.765994 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1d9cd-ccee-4b8a-8490-00ef9a9df7d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=660126a36fe74ee0b2c60ecb51c62269, user_id=6704cb4f961045458060802ff3e3b3b2, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:20.769143 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1d9cd-ccee-4b8a-8490-00ef9a9df7d7 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:20.807838 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 118/234] 10.222.0.62 () {58 vars in 1439 bytes} [Tue Oct 4 14:14:20 2022] PUT /identity/v3/projects/660126a36fe74ee0b2c60ecb51c62269/users/6704cb4f961045458060802ff3e3b3b2/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:14:21.133477 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e5f88-1e6c-49e1-914c-7e3b6ed3d701 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:21.134459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e5f88-1e6c-49e1-914c-7e3b6ed3d701 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:21.134953 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e5f88-1e6c-49e1-914c-7e3b6ed3d701 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:21.137015 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 117/235] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:21.158720 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c781d63-70fb-48fa-b58d-814431f15d2f None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:21.159373 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c781d63-70fb-48fa-b58d-814431f15d2f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:21.159909 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c781d63-70fb-48fa-b58d-814431f15d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:21.190452 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-2c781d63-70fb-48fa-b58d-814431f15d2f None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:21.192543 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2c781d63-70fb-48fa-b58d-814431f15d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:21.217239 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:21.306087 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 119/236] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:21.619750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e5f88-1e6c-49e1-914c-7e3b6ed3d701 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:21.703263 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140958f-0624-45b4-93ea-f263bcdcc9c0 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:21.703629 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140958f-0624-45b4-93ea-f263bcdcc9c0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:21.703854 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140958f-0624-45b4-93ea-f263bcdcc9c0 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:21.705950 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 120/237] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:21.711369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc13fb9-9d08-4d71-a1c6-4ddf9cbae37e None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:21.711657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc13fb9-9d08-4d71-a1c6-4ddf9cbae37e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:21.711938 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc13fb9-9d08-4d71-a1c6-4ddf9cbae37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:21.754977 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:21.756771 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-6dc13fb9-9d08-4d71-a1c6-4ddf9cbae37e None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:21.757987 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6dc13fb9-9d08-4d71-a1c6-4ddf9cbae37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:21.764732 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e5f88-1e6c-49e1-914c-7e3b6ed3d701 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:21.811426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba2576-b738-472e-9231-f073544318ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:21.812461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba2576-b738-472e-9231-f073544318ec None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:21.813209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba2576-b738-472e-9231-f073544318ec None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:21.815140 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba2576-b738-472e-9231-f073544318ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:21.828458 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba2576-b738-472e-9231-f073544318ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:21.834994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-3fba2576-b738-472e-9231-f073544318ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 14:14:21.834994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:21.834994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:21.834994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:21.834994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:21.834994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:21.834994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:21.834994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:21.834994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:21.834994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:21.834994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:21.834994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:21.834994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:21.834994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:21.834994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:21.834994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:21.836042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:21.836042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:21.836042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:21.836042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:21.836042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:21.836042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:21.836042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:21.836042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:21.836042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:21.836042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:21.836042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:21.836042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:21.836042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:21.836042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:21.836042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:21.836042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:21.836886 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:21.836886 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:21.836886 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:21.836886 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:21.836886 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:21.836886 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:21.836886 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:21.836886 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:21.836886 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:21.836886 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:21.836886 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 14:14:21.836886 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:14:21.839623 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 118/238] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:21.846198 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba2576-b738-472e-9231-f073544318ec None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:21.928981 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 121/239] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 14:14:22.037336 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba2576-b738-472e-9231-f073544318ec None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:22.078994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fdd466-5250-4e1a-9e01-80285679a860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:22.080240 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdd466-5250-4e1a-9e01-80285679a860 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:22.080756 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdd466-5250-4e1a-9e01-80285679a860 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:22.081235 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdd466-5250-4e1a-9e01-80285679a860 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:22.082155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fdd466-5250-4e1a-9e01-80285679a860 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:22.082681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fdd466-5250-4e1a-9e01-80285679a860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:22.084349 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fdd466-5250-4e1a-9e01-80285679a860 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:22.094635 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 119/240] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:14:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:22.100430 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc13fb9-9d08-4d71-a1c6-4ddf9cbae37e None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:22.210191 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:22.241138 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc13fb9-9d08-4d71-a1c6-4ddf9cbae37e None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:22.289549 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19aac72-1d35-43e0-be99-9696ee6e808e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:22.290220 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aac72-1d35-43e0-be99-9696ee6e808e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:22.290494 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aac72-1d35-43e0-be99-9696ee6e808e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:22.290760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aac72-1d35-43e0-be99-9696ee6e808e None admin] PATH_INFO: `/v3/users/31e2ee7593624e6abf462be463496e91` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:22.312370 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19aac72-1d35-43e0-be99-9696ee6e808e None admin] RBAC: Authorizing `identity:get_user(user_id=31e2ee7593624e6abf462be463496e91)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:22.314212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19aac72-1d35-43e0-be99-9696ee6e808e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:22.316207 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 122/241] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:22 2022] GET /identity/v3/users/31e2ee7593624e6abf462be463496e91 => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:22.321978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fdd466-5250-4e1a-9e01-80285679a860 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:22.355306 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19aac72-1d35-43e0-be99-9696ee6e808e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:22.359245 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:22.464544 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fdd466-5250-4e1a-9e01-80285679a860 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:22.509728 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7baea30-bd37-4c2f-8fe9-eba6c174d292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:22.510811 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baea30-bd37-4c2f-8fe9-eba6c174d292 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:22.511329 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baea30-bd37-4c2f-8fe9-eba6c174d292 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:22.511989 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baea30-bd37-4c2f-8fe9-eba6c174d292 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:22.577641 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19aac72-1d35-43e0-be99-9696ee6e808e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:22.605146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7baea30-bd37-4c2f-8fe9-eba6c174d292 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:22.608161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7baea30-bd37-4c2f-8fe9-eba6c174d292 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:22.633368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:22.636735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d888d50-f1f9-4053-9deb-be9b63cf70bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:22.637799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d888d50-f1f9-4053-9deb-be9b63cf70bf None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:22.638278 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d888d50-f1f9-4053-9deb-be9b63cf70bf None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:22.639089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d888d50-f1f9-4053-9deb-be9b63cf70bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:22.640955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d888d50-f1f9-4053-9deb-be9b63cf70bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:22.644382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d888d50-f1f9-4053-9deb-be9b63cf70bf None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:22.647293 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 123/242] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:14:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:14:22.649792 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319a144-2f82-4b5b-855f-9e92efe59dcb None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:22.650638 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319a144-2f82-4b5b-855f-9e92efe59dcb None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:22.650742 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319a144-2f82-4b5b-855f-9e92efe59dcb None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:22.659865 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 124/243] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:22.661489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319a144-2f82-4b5b-855f-9e92efe59dcb None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:22.680099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:22.748355 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 120/244] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:14:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:14:22.750356 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771539c-655f-42bb-a0d7-10bd7bf9225e None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:22.750894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771539c-655f-42bb-a0d7-10bd7bf9225e None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:22.751438 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771539c-655f-42bb-a0d7-10bd7bf9225e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:22.774842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-0771539c-655f-42bb-a0d7-10bd7bf9225e None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:22.776568 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-0771539c-655f-42bb-a0d7-10bd7bf9225e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:22.860030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 121/245] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:22.861650 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771539c-655f-42bb-a0d7-10bd7bf9225e None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:22.877269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319a144-2f82-4b5b-855f-9e92efe59dcb None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:22.921902 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:22.989623 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d058e3-b8b4-42e5-b03c-36add78fc29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:22.990679 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d058e3-b8b4-42e5-b03c-36add78fc29b None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:22.991141 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d058e3-b8b4-42e5-b03c-36add78fc29b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:22.993481 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771539c-655f-42bb-a0d7-10bd7bf9225e None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:23.000048 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d058e3-b8b4-42e5-b03c-36add78fc29b None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:23.002327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d058e3-b8b4-42e5-b03c-36add78fc29b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:23.005194 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d058e3-b8b4-42e5-b03c-36add78fc29b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:23.038281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf470a9-15e9-4301-bcb7-e4fe2a3476bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:23.039544 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf470a9-15e9-4301-bcb7-e4fe2a3476bb None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:23.040087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf470a9-15e9-4301-bcb7-e4fe2a3476bb None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:23.040563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf470a9-15e9-4301-bcb7-e4fe2a3476bb None admin] PATH_INFO: `/v3/projects/660126a36fe74ee0b2c60ecb51c62269` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:23.042219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf470a9-15e9-4301-bcb7-e4fe2a3476bb None admin] RBAC: Authorizing `identity:get_project(project_id=660126a36fe74ee0b2c60ecb51c62269)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:23.044131 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf470a9-15e9-4301-bcb7-e4fe2a3476bb None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:23.046714 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 122/246] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:22 2022] GET /identity/v3/projects/660126a36fe74ee0b2c60ecb51c62269 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:23.063428 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 125/247] 10.222.0.62 () {60 vars in 1132 bytes} [Tue Oct 4 14:14:22 2022] POST /identity/v3/users => generated 293 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:14:23.065030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf470a9-15e9-4301-bcb7-e4fe2a3476bb None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:23.116672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d451fc8-a850-4b42-b8ad-50da11e1f5e8 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:23.117818 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d451fc8-a850-4b42-b8ad-50da11e1f5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:23.118801 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d451fc8-a850-4b42-b8ad-50da11e1f5e8 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:23.122986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 126/248] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:23 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:23.130280 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9331611-3fbd-46c3-9945-deda33f3f17e None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:23.131293 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9331611-3fbd-46c3-9945-deda33f3f17e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:23.132257 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9331611-3fbd-46c3-9945-deda33f3f17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:23.169394 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-b9331611-3fbd-46c3-9945-deda33f3f17e None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:23.172417 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b9331611-3fbd-46c3-9945-deda33f3f17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:23.217240 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf470a9-15e9-4301-bcb7-e4fe2a3476bb None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:23.241662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:23.265383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e79f4-8d01-4b3d-a442-4ad4b93c3045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:23.266044 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e79f4-8d01-4b3d-a442-4ad4b93c3045 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:23.266327 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e79f4-8d01-4b3d-a442-4ad4b93c3045 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:23.266593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e79f4-8d01-4b3d-a442-4ad4b93c3045 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:23.268056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e79f4-8d01-4b3d-a442-4ad4b93c3045 None admin] RBAC: Adding query filter params (role.id=d1857bfa9b524282b38b5bf1160e2473, scope.project.id=660126a36fe74ee0b2c60ecb51c62269, user.id=31e2ee7593624e6abf462be463496e91) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:23.268516 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e79f4-8d01-4b3d-a442-4ad4b93c3045 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:23.270169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e79f4-8d01-4b3d-a442-4ad4b93c3045 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:23.277231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 123/249] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:14:23 2022] GET /identity/v3/role_assignments?user.id=31e2ee7593624e6abf462be463496e91&scope.project.id=660126a36fe74ee0b2c60ecb51c62269&role.id=d1857bfa9b524282b38b5bf1160e2473 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:14:23.360152 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:23.382208 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e79f4-8d01-4b3d-a442-4ad4b93c3045 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:23.388281 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 127/250] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:23.568466 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e79f4-8d01-4b3d-a442-4ad4b93c3045 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:23.629515 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406208e-d2bd-43c4-a976-be69d93257e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:23.631061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406208e-d2bd-43c4-a976-be69d93257e1 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:23.631924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406208e-d2bd-43c4-a976-be69d93257e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:23.632794 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406208e-d2bd-43c4-a976-be69d93257e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:23.656634 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406208e-d2bd-43c4-a976-be69d93257e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:23.669081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-8406208e-d2bd-43c4-a976-be69d93257e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:23.669081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:23.669081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:23.669081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:23.669081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:23.669081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:23.669081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:23.669081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:23.669081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:23.669081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:23.669081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:23.669081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:23.669081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:23.669081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:23.669081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:23.669081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:23.670871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:23.670871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:23.670871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:23.670871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:23.670871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:23.670871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:23.670871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:23.670871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:23.670871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:23.670871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:23.670871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:23.670871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:23.670871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:23.670871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:23.670871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:23.670871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:23.672419 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:23.672419 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:23.672419 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:23.672419 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:23.672419 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:23.672419 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:23.672419 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:23.672419 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:23.672419 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:23.672419 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:23.672419 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:23.672419 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:14:23.677629 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 124/251] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:23.686803 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9331611-3fbd-46c3-9945-deda33f3f17e None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:23.875752 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9331611-3fbd-46c3-9945-deda33f3f17e None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:23.926179 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae67bc5-ab04-48a6-9f8d-6bbe96f2f61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:23.926721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae67bc5-ab04-48a6-9f8d-6bbe96f2f61d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:23.926999 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae67bc5-ab04-48a6-9f8d-6bbe96f2f61d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:23.927269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae67bc5-ab04-48a6-9f8d-6bbe96f2f61d None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:23.927999 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae67bc5-ab04-48a6-9f8d-6bbe96f2f61d None admin] RBAC: Adding query filter params (name=member) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:23.928298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae67bc5-ab04-48a6-9f8d-6bbe96f2f61d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:23.929724 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae67bc5-ab04-48a6-9f8d-6bbe96f2f61d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:23.943973 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 128/252] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:14:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:14:23.951600 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406208e-d2bd-43c4-a976-be69d93257e1 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:23.966993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae67bc5-ab04-48a6-9f8d-6bbe96f2f61d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:24.044180 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:24.055752 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:24.110490 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae67bc5-ab04-48a6-9f8d-6bbe96f2f61d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:24.160344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406208e-d2bd-43c4-a976-be69d93257e1 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:24.162826 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719c6ee-6a4a-4729-90e7-fd1a0c43e861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:24.164187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719c6ee-6a4a-4729-90e7-fd1a0c43e861 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:24.165702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719c6ee-6a4a-4729-90e7-fd1a0c43e861 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:24.166139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719c6ee-6a4a-4729-90e7-fd1a0c43e861 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:24.182477 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719c6ee-6a4a-4729-90e7-fd1a0c43e861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:24.192149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-0719c6ee-6a4a-4729-90e7-fd1a0c43e861 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:14:24.192149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:24.192149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:24.192149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:24.192149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:24.192149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:24.192149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:24.192149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:24.192149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:24.192149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:24.192149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:24.192149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:24.192149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:24.192149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:24.192149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:24.192149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:24.193300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:24.193300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:24.193300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:24.193300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:24.193300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:24.193300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:24.193300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:24.193300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:24.193300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:24.193300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:24.193300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:24.193300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:24.193300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:24.193300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:24.193300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:24.193300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:24.194301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:24.194301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:24.194301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:24.194301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:24.194301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:24.194301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:24.194301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:24.194301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:24.194301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:24.194301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:24.194301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:14:24.194301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:14:24.197323 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 129/253] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Oct 4 14:14:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:24.203741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719c6ee-6a4a-4729-90e7-fd1a0c43e861 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:24.211131 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8914dc-715f-4e17-8595-1be94ce82d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:24.211806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8914dc-715f-4e17-8595-1be94ce82d7f None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:24.212186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8914dc-715f-4e17-8595-1be94ce82d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:24.212551 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8914dc-715f-4e17-8595-1be94ce82d7f None admin] PATH_INFO: `/v3/users/d8b41367ae0f4a21808f1d2a4b14e2b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:24.213894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8914dc-715f-4e17-8595-1be94ce82d7f None admin] RBAC: Authorizing `identity:get_user(user_id=d8b41367ae0f4a21808f1d2a4b14e2b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:24.215489 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8914dc-715f-4e17-8595-1be94ce82d7f None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:24.217712 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 125/254] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:23 2022] GET /identity/v3/users/d8b41367ae0f4a21808f1d2a4b14e2b1 => generated 297 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:24.226101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8914dc-715f-4e17-8595-1be94ce82d7f None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:24.336101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719c6ee-6a4a-4729-90e7-fd1a0c43e861 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:24.356466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:24.387340 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89683306-935c-4920-bb07-85ab7229b5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:24.388294 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89683306-935c-4920-bb07-85ab7229b5ea None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:24.388755 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89683306-935c-4920-bb07-85ab7229b5ea None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:24.389168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89683306-935c-4920-bb07-85ab7229b5ea None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:24.390030 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89683306-935c-4920-bb07-85ab7229b5ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:24.390500 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89683306-935c-4920-bb07-85ab7229b5ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:24.392168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89683306-935c-4920-bb07-85ab7229b5ea None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:24.403130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 130/255] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:14:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:14:24.406426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8914dc-715f-4e17-8595-1be94ce82d7f None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:24.411369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89683306-935c-4920-bb07-85ab7229b5ea None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:24.427386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:24.482257 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b33c7d-e078-4b86-b3be-d2e05ae0cee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:24.483596 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b33c7d-e078-4b86-b3be-d2e05ae0cee0 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:24.484224 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b33c7d-e078-4b86-b3be-d2e05ae0cee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:24.484828 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b33c7d-e078-4b86-b3be-d2e05ae0cee0 None admin] PATH_INFO: `/v3/projects/660126a36fe74ee0b2c60ecb51c62269` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:24.487451 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b33c7d-e078-4b86-b3be-d2e05ae0cee0 None admin] RBAC: Authorizing `identity:get_project(project_id=660126a36fe74ee0b2c60ecb51c62269)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:24.490278 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b33c7d-e078-4b86-b3be-d2e05ae0cee0 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:24.494131 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 126/256] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:24 2022] GET /identity/v3/projects/660126a36fe74ee0b2c60ecb51c62269 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:14:24.503219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b33c7d-e078-4b86-b3be-d2e05ae0cee0 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:24.545608 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89683306-935c-4920-bb07-85ab7229b5ea None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:24.591340 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5c617-3658-42d8-95f3-d579cea69807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:24.592315 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5c617-3658-42d8-95f3-d579cea69807 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:24.592737 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5c617-3658-42d8-95f3-d579cea69807 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:24.593160 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5c617-3658-42d8-95f3-d579cea69807 None admin] PATH_INFO: `/v3/users/6704cb4f961045458060802ff3e3b3b2` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:24.594582 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5c617-3658-42d8-95f3-d579cea69807 None admin] RBAC: Authorizing `identity:get_user(user_id=6704cb4f961045458060802ff3e3b3b2)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:24.597103 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5c617-3658-42d8-95f3-d579cea69807 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:24.599650 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 131/257] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:24 2022] GET /identity/v3/users/6704cb4f961045458060802ff3e3b3b2 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:24.605932 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5c617-3658-42d8-95f3-d579cea69807 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:24.667059 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:24.737886 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5c617-3658-42d8-95f3-d579cea69807 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:24.780341 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41630acd-899d-47f6-bff1-d395e1320506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:24.781326 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41630acd-899d-47f6-bff1-d395e1320506 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:24.781793 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41630acd-899d-47f6-bff1-d395e1320506 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:24.782315 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41630acd-899d-47f6-bff1-d395e1320506 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:24.827341 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b33c7d-e078-4b86-b3be-d2e05ae0cee0 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:24.868992 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41630acd-899d-47f6-bff1-d395e1320506 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:24.870850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41630acd-899d-47f6-bff1-d395e1320506 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:24.894707 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a7a03-93f9-403b-89ac-12cd7c93d15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:24.896012 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a7a03-93f9-403b-89ac-12cd7c93d15c None admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:24.896592 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a7a03-93f9-403b-89ac-12cd7c93d15c None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:24.897127 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a7a03-93f9-403b-89ac-12cd7c93d15c None admin] PATH_INFO: `/v3/projects/660126a36fe74ee0b2c60ecb51c62269/users/d8b41367ae0f4a21808f1d2a4b14e2b1/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:24.900868 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a7a03-93f9-403b-89ac-12cd7c93d15c None admin] RBAC: Authorizing `identity:create_grant(project_id=660126a36fe74ee0b2c60ecb51c62269, user_id=d8b41367ae0f4a21808f1d2a4b14e2b1, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:24.903739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a7a03-93f9-403b-89ac-12cd7c93d15c None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:24.933377 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 127/258] 10.222.0.62 () {58 vars in 1439 bytes} [Tue Oct 4 14:14:24 2022] PUT /identity/v3/projects/660126a36fe74ee0b2c60ecb51c62269/users/d8b41367ae0f4a21808f1d2a4b14e2b1/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:14:24.936145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92aa1a-c7f2-4612-8ce9-9b0b03635108 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:24.936854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92aa1a-c7f2-4612-8ce9-9b0b03635108 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:24.937458 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92aa1a-c7f2-4612-8ce9-9b0b03635108 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:24.947553 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 128/259] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:24.954382 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077e71f-e23e-43ac-a43e-2048443d8373 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:24.955908 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077e71f-e23e-43ac-a43e-2048443d8373 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:24.956498 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077e71f-e23e-43ac-a43e-2048443d8373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:24.958831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:25.000022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-3077e71f-e23e-43ac-a43e-2048443d8373 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:25.003577 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-3077e71f-e23e-43ac-a43e-2048443d8373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:25.081535 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:25.123538 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 132/260] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:14:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:14:25.133317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41630acd-899d-47f6-bff1-d395e1320506 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:25.191751 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 129/261] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:25.350682 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41630acd-899d-47f6-bff1-d395e1320506 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:25.428865 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2478f43-23d7-40ed-abac-114d94fb658a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:25.430292 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2478f43-23d7-40ed-abac-114d94fb658a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:25.430995 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2478f43-23d7-40ed-abac-114d94fb658a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:25.431687 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2478f43-23d7-40ed-abac-114d94fb658a None admin] PATH_INFO: `/v3/projects/660126a36fe74ee0b2c60ecb51c62269` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:25.437099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2478f43-23d7-40ed-abac-114d94fb658a None admin] RBAC: Authorizing `identity:get_project(project_id=660126a36fe74ee0b2c60ecb51c62269)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:25.441078 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2478f43-23d7-40ed-abac-114d94fb658a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:25.444583 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 133/262] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:25 2022] GET /identity/v3/projects/660126a36fe74ee0b2c60ecb51c62269 => generated 302 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:25.451138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077e71f-e23e-43ac-a43e-2048443d8373 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:25.654779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077e71f-e23e-43ac-a43e-2048443d8373 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:25.708790 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84a180-79fb-4d6d-a3c0-3c6f35619ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:25.709416 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84a180-79fb-4d6d-a3c0-3c6f35619ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:25.709692 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84a180-79fb-4d6d-a3c0-3c6f35619ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:25.709974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84a180-79fb-4d6d-a3c0-3c6f35619ac3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:25.710709 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84a180-79fb-4d6d-a3c0-3c6f35619ac3 None admin] RBAC: Adding query filter params (role.id=c3d8f302f6714108ac91c25b8a32d36b, scope.project.id=660126a36fe74ee0b2c60ecb51c62269, user.id=6704cb4f961045458060802ff3e3b3b2) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:25.711014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84a180-79fb-4d6d-a3c0-3c6f35619ac3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:25.712530 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84a180-79fb-4d6d-a3c0-3c6f35619ac3 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:25.725163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 130/263] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:14:25 2022] GET /identity/v3/role_assignments?user.id=6704cb4f961045458060802ff3e3b3b2&scope.project.id=660126a36fe74ee0b2c60ecb51c62269&role.id=c3d8f302f6714108ac91c25b8a32d36b => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:25.909564 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2478f43-23d7-40ed-abac-114d94fb658a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:25.941998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:26.156643 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2478f43-23d7-40ed-abac-114d94fb658a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:26.232886 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ba5ba-2a50-43d6-8df7-5497bcf77377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:26.233967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ba5ba-2a50-43d6-8df7-5497bcf77377 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:26.234445 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ba5ba-2a50-43d6-8df7-5497bcf77377 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:26.234907 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ba5ba-2a50-43d6-8df7-5497bcf77377 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:26.258018 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ba5ba-2a50-43d6-8df7-5497bcf77377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:26.263213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-c12ba5ba-2a50-43d6-8df7-5497bcf77377 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:14:26.263213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:26.263213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:26.263213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:26.263213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:26.263213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:26.263213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:26.263213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:26.263213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:26.263213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:26.263213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:26.263213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:26.263213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:26.263213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:26.263213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:26.263213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:26.264217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:26.264217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:26.264217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:26.264217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:26.264217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:26.264217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:26.264217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:26.264217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:26.264217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:26.264217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:26.264217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:26.264217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:26.264217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:26.264217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:26.264217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:26.264217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:26.264979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:26.264979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:26.264979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:26.264979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:26.264979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:26.264979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:26.264979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:26.264979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:26.264979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:26.264979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:26.264979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:14:26.264979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:14:26.268524 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 134/264] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:14:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:26.277434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84a180-79fb-4d6d-a3c0-3c6f35619ac3 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:26.335908 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:26.450110 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84a180-79fb-4d6d-a3c0-3c6f35619ac3 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:26.504174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eae45e-2d11-4b18-ad2a-d924f3c89d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:26.505063 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eae45e-2d11-4b18-ad2a-d924f3c89d4a None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:26.505063 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eae45e-2d11-4b18-ad2a-d924f3c89d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:26.505324 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eae45e-2d11-4b18-ad2a-d924f3c89d4a None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:26.506016 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eae45e-2d11-4b18-ad2a-d924f3c89d4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:26.506314 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eae45e-2d11-4b18-ad2a-d924f3c89d4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:26.507925 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eae45e-2d11-4b18-ad2a-d924f3c89d4a None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:26.520491 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 131/265] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:26.536725 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ba5ba-2a50-43d6-8df7-5497bcf77377 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:26.662172 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:26.705584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ba5ba-2a50-43d6-8df7-5497bcf77377 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:26.750288 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042bc29-5600-4191-a5e8-617f28b08dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:26.750945 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042bc29-5600-4191-a5e8-617f28b08dea None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:26.751219 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042bc29-5600-4191-a5e8-617f28b08dea None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:26.752067 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042bc29-5600-4191-a5e8-617f28b08dea None admin] PATH_INFO: `/v3/users/6704cb4f961045458060802ff3e3b3b2` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:26.754026 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042bc29-5600-4191-a5e8-617f28b08dea None admin] RBAC: Authorizing `identity:get_user(user_id=6704cb4f961045458060802ff3e3b3b2)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:26.756164 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042bc29-5600-4191-a5e8-617f28b08dea None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:26.757777 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 135/266] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:26 2022] GET /identity/v3/users/6704cb4f961045458060802ff3e3b3b2 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:26.773986 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eae45e-2d11-4b18-ad2a-d924f3c89d4a None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:26.917283 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:26.930746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eae45e-2d11-4b18-ad2a-d924f3c89d4a None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:26.984527 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f31ce0-5542-4d75-ad9e-a390be1d92b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:26.985158 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f31ce0-5542-4d75-ad9e-a390be1d92b2 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:26.985434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f31ce0-5542-4d75-ad9e-a390be1d92b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:26.985759 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f31ce0-5542-4d75-ad9e-a390be1d92b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:27.088027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f31ce0-5542-4d75-ad9e-a390be1d92b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:27.089443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f31ce0-5542-4d75-ad9e-a390be1d92b2 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:27.232171 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:27.247925 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 132/267] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:14:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 14:14:27.252299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042bc29-5600-4191-a5e8-617f28b08dea None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:27.455760 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834787a-e0e6-480c-8a35-1a01312da652 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:27.456251 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834787a-e0e6-480c-8a35-1a01312da652 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:27.456251 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834787a-e0e6-480c-8a35-1a01312da652 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:27.457973 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 133/268] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:27.464512 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722bdb0-ca6c-45c9-8c29-838697c11bf3 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:27.464812 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722bdb0-ca6c-45c9-8c29-838697c11bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:27.465060 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722bdb0-ca6c-45c9-8c29-838697c11bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:27.495278 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042bc29-5600-4191-a5e8-617f28b08dea None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:27.501837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-4722bdb0-ca6c-45c9-8c29-838697c11bf3 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:27.503053 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-4722bdb0-ca6c-45c9-8c29-838697c11bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:27.587887 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbddcf1-5e71-4922-a7a4-e8a70c2ab290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:27.588985 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbddcf1-5e71-4922-a7a4-e8a70c2ab290 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:27.589713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbddcf1-5e71-4922-a7a4-e8a70c2ab290 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:27.590173 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbddcf1-5e71-4922-a7a4-e8a70c2ab290 None admin] PATH_INFO: `/v3/projects/660126a36fe74ee0b2c60ecb51c62269` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:27.592472 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbddcf1-5e71-4922-a7a4-e8a70c2ab290 None admin] RBAC: Authorizing `identity:get_project(project_id=660126a36fe74ee0b2c60ecb51c62269)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:27.595814 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbddcf1-5e71-4922-a7a4-e8a70c2ab290 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:27.599531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 136/269] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:27 2022] GET /identity/v3/projects/660126a36fe74ee0b2c60ecb51c62269 => generated 302 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:27.610486 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbddcf1-5e71-4922-a7a4-e8a70c2ab290 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:27.638103 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:27.762772 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 134/270] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:27.861632 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbddcf1-5e71-4922-a7a4-e8a70c2ab290 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:27.940838 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6239ad-3a7d-4dbb-967e-2725ce3cca52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:27.941967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6239ad-3a7d-4dbb-967e-2725ce3cca52 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:27.942450 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6239ad-3a7d-4dbb-967e-2725ce3cca52 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:27.942934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6239ad-3a7d-4dbb-967e-2725ce3cca52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:27.944476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6239ad-3a7d-4dbb-967e-2725ce3cca52 None admin] RBAC: Adding query filter params (role.id=a16b6daeda5b4a67992f3c12514ca90e, scope.project.id=660126a36fe74ee0b2c60ecb51c62269, user.id=6704cb4f961045458060802ff3e3b3b2) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:27.945040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6239ad-3a7d-4dbb-967e-2725ce3cca52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:27.948067 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6239ad-3a7d-4dbb-967e-2725ce3cca52 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:27.959810 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 137/271] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:14:27 2022] GET /identity/v3/role_assignments?user.id=6704cb4f961045458060802ff3e3b3b2&scope.project.id=660126a36fe74ee0b2c60ecb51c62269&role.id=a16b6daeda5b4a67992f3c12514ca90e => generated 608 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:28.171338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20d8d9-eb23-4e5e-992b-8e6f5349493f None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:28.171513 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20d8d9-eb23-4e5e-992b-8e6f5349493f None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:28.171821 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20d8d9-eb23-4e5e-992b-8e6f5349493f None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:28.173973 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 135/272] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:28.183206 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3b521-10f4-4560-8087-091872954ba5 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:28.183615 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3b521-10f4-4560-8087-091872954ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:28.184038 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3b521-10f4-4560-8087-091872954ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:28.217595 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20d8d9-eb23-4e5e-992b-8e6f5349493f None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:28.221923 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ead3b521-10f4-4560-8087-091872954ba5 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:28.224135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ead3b521-10f4-4560-8087-091872954ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:28.332921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 138/273] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:28.378322 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20d8d9-eb23-4e5e-992b-8e6f5349493f None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:28.409037 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:28.428603 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5d2ab-f68c-4239-a6b0-19fafc7569e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:28.429630 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5d2ab-f68c-4239-a6b0-19fafc7569e7 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:28.430119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5d2ab-f68c-4239-a6b0-19fafc7569e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:28.430607 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5d2ab-f68c-4239-a6b0-19fafc7569e7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:28.463679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5d2ab-f68c-4239-a6b0-19fafc7569e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:28.478561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-5db5d2ab-f68c-4239-a6b0-19fafc7569e7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 14:14:28.478561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:28.478561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:28.478561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:28.478561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:28.478561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:28.478561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:28.478561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:28.478561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:28.478561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:28.478561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:28.478561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:28.478561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:28.478561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:28.478561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:28.478561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:28.479538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:28.479538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:28.479538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:28.479538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:28.479538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:28.479538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:28.479538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:28.479538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:28.479538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:28.479538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:28.479538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:28.479538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:28.479538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:28.479538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:28.479538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:28.479538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:28.480386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:28.480386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:28.480386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:28.480386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:28.480386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:28.480386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:28.480386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:28.480386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:28.480386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:28.480386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:28.480386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 14:14:28.480386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:14:28.481504 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 136/274] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:14:28.487349 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3b521-10f4-4560-8087-091872954ba5 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:28.490134 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:28.583515 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626b084-fc93-48a2-8d31-86d051fd1d7f None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:28.584019 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626b084-fc93-48a2-8d31-86d051fd1d7f None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:28.584508 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626b084-fc93-48a2-8d31-86d051fd1d7f None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:28.591906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 137/275] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:28.597896 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68af90-052d-49c5-868c-1398983cd5ed None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:28.598452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68af90-052d-49c5-868c-1398983cd5ed None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:28.598923 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68af90-052d-49c5-868c-1398983cd5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:28.631981 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-cc68af90-052d-49c5-868c-1398983cd5ed None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:28.633210 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-cc68af90-052d-49c5-868c-1398983cd5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:28.637854 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3b521-10f4-4560-8087-091872954ba5 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:28.709436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4291e-e0ba-40fd-aee4-6ae297aff6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:28.710318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4291e-e0ba-40fd-aee4-6ae297aff6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:28.710802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4291e-e0ba-40fd-aee4-6ae297aff6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:28.711288 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4291e-e0ba-40fd-aee4-6ae297aff6b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:28.712550 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4291e-e0ba-40fd-aee4-6ae297aff6b3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:28.713050 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4291e-e0ba-40fd-aee4-6ae297aff6b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:28.716273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4291e-e0ba-40fd-aee4-6ae297aff6b3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:28.730406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 138/276] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 14:14:28.731511 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c7672-60a7-47d5-974f-64546f5f7be7 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:28.731819 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c7672-60a7-47d5-974f-64546f5f7be7 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:28.732090 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c7672-60a7-47d5-974f-64546f5f7be7 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:28.733382 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 139/277] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:28.745640 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 139/278] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:14:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:28.745843 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412baffb-6f21-44e8-a74f-38e6ede51a65 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:28.745843 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412baffb-6f21-44e8-a74f-38e6ede51a65 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:28.745843 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412baffb-6f21-44e8-a74f-38e6ede51a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:28.747735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4291e-e0ba-40fd-aee4-6ae297aff6b3 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:28.767762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-412baffb-6f21-44e8-a74f-38e6ede51a65 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:28.769161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-412baffb-6f21-44e8-a74f-38e6ede51a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:28.864460 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:28.867501 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 140/279] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:28.869149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412baffb-6f21-44e8-a74f-38e6ede51a65 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:28.913502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4291e-e0ba-40fd-aee4-6ae297aff6b3 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:28.930535 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:28.954041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85be46c-7227-4733-9c2a-f028baaa8413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:28.955736 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85be46c-7227-4733-9c2a-f028baaa8413 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:28.956023 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85be46c-7227-4733-9c2a-f028baaa8413 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:28.956295 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85be46c-7227-4733-9c2a-f028baaa8413 None admin] PATH_INFO: `/v3/users/31e2ee7593624e6abf462be463496e91` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:28.957565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85be46c-7227-4733-9c2a-f028baaa8413 None admin] RBAC: Authorizing `identity:get_user(user_id=31e2ee7593624e6abf462be463496e91)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:28.959229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85be46c-7227-4733-9c2a-f028baaa8413 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:28.966229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 140/280] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:28 2022] GET /identity/v3/users/31e2ee7593624e6abf462be463496e91 => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:14:28.967385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85be46c-7227-4733-9c2a-f028baaa8413 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:29.028175 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412baffb-6f21-44e8-a74f-38e6ede51a65 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:29.083323 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414a5dd-72af-49a2-9d2a-029e2cb5a7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:29.084666 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414a5dd-72af-49a2-9d2a-029e2cb5a7da None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:29.085409 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414a5dd-72af-49a2-9d2a-029e2cb5a7da None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:29.085879 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414a5dd-72af-49a2-9d2a-029e2cb5a7da None admin] PATH_INFO: `/v3/roles/member` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:29.089253 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85be46c-7227-4733-9c2a-f028baaa8413 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:29.101279 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414a5dd-72af-49a2-9d2a-029e2cb5a7da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:29.109048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-b414a5dd-72af-49a2-9d2a-029e2cb5a7da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:29.109048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:29.109048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:29.109048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:29.109048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:29.109048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:29.109048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:29.109048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:29.109048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:29.109048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:29.109048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:29.109048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:29.109048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:29.109048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:29.109048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:29.109048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:29.110014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:29.110014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:29.110014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:29.110014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:29.110014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:29.110014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:29.110014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:29.110014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:29.110014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:29.110014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:29.110014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:29.110014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:29.110014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:29.110014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:29.110014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:29.110014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:29.111390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:29.111390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:29.111390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:29.111390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:29.111390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:29.111390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:29.111390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:29.111390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:29.111390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:29.111390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:29.111390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:29.111390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:14:29.118095 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 141/281] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:29.120770 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414a5dd-72af-49a2-9d2a-029e2cb5a7da None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:29.134182 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:29.140682 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fd317-4d21-4ebb-b3b9-5e2c84a715c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:29.141343 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fd317-4d21-4ebb-b3b9-5e2c84a715c4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:29.142645 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fd317-4d21-4ebb-b3b9-5e2c84a715c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:29.142937 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fd317-4d21-4ebb-b3b9-5e2c84a715c4 None admin] PATH_INFO: `/v3/projects/660126a36fe74ee0b2c60ecb51c62269` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:29.144323 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fd317-4d21-4ebb-b3b9-5e2c84a715c4 None admin] RBAC: Authorizing `identity:get_project(project_id=660126a36fe74ee0b2c60ecb51c62269)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:29.146542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fd317-4d21-4ebb-b3b9-5e2c84a715c4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:29.153095 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 141/282] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:28 2022] GET /identity/v3/projects/660126a36fe74ee0b2c60ecb51c62269 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:14:29.153095 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fd317-4d21-4ebb-b3b9-5e2c84a715c4 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:29.265848 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414a5dd-72af-49a2-9d2a-029e2cb5a7da None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:29.268591 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:29.310054 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56daa346-938e-456d-9124-d1938b67226d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:29.310851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daa346-938e-456d-9124-d1938b67226d None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:29.311117 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daa346-938e-456d-9124-d1938b67226d None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:29.311436 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daa346-938e-456d-9124-d1938b67226d None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:29.312168 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56daa346-938e-456d-9124-d1938b67226d None admin] RBAC: Adding query filter params (name=member) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:29.312471 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56daa346-938e-456d-9124-d1938b67226d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:29.314857 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56daa346-938e-456d-9124-d1938b67226d None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:29.317589 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fd317-4d21-4ebb-b3b9-5e2c84a715c4 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:29.326408 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 142/283] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:14:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:29.331474 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56daa346-938e-456d-9124-d1938b67226d None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:29.361908 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71b1dd-4d44-4638-ac7f-67097836d1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:29.362570 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71b1dd-4d44-4638-ac7f-67097836d1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:29.362839 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71b1dd-4d44-4638-ac7f-67097836d1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:29.363094 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71b1dd-4d44-4638-ac7f-67097836d1b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:29.364309 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf71b1dd-4d44-4638-ac7f-67097836d1b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:29.365766 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf71b1dd-4d44-4638-ac7f-67097836d1b8 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:29.367768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 142/284] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:14:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:29.368608 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71b1dd-4d44-4638-ac7f-67097836d1b8 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:29.457874 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:29.481184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56daa346-938e-456d-9124-d1938b67226d None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:29.506795 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71b1dd-4d44-4638-ac7f-67097836d1b8 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:29.543639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857662d-9542-4b96-90a3-7cda4dc16460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:29.544579 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857662d-9542-4b96-90a3-7cda4dc16460 None admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:29.545041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857662d-9542-4b96-90a3-7cda4dc16460 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:29.545369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857662d-9542-4b96-90a3-7cda4dc16460 None admin] PATH_INFO: `/v3/projects/660126a36fe74ee0b2c60ecb51c62269/users/31e2ee7593624e6abf462be463496e91/roles/d1857bfa9b524282b38b5bf1160e2473` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:29.546789 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b728a81-a59e-4616-9a3e-51d601d3a298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:29.547437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b728a81-a59e-4616-9a3e-51d601d3a298 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:29.547751 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b728a81-a59e-4616-9a3e-51d601d3a298 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:29.548011 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b728a81-a59e-4616-9a3e-51d601d3a298 None admin] PATH_INFO: `/v3/users/3a6b8342b07941b2bd3c899e7ba86132` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:29.548638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857662d-9542-4b96-90a3-7cda4dc16460 None admin] RBAC: Authorizing `identity:create_grant(project_id=660126a36fe74ee0b2c60ecb51c62269, user_id=31e2ee7593624e6abf462be463496e91, role_id=d1857bfa9b524282b38b5bf1160e2473)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:29.550203 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857662d-9542-4b96-90a3-7cda4dc16460 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:29.567038 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 143/285] 10.222.0.62 () {58 vars in 1439 bytes} [Tue Oct 4 14:14:29 2022] PUT /identity/v3/projects/660126a36fe74ee0b2c60ecb51c62269/users/31e2ee7593624e6abf462be463496e91/roles/d1857bfa9b524282b38b5bf1160e2473 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:14:29.575330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b728a81-a59e-4616-9a3e-51d601d3a298 None admin] RBAC: Authorizing `identity:get_user(user_id=3a6b8342b07941b2bd3c899e7ba86132)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:29.575498 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857662d-9542-4b96-90a3-7cda4dc16460 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:29.575658 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b728a81-a59e-4616-9a3e-51d601d3a298 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:29.575658 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 143/286] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:29 2022] GET /identity/v3/users/3a6b8342b07941b2bd3c899e7ba86132 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:29.575658 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b728a81-a59e-4616-9a3e-51d601d3a298 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:29.643309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:29.758024 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b728a81-a59e-4616-9a3e-51d601d3a298 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:29.800024 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857662d-9542-4b96-90a3-7cda4dc16460 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:29.815271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:29.826472 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc502daa-6d39-4ffb-8bb7-f88f4a48af44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:29.827125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc502daa-6d39-4ffb-8bb7-f88f4a48af44 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:29.827400 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc502daa-6d39-4ffb-8bb7-f88f4a48af44 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:29.827675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc502daa-6d39-4ffb-8bb7-f88f4a48af44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:29.842174 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc502daa-6d39-4ffb-8bb7-f88f4a48af44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:29.846682 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b4521-cc35-4723-9684-e3d671719893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:29.847476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-bc502daa-6d39-4ffb-8bb7-f88f4a48af44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:29.847476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:29.847476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:29.847476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:29.847476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:29.847476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:29.847476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:29.847476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:29.847476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:29.847476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:29.847476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:29.847476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:29.847476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:29.847476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:29.847476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:29.847476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:29.849130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:29.849130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:29.849130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:29.849130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:29.849130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:29.849130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:29.849130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:29.849130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:29.849130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:29.849130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:29.849130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:29.849130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:29.849130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:29.849130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:29.849130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:29.849130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:29.850573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:29.850573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:29.850573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:29.850573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:29.850573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:29.850573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:29.850573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:29.850573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:29.850573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:29.850573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:29.850573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:29.850573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:14:29.851654 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b4521-cc35-4723-9684-e3d671719893 None admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:29.851654 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b4521-cc35-4723-9684-e3d671719893 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:29.851654 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b4521-cc35-4723-9684-e3d671719893 None admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:29.852740 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 144/287] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:29.852740 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc502daa-6d39-4ffb-8bb7-f88f4a48af44 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:29.853155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b4521-cc35-4723-9684-e3d671719893 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:29.858801 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b4521-cc35-4723-9684-e3d671719893 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:29.906598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 144/288] 10.222.0.62 () {60 vars in 1132 bytes} [Tue Oct 4 14:14:29 2022] POST /identity/v3/users => generated 293 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:14:29.908964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b4521-cc35-4723-9684-e3d671719893 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:30.090550 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc502daa-6d39-4ffb-8bb7-f88f4a48af44 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:30.131519 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:30.164211 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b4521-cc35-4723-9684-e3d671719893 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:30.177797 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544afed5-42c9-4b9e-8851-2b1be2246a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:30.178698 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544afed5-42c9-4b9e-8851-2b1be2246a4a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:30.179165 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544afed5-42c9-4b9e-8851-2b1be2246a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:30.179582 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544afed5-42c9-4b9e-8851-2b1be2246a4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:30.181961 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544afed5-42c9-4b9e-8851-2b1be2246a4a None admin] RBAC: Adding query filter params (role.id=eb2435bb443d4469899fb3830f4ee5b1, user.id=3a6b8342b07941b2bd3c899e7ba86132, scope.system=all) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:30.181961 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544afed5-42c9-4b9e-8851-2b1be2246a4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:30.184680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544afed5-42c9-4b9e-8851-2b1be2246a4a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:30.191942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 145/289] 10.222.0.62 () {56 vars in 1308 bytes} [Tue Oct 4 14:14:29 2022] GET /identity/v3/role_assignments?user.id=3a6b8342b07941b2bd3c899e7ba86132&scope.system=all&role.id=eb2435bb443d4469899fb3830f4ee5b1 => generated 226 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:30.224390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a85f8-b143-4e03-921e-bd7b49341586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:30.225537 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a85f8-b143-4e03-921e-bd7b49341586 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:30.226026 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a85f8-b143-4e03-921e-bd7b49341586 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:30.226507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a85f8-b143-4e03-921e-bd7b49341586 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:30.227847 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a85f8-b143-4e03-921e-bd7b49341586 None admin] RBAC: Adding query filter params (name=member) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:30.228335 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a85f8-b143-4e03-921e-bd7b49341586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:30.230874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a85f8-b143-4e03-921e-bd7b49341586 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:30.248632 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 145/290] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:14:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:30.255462 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544afed5-42c9-4b9e-8851-2b1be2246a4a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:30.365692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:30.441768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544afed5-42c9-4b9e-8851-2b1be2246a4a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:30.494635 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a59e5-c1db-47af-9d92-12fde56cee70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:30.495853 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a59e5-c1db-47af-9d92-12fde56cee70 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:30.496364 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a59e5-c1db-47af-9d92-12fde56cee70 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:30.496836 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a59e5-c1db-47af-9d92-12fde56cee70 None admin] PATH_INFO: `/v3/users/d8b41367ae0f4a21808f1d2a4b14e2b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:30.500605 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a59e5-c1db-47af-9d92-12fde56cee70 None admin] RBAC: Authorizing `identity:get_user(user_id=d8b41367ae0f4a21808f1d2a4b14e2b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:30.504051 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a59e5-c1db-47af-9d92-12fde56cee70 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:30.507403 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 146/291] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:30 2022] GET /identity/v3/users/d8b41367ae0f4a21808f1d2a4b14e2b1 => generated 297 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:30.513632 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a85f8-b143-4e03-921e-bd7b49341586 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:30.681595 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a85f8-b143-4e03-921e-bd7b49341586 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:30.752120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3d8bb-c0ae-47f8-8741-370d2e1c14fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:30.753248 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3d8bb-c0ae-47f8-8741-370d2e1c14fd None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:30.753699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3d8bb-c0ae-47f8-8741-370d2e1c14fd None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:30.754117 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3d8bb-c0ae-47f8-8741-370d2e1c14fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:30.769920 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:30.852650 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3d8bb-c0ae-47f8-8741-370d2e1c14fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:30.856160 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3d8bb-c0ae-47f8-8741-370d2e1c14fd None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:30.998931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 146/292] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:14:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:14:31.006447 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a59e5-c1db-47af-9d92-12fde56cee70 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:31.242510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a59e5-c1db-47af-9d92-12fde56cee70 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:31.283497 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:31.316245 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a55a50-cda3-4a40-9211-7d601e596241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:31.317304 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a55a50-cda3-4a40-9211-7d601e596241 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:31.317748 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a55a50-cda3-4a40-9211-7d601e596241 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:31.318194 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a55a50-cda3-4a40-9211-7d601e596241 None admin] PATH_INFO: `/v3/projects/660126a36fe74ee0b2c60ecb51c62269` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:31.320060 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a55a50-cda3-4a40-9211-7d601e596241 None admin] RBAC: Authorizing `identity:get_project(project_id=660126a36fe74ee0b2c60ecb51c62269)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:31.322563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a55a50-cda3-4a40-9211-7d601e596241 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:31.326190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 147/293] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:31 2022] GET /identity/v3/projects/660126a36fe74ee0b2c60ecb51c62269 => generated 302 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:31.334562 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3d8bb-c0ae-47f8-8741-370d2e1c14fd None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:31.473153 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:31.621135 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3d8bb-c0ae-47f8-8741-370d2e1c14fd None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:31.682396 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d01b8-fa15-485a-8091-1de4dac72ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:31.683064 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d01b8-fa15-485a-8091-1de4dac72ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:31.683307 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d01b8-fa15-485a-8091-1de4dac72ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:31.683584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d01b8-fa15-485a-8091-1de4dac72ab1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:31.684354 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d01b8-fa15-485a-8091-1de4dac72ab1 None admin] RBAC: Adding query filter params (role.id=eb2435bb443d4469899fb3830f4ee5b1, scope.project.id=660126a36fe74ee0b2c60ecb51c62269, user.id=d8b41367ae0f4a21808f1d2a4b14e2b1) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:31.684664 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d01b8-fa15-485a-8091-1de4dac72ab1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:31.686158 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d01b8-fa15-485a-8091-1de4dac72ab1 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:31.697943 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 147/294] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:14:31 2022] GET /identity/v3/role_assignments?user.id=d8b41367ae0f4a21808f1d2a4b14e2b1&scope.project.id=660126a36fe74ee0b2c60ecb51c62269&role.id=eb2435bb443d4469899fb3830f4ee5b1 => generated 608 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:32.394768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705de58-75ef-4b15-85d6-bab70c067c0c None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:32.395327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705de58-75ef-4b15-85d6-bab70c067c0c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:32.395327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705de58-75ef-4b15-85d6-bab70c067c0c None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:32.396986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 148/295] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:32.404092 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9feb4-bf84-4424-bdca-c231807c20f7 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:32.405064 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9feb4-bf84-4424-bdca-c231807c20f7 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:32.405558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9feb4-bf84-4424-bdca-c231807c20f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:32.431572 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-abe9feb4-bf84-4424-bdca-c231807c20f7 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:32.432982 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-abe9feb4-bf84-4424-bdca-c231807c20f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:32.542895 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 148/296] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 14:14:33.057949 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705de58-75ef-4b15-85d6-bab70c067c0c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:33.263282 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705de58-75ef-4b15-85d6-bab70c067c0c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:33.306200 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f6150-1967-454a-b231-18e0158f0209 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:33.307084 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f6150-1967-454a-b231-18e0158f0209 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:33.307819 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f6150-1967-454a-b231-18e0158f0209 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:33.310797 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 149/297] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:33.320681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a157936-441d-4f7c-82c0-e9559de17a9a None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:33.321473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a157936-441d-4f7c-82c0-e9559de17a9a None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:33.321984 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a157936-441d-4f7c-82c0-e9559de17a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:33.329826 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5b73e-8b81-4190-aac0-de4cffcdace7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:33.330925 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5b73e-8b81-4190-aac0-de4cffcdace7 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:33.331471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5b73e-8b81-4190-aac0-de4cffcdace7 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:33.331897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5b73e-8b81-4190-aac0-de4cffcdace7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:33.359746 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5b73e-8b81-4190-aac0-de4cffcdace7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:33.360000 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-3a157936-441d-4f7c-82c0-e9559de17a9a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:33.360000 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-3a157936-441d-4f7c-82c0-e9559de17a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:33.365970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-ccd5b73e-8b81-4190-aac0-de4cffcdace7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 14:14:33.365970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:33.365970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:33.365970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:33.365970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:33.365970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:33.365970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:33.365970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:33.365970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:33.365970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:33.365970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:33.365970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:33.365970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:33.365970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:33.365970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:33.365970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:33.367689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:33.367689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:33.367689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:33.367689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:33.367689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:33.367689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:33.367689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:33.367689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:33.367689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:33.367689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:33.367689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:33.367689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:33.367689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:33.367689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:33.367689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:33.367689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:33.369342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:33.369342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:33.369342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:33.369342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:33.369342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:33.369342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:33.369342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:33.369342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:33.369342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:33.369342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:33.369342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 14:14:33.369342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:14:33.375741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 149/298] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:33.385510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5b73e-8b81-4190-aac0-de4cffcdace7 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:33.403823 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:33.472399 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:33.473165 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 150/299] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 14:14:33.593699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5b73e-8b81-4190-aac0-de4cffcdace7 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:33.639819 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757f7c4-32c1-46e7-b2f2-dbc9fcc114f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:33.640842 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757f7c4-32c1-46e7-b2f2-dbc9fcc114f1 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:33.641323 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757f7c4-32c1-46e7-b2f2-dbc9fcc114f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:33.641840 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757f7c4-32c1-46e7-b2f2-dbc9fcc114f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:33.643143 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757f7c4-32c1-46e7-b2f2-dbc9fcc114f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:33.643660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757f7c4-32c1-46e7-b2f2-dbc9fcc114f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:33.645345 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757f7c4-32c1-46e7-b2f2-dbc9fcc114f1 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:33.656437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 150/300] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:14:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:33.666785 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a157936-441d-4f7c-82c0-e9559de17a9a None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:33.698225 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de99eba-1506-4719-8402-9530449ddb59 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:33.698507 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de99eba-1506-4719-8402-9530449ddb59 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:33.698972 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de99eba-1506-4719-8402-9530449ddb59 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:33.701293 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 151/301] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:14:33.707286 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f1d2b-0f94-4556-a207-7f1d0ec39546 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:33.707824 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f1d2b-0f94-4556-a207-7f1d0ec39546 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:33.708235 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f1d2b-0f94-4556-a207-7f1d0ec39546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:33.729801 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-748f1d2b-0f94-4556-a207-7f1d0ec39546 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:33.731037 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-748f1d2b-0f94-4556-a207-7f1d0ec39546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:33.835251 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 152/302] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 14:14:33.842015 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e43935-0b0c-4209-a805-6295a2b71937 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:33.842429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e43935-0b0c-4209-a805-6295a2b71937 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:33.842853 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e43935-0b0c-4209-a805-6295a2b71937 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:33.844705 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 153/303] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:33.845575 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a157936-441d-4f7c-82c0-e9559de17a9a None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:33.851121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e43935-0b0c-4209-a805-6295a2b71937 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:33.917199 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560451b-0764-4075-b315-bf065177645b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:33.921900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560451b-0764-4075-b315-bf065177645b None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:33.922336 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560451b-0764-4075-b315-bf065177645b None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:33.922742 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560451b-0764-4075-b315-bf065177645b None admin] PATH_INFO: `/v3/users/31e2ee7593624e6abf462be463496e91` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:33.924454 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560451b-0764-4075-b315-bf065177645b None admin] RBAC: Authorizing `identity:get_user(user_id=31e2ee7593624e6abf462be463496e91)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:33.926787 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560451b-0764-4075-b315-bf065177645b None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:33.928907 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 151/304] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:33 2022] GET /identity/v3/users/31e2ee7593624e6abf462be463496e91 => generated 297 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:33.932569 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:33.933169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709fcab-1238-492b-ba9c-b3eeca17da5a None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:33.933454 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709fcab-1238-492b-ba9c-b3eeca17da5a None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:33.933722 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709fcab-1238-492b-ba9c-b3eeca17da5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:33.958220 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-f709fcab-1238-492b-ba9c-b3eeca17da5a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:33.960139 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f709fcab-1238-492b-ba9c-b3eeca17da5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:33.998607 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:34.020387 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e43935-0b0c-4209-a805-6295a2b71937 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:34.056944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 152/305] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:34.058148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709fcab-1238-492b-ba9c-b3eeca17da5a None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:34.075807 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf1e3a-e84f-4c63-bd4e-579be2c917dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:34.077462 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf1e3a-e84f-4c63-bd4e-579be2c917dc None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:34.078831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf1e3a-e84f-4c63-bd4e-579be2c917dc None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:34.080683 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf1e3a-e84f-4c63-bd4e-579be2c917dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:34.105732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf1e3a-e84f-4c63-bd4e-579be2c917dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:34.119531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-c2cf1e3a-e84f-4c63-bd4e-579be2c917dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:34.119531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:34.119531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:34.119531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:34.119531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:34.119531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:34.119531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:34.119531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:34.119531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:34.119531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:34.119531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:34.119531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:34.119531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:34.119531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:34.119531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:34.119531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:34.121897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:34.121897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:34.121897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:34.121897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:34.121897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:34.121897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:34.121897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:34.121897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:34.121897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:34.121897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:34.121897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:34.121897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:34.121897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:34.121897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:34.121897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:34.121897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:34.123863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:34.123863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:34.123863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:34.123863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:34.123863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:34.123863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:34.123863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:34.123863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:34.123863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:34.123863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:34.123863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:34.123863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:14:34.135757 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 154/306] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:34.140892 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf1e3a-e84f-4c63-bd4e-579be2c917dc None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:34.277106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709fcab-1238-492b-ba9c-b3eeca17da5a None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:34.342799 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46a919-923b-410e-b5ab-d77ff139b2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:34.344014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46a919-923b-410e-b5ab-d77ff139b2fe None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:34.344521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46a919-923b-410e-b5ab-d77ff139b2fe None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:34.345674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46a919-923b-410e-b5ab-d77ff139b2fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:34.373369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:34.380084 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf1e3a-e84f-4c63-bd4e-579be2c917dc None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:34.389860 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:34.434619 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99656b-6775-4a73-9311-6de07b2d1831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:34.434916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46a919-923b-410e-b5ab-d77ff139b2fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:34.435444 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99656b-6775-4a73-9311-6de07b2d1831 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:34.435858 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99656b-6775-4a73-9311-6de07b2d1831 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:34.436241 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99656b-6775-4a73-9311-6de07b2d1831 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:34.436471 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46a919-923b-410e-b5ab-d77ff139b2fe None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:34.437177 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99656b-6775-4a73-9311-6de07b2d1831 None admin] RBAC: Adding query filter params (name=member) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:34.437595 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99656b-6775-4a73-9311-6de07b2d1831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:34.441392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99656b-6775-4a73-9311-6de07b2d1831 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:34.451103 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 155/307] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:14:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:14:34.452149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99656b-6775-4a73-9311-6de07b2d1831 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:34.572360 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 153/308] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:14:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:14:34.574820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46a919-923b-410e-b5ab-d77ff139b2fe None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:34.636733 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99656b-6775-4a73-9311-6de07b2d1831 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:34.681760 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:34.685782 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78946db0-1f54-4ce4-bcd9-78c4679fbba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:34.686570 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78946db0-1f54-4ce4-bcd9-78c4679fbba4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:34.686984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78946db0-1f54-4ce4-bcd9-78c4679fbba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:34.687395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78946db0-1f54-4ce4-bcd9-78c4679fbba4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:34.689571 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78946db0-1f54-4ce4-bcd9-78c4679fbba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:34.691939 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78946db0-1f54-4ce4-bcd9-78c4679fbba4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:34.695644 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 156/309] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:14:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:34.695915 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78946db0-1f54-4ce4-bcd9-78c4679fbba4 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:34.738084 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46a919-923b-410e-b5ab-d77ff139b2fe None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:34.738364 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:34.783250 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e000821-3a16-4362-a684-8cbe78be5efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:34.784206 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e000821-3a16-4362-a684-8cbe78be5efa None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:34.784490 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e000821-3a16-4362-a684-8cbe78be5efa None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:34.784764 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e000821-3a16-4362-a684-8cbe78be5efa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:34.801815 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e000821-3a16-4362-a684-8cbe78be5efa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:34.812058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-0e000821-3a16-4362-a684-8cbe78be5efa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 14:14:34.812058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:34.812058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:34.812058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:34.812058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:34.812058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:34.812058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:34.812058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:34.812058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:34.812058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:34.812058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:34.812058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:34.812058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:34.812058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:34.812058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:34.812058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:34.814659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:34.814659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:34.814659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:34.814659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:34.814659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:34.814659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:34.814659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:34.814659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:34.814659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:34.814659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:34.814659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:34.814659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:34.814659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:34.814659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:34.814659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:34.814659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:34.817752 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:34.817752 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:34.817752 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:34.817752 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:34.817752 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:34.817752 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:34.817752 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:34.817752 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:34.817752 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:34.817752 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:34.817752 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 14:14:34.817752 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:14:34.817752 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 154/310] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:34.817752 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e000821-3a16-4362-a684-8cbe78be5efa None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:34.846413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78946db0-1f54-4ce4-bcd9-78c4679fbba4 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:34.885722 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1d5c8-c598-4510-944b-841834bb11a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:34.886501 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1d5c8-c598-4510-944b-841834bb11a8 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:34.886906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1d5c8-c598-4510-944b-841834bb11a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:34.887220 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1d5c8-c598-4510-944b-841834bb11a8 None admin] PATH_INFO: `/v3/users/3a6b8342b07941b2bd3c899e7ba86132` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:34.888583 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc1d5c8-c598-4510-944b-841834bb11a8 None admin] RBAC: Authorizing `identity:get_user(user_id=3a6b8342b07941b2bd3c899e7ba86132)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:34.890120 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc1d5c8-c598-4510-944b-841834bb11a8 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:34.892642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 157/311] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:34 2022] GET /identity/v3/users/3a6b8342b07941b2bd3c899e7ba86132 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:34.893882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1d5c8-c598-4510-944b-841834bb11a8 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:34.982014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e000821-3a16-4362-a684-8cbe78be5efa None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:35.029157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:35.030808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:35.041187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1d5c8-c598-4510-944b-841834bb11a8 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:35.054419 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca255bb-5d5f-4258-94ec-18df68467772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:35.055510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca255bb-5d5f-4258-94ec-18df68467772 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:35.056036 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca255bb-5d5f-4258-94ec-18df68467772 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:35.056521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca255bb-5d5f-4258-94ec-18df68467772 None admin] PATH_INFO: `/v3/projects/660126a36fe74ee0b2c60ecb51c62269` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:35.058541 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca255bb-5d5f-4258-94ec-18df68467772 None admin] RBAC: Authorizing `identity:get_project(project_id=660126a36fe74ee0b2c60ecb51c62269)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:35.061734 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca255bb-5d5f-4258-94ec-18df68467772 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:35.071073 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 155/312] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:34 2022] GET /identity/v3/projects/660126a36fe74ee0b2c60ecb51c62269 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:35.071073 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca255bb-5d5f-4258-94ec-18df68467772 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:35.093365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8e776-a8ab-4516-b2d9-15b06888f81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:35.094376 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8e776-a8ab-4516-b2d9-15b06888f81f None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:35.094733 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8e776-a8ab-4516-b2d9-15b06888f81f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:35.095578 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8e776-a8ab-4516-b2d9-15b06888f81f None admin] PATH_INFO: `/v3/groups` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:35.096375 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8e776-a8ab-4516-b2d9-15b06888f81f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:35.097998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8e776-a8ab-4516-b2d9-15b06888f81f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:35.117109 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 158/313] 10.222.0.62 () {60 vars in 1134 bytes} [Tue Oct 4 14:14:34 2022] POST /identity/v3/groups => generated 229 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:14:35.117722 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8e776-a8ab-4516-b2d9-15b06888f81f None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:35.262193 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca255bb-5d5f-4258-94ec-18df68467772 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:35.280621 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8e776-a8ab-4516-b2d9-15b06888f81f None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:35.332392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d758d98-e0c4-46c4-bd80-7eb3ce814edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:35.333438 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d758d98-e0c4-46c4-bd80-7eb3ce814edb None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:35.333727 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d758d98-e0c4-46c4-bd80-7eb3ce814edb None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:35.334061 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d758d98-e0c4-46c4-bd80-7eb3ce814edb None admin] PATH_INFO: `/v3/system/users/3a6b8342b07941b2bd3c899e7ba86132/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:35.335642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d758d98-e0c4-46c4-bd80-7eb3ce814edb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3a6b8342b07941b2bd3c899e7ba86132, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:35.337181 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d758d98-e0c4-46c4-bd80-7eb3ce814edb None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:35.338246 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b46593-4b8b-4a59-bee8-0e1cd98a80fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:35.339316 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b46593-4b8b-4a59-bee8-0e1cd98a80fd None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:35.339837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b46593-4b8b-4a59-bee8-0e1cd98a80fd None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:35.340320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b46593-4b8b-4a59-bee8-0e1cd98a80fd None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:35.341972 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b46593-4b8b-4a59-bee8-0e1cd98a80fd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:35.342147 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b46593-4b8b-4a59-bee8-0e1cd98a80fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:35.346637 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b46593-4b8b-4a59-bee8-0e1cd98a80fd None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:35.352224 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 159/314] 10.222.0.62 () {58 vars in 1334 bytes} [Tue Oct 4 14:14:35 2022] PUT /identity/v3/system/users/3a6b8342b07941b2bd3c899e7ba86132/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:14:35.365390 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d758d98-e0c4-46c4-bd80-7eb3ce814edb None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:35.365975 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 156/315] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:14:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:35.375674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b46593-4b8b-4a59-bee8-0e1cd98a80fd None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:35.425683 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:35.527333 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:35.612501 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d758d98-e0c4-46c4-bd80-7eb3ce814edb None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:35.634922 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b46593-4b8b-4a59-bee8-0e1cd98a80fd None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:35.656303 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cd32d-8a25-42ef-8dd6-9cad76e5ed47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:35.657006 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cd32d-8a25-42ef-8dd6-9cad76e5ed47 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:35.658200 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cd32d-8a25-42ef-8dd6-9cad76e5ed47 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:35.658200 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cd32d-8a25-42ef-8dd6-9cad76e5ed47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:35.658767 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613cd32d-8a25-42ef-8dd6-9cad76e5ed47 None admin] RBAC: Adding query filter params (role.id=d1857bfa9b524282b38b5bf1160e2473, scope.project.id=660126a36fe74ee0b2c60ecb51c62269, user.id=31e2ee7593624e6abf462be463496e91) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:35.659164 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613cd32d-8a25-42ef-8dd6-9cad76e5ed47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:35.660694 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613cd32d-8a25-42ef-8dd6-9cad76e5ed47 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:35.667864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 160/316] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:14:35 2022] GET /identity/v3/role_assignments?user.id=31e2ee7593624e6abf462be463496e91&scope.project.id=660126a36fe74ee0b2c60ecb51c62269&role.id=d1857bfa9b524282b38b5bf1160e2473 => generated 608 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:35.706980 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a489d2-ebf4-4b54-864b-b610af837e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:35.708340 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a489d2-ebf4-4b54-864b-b610af837e2a None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:35.709005 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a489d2-ebf4-4b54-864b-b610af837e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:35.709667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a489d2-ebf4-4b54-864b-b610af837e2a None admin] PATH_INFO: `/v3/users/9a05ee40e35b4d8084d6dde24198871e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:35.737848 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a489d2-ebf4-4b54-864b-b610af837e2a None admin] RBAC: Authorizing `identity:get_user(user_id=9a05ee40e35b4d8084d6dde24198871e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:35.740958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a489d2-ebf4-4b54-864b-b610af837e2a None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:35.744234 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 157/317] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:35 2022] GET /identity/v3/users/9a05ee40e35b4d8084d6dde24198871e => generated 293 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:35.754437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cd32d-8a25-42ef-8dd6-9cad76e5ed47 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:35.914157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:35.933922 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cd32d-8a25-42ef-8dd6-9cad76e5ed47 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:35.978579 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf33e42-c395-4811-a89f-d9076c87876d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:35.979217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf33e42-c395-4811-a89f-d9076c87876d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:35.979496 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf33e42-c395-4811-a89f-d9076c87876d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:35.979900 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf33e42-c395-4811-a89f-d9076c87876d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:35.980620 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf33e42-c395-4811-a89f-d9076c87876d None admin] RBAC: Adding query filter params (role.id=d1857bfa9b524282b38b5bf1160e2473, user.id=9a05ee40e35b4d8084d6dde24198871e, scope.system=all) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:35.980928 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf33e42-c395-4811-a89f-d9076c87876d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:35.982423 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf33e42-c395-4811-a89f-d9076c87876d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:35.989449 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 161/318] 10.222.0.62 () {56 vars in 1308 bytes} [Tue Oct 4 14:14:35 2022] GET /identity/v3/role_assignments?user.id=9a05ee40e35b4d8084d6dde24198871e&scope.system=all&role.id=d1857bfa9b524282b38b5bf1160e2473 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:37.863803 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00830bd8-1965-49d8-9191-f07ad45aee90 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:37.864329 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00830bd8-1965-49d8-9191-f07ad45aee90 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:37.864659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00830bd8-1965-49d8-9191-f07ad45aee90 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:37.867387 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 158/319] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:37.873447 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd1648-7ba1-4a8f-a0d9-3c8bec0df55e None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:37.874233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd1648-7ba1-4a8f-a0d9-3c8bec0df55e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:37.874233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd1648-7ba1-4a8f-a0d9-3c8bec0df55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:37.895525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f1cd1648-7ba1-4a8f-a0d9-3c8bec0df55e None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:37.896794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f1cd1648-7ba1-4a8f-a0d9-3c8bec0df55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:37.985387 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 162/320] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:38.261698 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00830bd8-1965-49d8-9191-f07ad45aee90 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:38.377469 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae8828-2985-4859-be2b-7646791d728f None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:38.377829 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae8828-2985-4859-be2b-7646791d728f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:38.378447 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae8828-2985-4859-be2b-7646791d728f None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:38.380251 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 163/321] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:14:38.387686 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ef27b-ec6c-4727-832c-a9ac5f12b8b8 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:38.388174 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ef27b-ec6c-4727-832c-a9ac5f12b8b8 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:38.388613 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ef27b-ec6c-4727-832c-a9ac5f12b8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:38.391665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00830bd8-1965-49d8-9191-f07ad45aee90 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:38.416412 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:38.421606 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-558ef27b-ec6c-4727-832c-a9ac5f12b8b8 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:38.424407 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-558ef27b-ec6c-4727-832c-a9ac5f12b8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:38.447210 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25862a2-e361-4053-8471-ed68e106dfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:38.447891 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25862a2-e361-4053-8471-ed68e106dfee None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:38.448170 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25862a2-e361-4053-8471-ed68e106dfee None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:38.448439 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25862a2-e361-4053-8471-ed68e106dfee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:38.449677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25862a2-e361-4053-8471-ed68e106dfee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:38.451182 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25862a2-e361-4053-8471-ed68e106dfee None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:38.452914 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 159/322] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:14:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:14:38.458922 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25862a2-e361-4053-8471-ed68e106dfee None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:38.536059 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 164/323] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 14:14:38.608878 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25862a2-e361-4053-8471-ed68e106dfee None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:38.652345 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5a52b-3a4a-4254-863d-b3721eff4b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:38.652989 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5a52b-3a4a-4254-863d-b3721eff4b06 None admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:38.653236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5a52b-3a4a-4254-863d-b3721eff4b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:38.653515 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5a52b-3a4a-4254-863d-b3721eff4b06 None admin] PATH_INFO: `/v3/groups` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:38.654216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5a52b-3a4a-4254-863d-b3721eff4b06 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:38.655603 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5a52b-3a4a-4254-863d-b3721eff4b06 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:38.674717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a1b75-cfbb-48c9-bc44-0d05191cf517 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:38.675008 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a1b75-cfbb-48c9-bc44-0d05191cf517 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:38.675277 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a1b75-cfbb-48c9-bc44-0d05191cf517 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:38.676707 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 165/324] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:14:38.679572 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 160/325] 10.222.0.62 () {60 vars in 1134 bytes} [Tue Oct 4 14:14:38 2022] POST /identity/v3/groups => generated 226 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:14:38.684307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7e665-2818-4bef-8e58-3ae837d6a5fb None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:38.684813 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7e665-2818-4bef-8e58-3ae837d6a5fb None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:38.685312 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7e665-2818-4bef-8e58-3ae837d6a5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:38.718708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-bfe7e665-2818-4bef-8e58-3ae837d6a5fb None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:38.721360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bfe7e665-2818-4bef-8e58-3ae837d6a5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:38.725396 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:38.819512 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5a52b-3a4a-4254-863d-b3721eff4b06 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:38.857035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 166/326] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:38.874871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:38.957061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5a52b-3a4a-4254-863d-b3721eff4b06 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:39.002320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de656e-1135-4491-b6ad-0d012433f97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:39.003623 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de656e-1135-4491-b6ad-0d012433f97c None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:39.004160 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de656e-1135-4491-b6ad-0d012433f97c None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:39.004617 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de656e-1135-4491-b6ad-0d012433f97c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:39.023803 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de656e-1135-4491-b6ad-0d012433f97c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:39.032861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-99de656e-1135-4491-b6ad-0d012433f97c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 14:14:39.032861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:39.032861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:39.032861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:39.032861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:39.032861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:39.032861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:39.032861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:39.032861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:39.032861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:39.032861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:39.032861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:39.032861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:39.032861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:39.032861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:39.032861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:39.034900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:39.034900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:39.034900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:39.034900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:39.034900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:39.034900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:39.034900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:39.034900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:39.034900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:39.034900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:39.034900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:39.034900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:39.034900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:39.034900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:39.034900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:39.034900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:39.037008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:39.037008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:39.037008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:39.037008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:39.037008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:39.037008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:39.037008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:39.037008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:39.037008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:39.037008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:39.037008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 14:14:39.037008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:14:39.040440 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 161/327] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:14:39.046140 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7e665-2818-4bef-8e58-3ae837d6a5fb None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:39.166086 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de656e-1135-4491-b6ad-0d012433f97c None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:39.200473 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7e665-2818-4bef-8e58-3ae837d6a5fb None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:39.247819 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820db36f-6e41-4cf7-aa12-37d3c995856a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:39.248726 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820db36f-6e41-4cf7-aa12-37d3c995856a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:39.249025 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820db36f-6e41-4cf7-aa12-37d3c995856a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:39.249294 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820db36f-6e41-4cf7-aa12-37d3c995856a None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:39.249979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820db36f-6e41-4cf7-aa12-37d3c995856a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:39.250277 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820db36f-6e41-4cf7-aa12-37d3c995856a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:39.251940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820db36f-6e41-4cf7-aa12-37d3c995856a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:39.261485 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:39.265102 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 167/328] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:14:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:14:39.273529 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820db36f-6e41-4cf7-aa12-37d3c995856a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:39.308112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de656e-1135-4491-b6ad-0d012433f97c None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:39.310157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:39.373822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a05a0a-a7e3-474b-b37f-9304a8feb1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:39.374836 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a05a0a-a7e3-474b-b37f-9304a8feb1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:39.375119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a05a0a-a7e3-474b-b37f-9304a8feb1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:39.375408 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a05a0a-a7e3-474b-b37f-9304a8feb1d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:39.399934 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a05a0a-a7e3-474b-b37f-9304a8feb1d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:39.408503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-f2a05a0a-a7e3-474b-b37f-9304a8feb1d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:39.408503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:39.408503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:39.408503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:39.408503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:39.408503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:39.408503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:39.408503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:39.408503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:39.408503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:39.408503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:39.408503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:39.408503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:39.408503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:39.408503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:39.408503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:39.409452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:39.409452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:39.409452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:39.409452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:39.409452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:39.409452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:39.409452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:39.409452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:39.409452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:39.409452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:39.409452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:39.409452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:39.409452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:39.409452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:39.409452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:39.409452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:39.410236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:39.410236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:39.410236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:39.410236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:39.410236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:39.410236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:39.410236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:39.410236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:39.410236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:39.410236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:39.410236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:39.410236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:14:39.414187 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 162/329] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:14:39.421410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a05a0a-a7e3-474b-b37f-9304a8feb1d1 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:39.456866 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820db36f-6e41-4cf7-aa12-37d3c995856a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:39.502565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2aeb7-661a-4c02-828d-227d939a6087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:39.503508 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2aeb7-661a-4c02-828d-227d939a6087 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:39.503508 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2aeb7-661a-4c02-828d-227d939a6087 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:39.503812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2aeb7-661a-4c02-828d-227d939a6087 None admin] PATH_INFO: `/v3/users/9a05ee40e35b4d8084d6dde24198871e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:39.505073 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2aeb7-661a-4c02-828d-227d939a6087 None admin] RBAC: Authorizing `identity:get_user(user_id=9a05ee40e35b4d8084d6dde24198871e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:39.506559 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2aeb7-661a-4c02-828d-227d939a6087 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:39.508315 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 168/330] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:39 2022] GET /identity/v3/users/9a05ee40e35b4d8084d6dde24198871e => generated 293 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:39.514285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2aeb7-661a-4c02-828d-227d939a6087 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:39.602123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a05a0a-a7e3-474b-b37f-9304a8feb1d1 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:39.619517 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:39.665252 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df71c51-465b-421b-9e70-5758987b2355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:39.667778 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df71c51-465b-421b-9e70-5758987b2355 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:39.668561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df71c51-465b-421b-9e70-5758987b2355 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:39.669141 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df71c51-465b-421b-9e70-5758987b2355 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:39.670699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df71c51-465b-421b-9e70-5758987b2355 None admin] RBAC: Adding query filter params (name=member) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:39.671858 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df71c51-465b-421b-9e70-5758987b2355 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:39.677825 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df71c51-465b-421b-9e70-5758987b2355 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:39.681088 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2aeb7-661a-4c02-828d-227d939a6087 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:39.708406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 163/331] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:14:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:14:39.717594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df71c51-465b-421b-9e70-5758987b2355 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:39.772976 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b509ff-ff7d-4e49-a159-a4421b372f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:39.773665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b509ff-ff7d-4e49-a159-a4421b372f6e None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:39.773945 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b509ff-ff7d-4e49-a159-a4421b372f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:39.774217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b509ff-ff7d-4e49-a159-a4421b372f6e None admin] PATH_INFO: `/v3/system/users/9a05ee40e35b4d8084d6dde24198871e/roles/d1857bfa9b524282b38b5bf1160e2473` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:39.778437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b509ff-ff7d-4e49-a159-a4421b372f6e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9a05ee40e35b4d8084d6dde24198871e, role_id=d1857bfa9b524282b38b5bf1160e2473)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:39.779999 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b509ff-ff7d-4e49-a159-a4421b372f6e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:39.802625 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 169/332] 10.222.0.62 () {58 vars in 1334 bytes} [Tue Oct 4 14:14:39 2022] PUT /identity/v3/system/users/9a05ee40e35b4d8084d6dde24198871e/roles/d1857bfa9b524282b38b5bf1160e2473 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:14:39.804861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:39.997561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df71c51-465b-421b-9e70-5758987b2355 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:40.083749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ab8ef-6213-401d-8426-1a37fa83de08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:40.083749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ab8ef-6213-401d-8426-1a37fa83de08 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:40.083749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ab8ef-6213-401d-8426-1a37fa83de08 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:40.083749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ab8ef-6213-401d-8426-1a37fa83de08 None admin] PATH_INFO: `/v3/users/3a6b8342b07941b2bd3c899e7ba86132` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:40.088220 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ab8ef-6213-401d-8426-1a37fa83de08 None admin] RBAC: Authorizing `identity:get_user(user_id=3a6b8342b07941b2bd3c899e7ba86132)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:40.091178 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ab8ef-6213-401d-8426-1a37fa83de08 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:40.095781 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 164/333] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:39 2022] GET /identity/v3/users/3a6b8342b07941b2bd3c899e7ba86132 => generated 293 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:14:40.108314 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b509ff-ff7d-4e49-a159-a4421b372f6e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:40.288187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b509ff-ff7d-4e49-a159-a4421b372f6e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:40.325215 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:40.349705 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b8639-4c49-4859-b972-91ebc6c02910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:40.355020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b8639-4c49-4859-b972-91ebc6c02910 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:40.355020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b8639-4c49-4859-b972-91ebc6c02910 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:40.355020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b8639-4c49-4859-b972-91ebc6c02910 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:40.355020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b8639-4c49-4859-b972-91ebc6c02910 None admin] RBAC: Adding query filter params (role.id=eb2435bb443d4469899fb3830f4ee5b1, user.id=3a6b8342b07941b2bd3c899e7ba86132, scope.system=all) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:40.355020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b8639-4c49-4859-b972-91ebc6c02910 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:40.355020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b8639-4c49-4859-b972-91ebc6c02910 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:40.381401 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 170/334] 10.222.0.62 () {56 vars in 1308 bytes} [Tue Oct 4 14:14:40 2022] GET /identity/v3/role_assignments?user.id=3a6b8342b07941b2bd3c899e7ba86132&scope.system=all&role.id=eb2435bb443d4469899fb3830f4ee5b1 => generated 510 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:42.462440 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fa007-1096-4d98-bc3d-a52375fac2f9 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:42.462959 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fa007-1096-4d98-bc3d-a52375fac2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:42.463319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fa007-1096-4d98-bc3d-a52375fac2f9 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:42.466500 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 165/335] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:42.474470 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f12b99-4ffd-404b-9b64-a0b21ef5be4d None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:42.474982 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f12b99-4ffd-404b-9b64-a0b21ef5be4d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:42.475425 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f12b99-4ffd-404b-9b64-a0b21ef5be4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:42.534803 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-77f12b99-4ffd-404b-9b64-a0b21ef5be4d None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:42.536895 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-77f12b99-4ffd-404b-9b64-a0b21ef5be4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:42.599491 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddbcf4-5c4f-4e82-b5ba-4c924e7070a3 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:42.599949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddbcf4-5c4f-4e82-b5ba-4c924e7070a3 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:42.600377 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddbcf4-5c4f-4e82-b5ba-4c924e7070a3 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:42.603438 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 166/336] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:42.614277 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52b7db-bf95-4db9-a26f-075a6c83e845 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:42.614693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52b7db-bf95-4db9-a26f-075a6c83e845 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:42.615143 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52b7db-bf95-4db9-a26f-075a6c83e845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:42.680903 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-0a52b7db-bf95-4db9-a26f-075a6c83e845 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:42.682174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-0a52b7db-bf95-4db9-a26f-075a6c83e845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:42.736318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 171/337] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:42.819076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 167/338] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:43.212784 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f12b99-4ffd-404b-9b64-a0b21ef5be4d None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:43.333353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52b7db-bf95-4db9-a26f-075a6c83e845 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:43.388230 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:43.442398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f12b99-4ffd-404b-9b64-a0b21ef5be4d None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:43.504294 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:43.529939 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2d3ed-0e7c-4f16-9075-62e7cb0b75f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:43.534806 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2d3ed-0e7c-4f16-9075-62e7cb0b75f9 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:43.536746 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2d3ed-0e7c-4f16-9075-62e7cb0b75f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:43.537272 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2d3ed-0e7c-4f16-9075-62e7cb0b75f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:43.564474 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2d3ed-0e7c-4f16-9075-62e7cb0b75f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:43.576027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-82a2d3ed-0e7c-4f16-9075-62e7cb0b75f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:43.576027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:43.576027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:43.576027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:43.576027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:43.576027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:43.576027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:43.576027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:43.576027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:43.576027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:43.576027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:43.576027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:43.576027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:43.576027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:43.576027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:43.576027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:43.577001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:43.577001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:43.577001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:43.577001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:43.577001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:43.577001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:43.577001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:43.577001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:43.577001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:43.577001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:43.577001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:43.577001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:43.577001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:43.577001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:43.577001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:43.577001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:43.577796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:43.577796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:43.577796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:43.577796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:43.577796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:43.577796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:43.577796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:43.577796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:43.577796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:43.577796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:43.577796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:43.577796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:14:43.577796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 172/339] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:43.583604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2d3ed-0e7c-4f16-9075-62e7cb0b75f9 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:43.587830 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52b7db-bf95-4db9-a26f-075a6c83e845 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:43.689865 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283474c-24f9-4a2d-b0df-23a11cbc8c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:43.691058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283474c-24f9-4a2d-b0df-23a11cbc8c84 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:43.691555 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283474c-24f9-4a2d-b0df-23a11cbc8c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:43.692073 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283474c-24f9-4a2d-b0df-23a11cbc8c84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:43.730210 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283474c-24f9-4a2d-b0df-23a11cbc8c84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:43.748276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-1283474c-24f9-4a2d-b0df-23a11cbc8c84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:14:43.748276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:43.748276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:43.748276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:43.748276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:43.748276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:43.748276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:43.748276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:43.748276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:43.748276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:43.748276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:43.748276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:43.748276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:43.748276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:43.748276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:43.748276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:43.749231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:43.749231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:43.749231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:43.749231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:43.749231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:43.749231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:43.749231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:43.749231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:43.749231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:43.749231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:43.749231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:43.749231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:43.749231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:43.749231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:43.749231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:43.749231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:43.750022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:43.750022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:43.750022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:43.750022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:43.750022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:43.750022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:43.750022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:43.750022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:43.750022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:43.750022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:43.750022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:14:43.750022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:14:43.754167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 168/340] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Oct 4 14:14:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:14:43.765400 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283474c-24f9-4a2d-b0df-23a11cbc8c84 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:43.789559 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2d3ed-0e7c-4f16-9075-62e7cb0b75f9 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:43.846323 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4408a-af47-4aa5-b972-4b2af47f913d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:43.846953 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4408a-af47-4aa5-b972-4b2af47f913d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:43.847228 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4408a-af47-4aa5-b972-4b2af47f913d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:43.847496 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4408a-af47-4aa5-b972-4b2af47f913d None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:43.848225 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4408a-af47-4aa5-b972-4b2af47f913d None admin] RBAC: Adding query filter params (name=member) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:43.848530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4408a-af47-4aa5-b972-4b2af47f913d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:43.850471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4408a-af47-4aa5-b972-4b2af47f913d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:43.865164 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 173/341] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:14:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:43.871132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4408a-af47-4aa5-b972-4b2af47f913d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:43.942945 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:43.985941 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:44.029876 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283474c-24f9-4a2d-b0df-23a11cbc8c84 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:44.034692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4408a-af47-4aa5-b972-4b2af47f913d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:44.093245 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574c3cb-e86e-4e30-a2fa-0111c58105df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:44.093894 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574c3cb-e86e-4e30-a2fa-0111c58105df None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:44.094172 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574c3cb-e86e-4e30-a2fa-0111c58105df None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:44.095009 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574c3cb-e86e-4e30-a2fa-0111c58105df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:44.117387 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fc0db-6775-4254-b5e3-1871871b75c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:44.118790 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fc0db-6775-4254-b5e3-1871871b75c5 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:44.120265 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fc0db-6775-4254-b5e3-1871871b75c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:44.123633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fc0db-6775-4254-b5e3-1871871b75c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:44.125377 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fc0db-6775-4254-b5e3-1871871b75c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:44.126758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fc0db-6775-4254-b5e3-1871871b75c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:44.129841 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fc0db-6775-4254-b5e3-1871871b75c5 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:44.147788 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 169/342] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:14:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:44.151475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bab20-ea80-441d-9f24-c5d742bdcd32 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:44.153008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bab20-ea80-441d-9f24-c5d742bdcd32 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:44.153792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bab20-ea80-441d-9f24-c5d742bdcd32 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:44.156736 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 170/343] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:44.160544 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7bab20-ea80-441d-9f24-c5d742bdcd32 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:44.335465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574c3cb-e86e-4e30-a2fa-0111c58105df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:44.338898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574c3cb-e86e-4e30-a2fa-0111c58105df None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:44.459389 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:44.472607 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7bab20-ea80-441d-9f24-c5d742bdcd32 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:44.575735 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006df52e-f154-4097-b8ba-eba6f090dec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:44.576874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006df52e-f154-4097-b8ba-eba6f090dec5 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:44.577352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006df52e-f154-4097-b8ba-eba6f090dec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:44.577870 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006df52e-f154-4097-b8ba-eba6f090dec5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:44.599759 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:44.610666 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 174/344] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:14:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 740 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 14:14:44.618105 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c1bdf-7314-4999-a13e-ceb0f2ce9498 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:44.618855 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c1bdf-7314-4999-a13e-ceb0f2ce9498 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:44.619469 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c1bdf-7314-4999-a13e-ceb0f2ce9498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:44.657226 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-d66c1bdf-7314-4999-a13e-ceb0f2ce9498 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:44.659402 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d66c1bdf-7314-4999-a13e-ceb0f2ce9498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:44.697463 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006df52e-f154-4097-b8ba-eba6f090dec5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:44.701307 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006df52e-f154-4097-b8ba-eba6f090dec5 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:44.812683 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 175/345] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:44.816349 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216b910-05a2-45d3-aa94-2e914c319217 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:44.817096 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216b910-05a2-45d3-aa94-2e914c319217 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:44.817762 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216b910-05a2-45d3-aa94-2e914c319217 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:44.821196 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 176/346] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:44.823093 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216b910-05a2-45d3-aa94-2e914c319217 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:44.981746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 171/347] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:14:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 824 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:14:44.983154 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993caee-3d58-46bb-b317-49f820c6a6e4 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:44.983432 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993caee-3d58-46bb-b317-49f820c6a6e4 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:44.983700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993caee-3d58-46bb-b317-49f820c6a6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:45.018593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-4993caee-3d58-46bb-b317-49f820c6a6e4 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:45.019844 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-4993caee-3d58-46bb-b317-49f820c6a6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:45.021102 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:45.077128 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:45.103416 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216b910-05a2-45d3-aa94-2e914c319217 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:45.131835 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 172/348] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:45.133109 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993caee-3d58-46bb-b317-49f820c6a6e4 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:45.206198 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b448a6f-14f9-40cd-bab0-515566d86e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:45.209229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b448a6f-14f9-40cd-bab0-515566d86e9d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:45.210273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b448a6f-14f9-40cd-bab0-515566d86e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:45.212126 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b448a6f-14f9-40cd-bab0-515566d86e9d None admin] PATH_INFO: `/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:45.216899 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b448a6f-14f9-40cd-bab0-515566d86e9d None admin] RBAC: Authorizing `identity:get_project(project_id=0c72ec4a5e6f40ac84de3c903eedf1d3)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:45.223245 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b448a6f-14f9-40cd-bab0-515566d86e9d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:45.230850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 177/349] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:44 2022] GET /identity/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3 => generated 298 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:45.236966 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b448a6f-14f9-40cd-bab0-515566d86e9d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:45.468378 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993caee-3d58-46bb-b317-49f820c6a6e4 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:45.510536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b448a6f-14f9-40cd-bab0-515566d86e9d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:45.557364 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fa921-7319-4499-b26f-72990bbdfc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:45.558004 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fa921-7319-4499-b26f-72990bbdfc92 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:45.558289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fa921-7319-4499-b26f-72990bbdfc92 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:45.558562 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fa921-7319-4499-b26f-72990bbdfc92 None admin] PATH_INFO: `/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:45.559884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fa921-7319-4499-b26f-72990bbdfc92 None admin] RBAC: Authorizing `identity:get_project(project_id=0c72ec4a5e6f40ac84de3c903eedf1d3)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:45.561396 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fa921-7319-4499-b26f-72990bbdfc92 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:45.563473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 173/350] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:45 2022] GET /identity/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3 => generated 298 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:45.564404 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fa921-7319-4499-b26f-72990bbdfc92 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:45.567231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532724a8-2ab5-4505-8875-3c4ab0bdf92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:45.568385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532724a8-2ab5-4505-8875-3c4ab0bdf92d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:45.568926 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532724a8-2ab5-4505-8875-3c4ab0bdf92d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:45.569191 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532724a8-2ab5-4505-8875-3c4ab0bdf92d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:45.580816 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:45.584953 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532724a8-2ab5-4505-8875-3c4ab0bdf92d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:45.590943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-532724a8-2ab5-4505-8875-3c4ab0bdf92d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 14:14:45.590943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:45.590943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:45.590943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:45.590943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:45.590943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:45.590943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:45.590943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:45.590943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:45.590943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:45.590943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:45.590943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:45.590943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:45.590943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:45.590943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:45.590943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:45.592273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:45.592273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:45.592273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:45.592273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:45.592273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:45.592273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:45.592273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:45.592273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:45.592273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:45.592273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:45.592273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:45.592273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:45.592273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:45.592273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:45.592273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:45.592273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:45.593243 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:45.593243 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:45.593243 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:45.593243 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:45.593243 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:45.593243 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:45.593243 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:45.593243 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:45.593243 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:45.593243 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:45.593243 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 14:14:45.593243 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:14:45.593243 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 178/351] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:45.595153 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8f3fd-d3a7-44cb-8553-e63160a0334a None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:45.595912 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8f3fd-d3a7-44cb-8553-e63160a0334a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:45.596539 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8f3fd-d3a7-44cb-8553-e63160a0334a None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:45.598404 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 179/352] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:45.599410 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8f3fd-d3a7-44cb-8553-e63160a0334a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:45.631636 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:45.744441 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fa921-7319-4499-b26f-72990bbdfc92 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:45.785173 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8f3fd-d3a7-44cb-8553-e63160a0334a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:45.792675 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b4111-edc6-4a55-bc71-56e4f3a1f813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:45.793584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b4111-edc6-4a55-bc71-56e4f3a1f813 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:45.794035 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b4111-edc6-4a55-bc71-56e4f3a1f813 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:45.794309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b4111-edc6-4a55-bc71-56e4f3a1f813 None admin] PATH_INFO: `/v3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:45.803354 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b4111-edc6-4a55-bc71-56e4f3a1f813 None admin] RBAC: Authorizing `identity:get_group(group_id=259e3ab57d9e4c2dbb5cc6e5fccf5aed)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:45.804945 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b4111-edc6-4a55-bc71-56e4f3a1f813 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:45.806955 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 174/353] 10.222.0.62 () {56 vars in 1180 bytes} [Tue Oct 4 14:14:45 2022] GET /identity/v3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:45.808049 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db5862-dbb5-478a-99f4-3bb6f619f6ab None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:45.808326 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db5862-dbb5-478a-99f4-3bb6f619f6ab None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:45.808773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db5862-dbb5-478a-99f4-3bb6f619f6ab None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:45.810206 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 175/354] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:45.811001 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db5862-dbb5-478a-99f4-3bb6f619f6ab None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:45.853849 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7e52a-f01e-484f-a2e4-56d41f5ad985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:45.854847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7e52a-f01e-484f-a2e4-56d41f5ad985 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:45.855470 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7e52a-f01e-484f-a2e4-56d41f5ad985 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:45.855952 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7e52a-f01e-484f-a2e4-56d41f5ad985 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:45.873771 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7e52a-f01e-484f-a2e4-56d41f5ad985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:45.886562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-d3c7e52a-f01e-484f-a2e4-56d41f5ad985 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:45.886562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:45.886562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:45.886562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:45.886562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:45.886562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:45.886562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:45.886562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:45.886562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:45.886562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:45.886562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:45.886562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:45.886562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:45.886562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:45.886562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:45.886562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:45.887534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:45.887534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:45.887534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:45.887534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:45.887534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:45.887534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:45.887534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:45.887534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:45.887534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:45.887534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:45.887534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:45.887534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:45.887534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:45.887534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:45.887534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:45.887534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:45.888398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:45.888398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:45.888398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:45.888398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:45.888398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:45.888398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:45.888398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:45.888398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:45.888398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:45.888398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:45.888398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:45.888398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:14:45.889035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 180/355] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:45.891939 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7e52a-f01e-484f-a2e4-56d41f5ad985 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:45.960787 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db5862-dbb5-478a-99f4-3bb6f619f6ab None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:45.965674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:45.974412 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:46.032554 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d9006-3ca3-46a5-8278-0019f695d5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:46.033698 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d9006-3ca3-46a5-8278-0019f695d5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:46.033975 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d9006-3ca3-46a5-8278-0019f695d5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:46.034246 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d9006-3ca3-46a5-8278-0019f695d5f1 None admin] PATH_INFO: `/v3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:46.035999 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d9006-3ca3-46a5-8278-0019f695d5f1 None admin] RBAC: Authorizing `identity:get_group(group_id=259e3ab57d9e4c2dbb5cc6e5fccf5aed)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:46.037063 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7e52a-f01e-484f-a2e4-56d41f5ad985 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:46.037892 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d9006-3ca3-46a5-8278-0019f695d5f1 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:46.039846 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 176/356] 10.222.0.62 () {56 vars in 1180 bytes} [Tue Oct 4 14:14:45 2022] GET /identity/v3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:46.041276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd223fd-c3d1-406f-80e8-1a902120c3b3 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:46.041553 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd223fd-c3d1-406f-80e8-1a902120c3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:46.042094 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd223fd-c3d1-406f-80e8-1a902120c3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:46.063558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-6dd223fd-c3d1-406f-80e8-1a902120c3b3 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:46.065025 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-6dd223fd-c3d1-406f-80e8-1a902120c3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:46.090172 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840f0f4-cb5e-4914-a0ac-a952b1a47645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:46.091044 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840f0f4-cb5e-4914-a0ac-a952b1a47645 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:46.091514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840f0f4-cb5e-4914-a0ac-a952b1a47645 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:46.091806 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840f0f4-cb5e-4914-a0ac-a952b1a47645 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:46.092647 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840f0f4-cb5e-4914-a0ac-a952b1a47645 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:46.093098 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840f0f4-cb5e-4914-a0ac-a952b1a47645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:46.095360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840f0f4-cb5e-4914-a0ac-a952b1a47645 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:46.107005 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 181/357] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:14:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:46.108398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c3ced-9904-4f3f-92f2-06adeae8119b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:46.108733 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c3ced-9904-4f3f-92f2-06adeae8119b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:46.109009 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c3ced-9904-4f3f-92f2-06adeae8119b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:46.130482 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-171c3ced-9904-4f3f-92f2-06adeae8119b None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:46.131764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-171c3ced-9904-4f3f-92f2-06adeae8119b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:46.171522 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 177/358] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:46.173384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd223fd-c3d1-406f-80e8-1a902120c3b3 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:46.254408 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 182/359] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:46.256684 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c3ced-9904-4f3f-92f2-06adeae8119b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:46.388256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:46.415357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd223fd-c3d1-406f-80e8-1a902120c3b3 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:46.420904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:46.503652 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533db4d-111b-4c47-87f0-99206fd240fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:46.504749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533db4d-111b-4c47-87f0-99206fd240fa None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:46.505227 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533db4d-111b-4c47-87f0-99206fd240fa None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:46.505680 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533db4d-111b-4c47-87f0-99206fd240fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:46.507028 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533db4d-111b-4c47-87f0-99206fd240fa None admin] RBAC: Adding query filter params (group.id=259e3ab57d9e4c2dbb5cc6e5fccf5aed, role.id=eb2435bb443d4469899fb3830f4ee5b1, scope.project.id=0c72ec4a5e6f40ac84de3c903eedf1d3) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:46.507576 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533db4d-111b-4c47-87f0-99206fd240fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:46.510380 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533db4d-111b-4c47-87f0-99206fd240fa None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:46.511901 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c3ced-9904-4f3f-92f2-06adeae8119b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:46.524965 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 178/360] 10.222.0.62 () {56 vars in 1376 bytes} [Tue Oct 4 14:14:46 2022] GET /identity/v3/role_assignments?group.id=259e3ab57d9e4c2dbb5cc6e5fccf5aed&scope.project.id=0c72ec4a5e6f40ac84de3c903eedf1d3&role.id=eb2435bb443d4469899fb3830f4ee5b1 => generated 260 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:46.526504 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533db4d-111b-4c47-87f0-99206fd240fa None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:46.618617 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df825382-6093-4889-9d27-1526bed6dec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:46.619788 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df825382-6093-4889-9d27-1526bed6dec4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:46.620282 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df825382-6093-4889-9d27-1526bed6dec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:46.620750 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df825382-6093-4889-9d27-1526bed6dec4 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:46.621948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df825382-6093-4889-9d27-1526bed6dec4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:46.622486 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df825382-6093-4889-9d27-1526bed6dec4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:46.628892 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df825382-6093-4889-9d27-1526bed6dec4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:46.651385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 183/361] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:14:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:46.651971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df825382-6093-4889-9d27-1526bed6dec4 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:46.776902 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533db4d-111b-4c47-87f0-99206fd240fa None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:46.827164 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df825382-6093-4889-9d27-1526bed6dec4 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:46.859347 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e66bf-0356-4089-82b5-8169f8d6b838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:46.861063 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e66bf-0356-4089-82b5-8169f8d6b838 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:46.861783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e66bf-0356-4089-82b5-8169f8d6b838 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:46.862833 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:46.862970 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e66bf-0356-4089-82b5-8169f8d6b838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:46.864433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e66bf-0356-4089-82b5-8169f8d6b838 None admin] RBAC: Adding query filter params (group.id=259e3ab57d9e4c2dbb5cc6e5fccf5aed, role.id=c3d8f302f6714108ac91c25b8a32d36b, scope.project.id=0c72ec4a5e6f40ac84de3c903eedf1d3) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:46.865250 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e66bf-0356-4089-82b5-8169f8d6b838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:46.868034 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e66bf-0356-4089-82b5-8169f8d6b838 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:46.879297 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 179/362] 10.222.0.62 () {56 vars in 1376 bytes} [Tue Oct 4 14:14:46 2022] GET /identity/v3/role_assignments?group.id=259e3ab57d9e4c2dbb5cc6e5fccf5aed&scope.project.id=0c72ec4a5e6f40ac84de3c903eedf1d3&role.id=c3d8f302f6714108ac91c25b8a32d36b => generated 260 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:46.880626 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e66bf-0356-4089-82b5-8169f8d6b838 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:46.923440 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33829361-ba2e-4e49-8e39-be557b100717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:46.924079 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33829361-ba2e-4e49-8e39-be557b100717 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:46.924527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33829361-ba2e-4e49-8e39-be557b100717 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:46.924736 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33829361-ba2e-4e49-8e39-be557b100717 None admin] PATH_INFO: `/v3/users/9a05ee40e35b4d8084d6dde24198871e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:46.926862 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33829361-ba2e-4e49-8e39-be557b100717 None admin] RBAC: Authorizing `identity:get_user(user_id=9a05ee40e35b4d8084d6dde24198871e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:46.928390 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33829361-ba2e-4e49-8e39-be557b100717 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:46.930508 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 184/363] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:14:46 2022] GET /identity/v3/users/9a05ee40e35b4d8084d6dde24198871e => generated 293 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:46.931588 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33829361-ba2e-4e49-8e39-be557b100717 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:46.954615 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:47.108905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e66bf-0356-4089-82b5-8169f8d6b838 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:47.164246 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33829361-ba2e-4e49-8e39-be557b100717 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:47.181254 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988dc46-f3e2-4224-bfd2-2cb59191c356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:47.182053 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988dc46-f3e2-4224-bfd2-2cb59191c356 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:47.182507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988dc46-f3e2-4224-bfd2-2cb59191c356 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:47.182969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988dc46-f3e2-4224-bfd2-2cb59191c356 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:47.238464 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da26137-d9ed-4bb4-8e4f-6d1d39c73d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:47.239373 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da26137-d9ed-4bb4-8e4f-6d1d39c73d5b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:47.239655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da26137-d9ed-4bb4-8e4f-6d1d39c73d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:47.239959 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da26137-d9ed-4bb4-8e4f-6d1d39c73d5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:47.262505 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da26137-d9ed-4bb4-8e4f-6d1d39c73d5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:47.269604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-1da26137-d9ed-4bb4-8e4f-6d1d39c73d5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:14:47.269604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:47.269604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:47.269604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:47.269604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:47.269604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:47.269604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:47.269604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:47.269604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:47.269604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:47.269604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:47.269604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:47.269604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:47.269604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:47.269604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:47.269604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:47.270591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:47.270591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:47.270591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:47.270591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:47.270591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:47.270591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:47.270591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:47.270591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:47.270591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:47.270591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:47.270591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:47.270591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:47.270591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:47.270591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:47.270591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:47.270591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:47.271398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:47.271398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:47.271398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:47.271398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:47.271398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:47.271398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:47.271398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:47.271398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:47.271398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:47.271398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:47.271398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:14:47.271398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:14:47.272587 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 185/364] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:14:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:47.273713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da26137-d9ed-4bb4-8e4f-6d1d39c73d5b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:47.314689 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988dc46-f3e2-4224-bfd2-2cb59191c356 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:47.319113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988dc46-f3e2-4224-bfd2-2cb59191c356 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:47.348289 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:47.397611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:47.488714 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da26137-d9ed-4bb4-8e4f-6d1d39c73d5b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:47.571515 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9ec87-1dad-4f57-9ccb-32273d19bf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:47.572577 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9ec87-1dad-4f57-9ccb-32273d19bf03 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:47.573031 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9ec87-1dad-4f57-9ccb-32273d19bf03 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:47.573468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9ec87-1dad-4f57-9ccb-32273d19bf03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:47.575122 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 180/365] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:14:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 695 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:14:47.576713 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988dc46-f3e2-4224-bfd2-2cb59191c356 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:47.595922 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9ec87-1dad-4f57-9ccb-32273d19bf03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:47.609379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-7da9ec87-1dad-4f57-9ccb-32273d19bf03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:14:47.609379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:47.609379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:47.609379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:47.609379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:47.609379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:47.609379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:47.609379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:47.609379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:47.609379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:47.609379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:47.609379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:47.609379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:47.609379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:47.609379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:47.609379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:47.611185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:47.611185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:47.611185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:47.611185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:47.611185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:47.611185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:47.611185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:47.611185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:47.611185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:47.611185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:47.611185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:47.611185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:47.611185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:47.611185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:47.611185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:47.611185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:47.612921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:47.612921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:47.612921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:47.612921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:47.612921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:47.612921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:47.612921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:47.612921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:47.612921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:47.612921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:47.612921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:14:47.612921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:14:47.612921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 186/366] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Oct 4 14:14:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:47.616944 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9ec87-1dad-4f57-9ccb-32273d19bf03 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:47.864668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988dc46-f3e2-4224-bfd2-2cb59191c356 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:47.866355 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9ec87-1dad-4f57-9ccb-32273d19bf03 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:47.869580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:47.944042 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa74f6a-24e9-415b-802b-a2c5bc9a9147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:47.945531 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:47.945748 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa74f6a-24e9-415b-802b-a2c5bc9a9147 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:47.946163 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa74f6a-24e9-415b-802b-a2c5bc9a9147 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:47.946608 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa74f6a-24e9-415b-802b-a2c5bc9a9147 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:47.947855 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa74f6a-24e9-415b-802b-a2c5bc9a9147 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:47.948333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa74f6a-24e9-415b-802b-a2c5bc9a9147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:47.952990 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa74f6a-24e9-415b-802b-a2c5bc9a9147 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:47.958142 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474e209-dbdc-4eee-8daf-d812f1b2686c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:47.959153 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474e209-dbdc-4eee-8daf-d812f1b2686c None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:47.959636 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474e209-dbdc-4eee-8daf-d812f1b2686c None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:47.960191 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474e209-dbdc-4eee-8daf-d812f1b2686c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:47.961521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474e209-dbdc-4eee-8daf-d812f1b2686c None admin] RBAC: Adding query filter params (role.id=d1857bfa9b524282b38b5bf1160e2473, user.id=9a05ee40e35b4d8084d6dde24198871e, scope.system=all) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:47.962073 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474e209-dbdc-4eee-8daf-d812f1b2686c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:47.965999 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474e209-dbdc-4eee-8daf-d812f1b2686c None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:47.970732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 187/367] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:47.972269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa74f6a-24e9-415b-802b-a2c5bc9a9147 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:48.001758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 181/368] 10.222.0.62 () {56 vars in 1308 bytes} [Tue Oct 4 14:14:47 2022] GET /identity/v3/role_assignments?user.id=9a05ee40e35b4d8084d6dde24198871e&scope.system=all&role.id=d1857bfa9b524282b38b5bf1160e2473 => generated 510 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:48.002847 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474e209-dbdc-4eee-8daf-d812f1b2686c None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:48.257363 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa74f6a-24e9-415b-802b-a2c5bc9a9147 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:48.306858 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474e209-dbdc-4eee-8daf-d812f1b2686c None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:48.353008 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41124f9-8997-47e6-ac74-7d2f52618ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:48.353683 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41124f9-8997-47e6-ac74-7d2f52618ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:48.353962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41124f9-8997-47e6-ac74-7d2f52618ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:48.354260 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41124f9-8997-47e6-ac74-7d2f52618ab4 None admin] PATH_INFO: `/v3/projects/660126a36fe74ee0b2c60ecb51c62269` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:48.357873 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41124f9-8997-47e6-ac74-7d2f52618ab4 None admin] RBAC: Authorizing `identity:get_project(project_id=660126a36fe74ee0b2c60ecb51c62269)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:48.361356 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41124f9-8997-47e6-ac74-7d2f52618ab4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:48.364888 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 188/369] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:47 2022] GET /identity/v3/projects/660126a36fe74ee0b2c60ecb51c62269 => generated 302 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:48.366164 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41124f9-8997-47e6-ac74-7d2f52618ab4 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:48.384660 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4072d4-8747-4214-b376-c277346d21d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:48.386379 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4072d4-8747-4214-b376-c277346d21d7 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:48.387901 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4072d4-8747-4214-b376-c277346d21d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:48.388640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4072d4-8747-4214-b376-c277346d21d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:48.390525 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4072d4-8747-4214-b376-c277346d21d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:48.392047 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4072d4-8747-4214-b376-c277346d21d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:48.394749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4072d4-8747-4214-b376-c277346d21d7 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:48.418928 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 182/370] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:14:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:48.423513 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4072d4-8747-4214-b376-c277346d21d7 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:48.450132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:48.536068 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:48.610338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41124f9-8997-47e6-ac74-7d2f52618ab4 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:48.667453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4072d4-8747-4214-b376-c277346d21d7 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:48.686257 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b864c-7108-4a46-b41b-b06a57121a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:48.686904 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b864c-7108-4a46-b41b-b06a57121a9e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:48.687181 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b864c-7108-4a46-b41b-b06a57121a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:48.687509 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b864c-7108-4a46-b41b-b06a57121a9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:48.757858 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abd7e1-6e1f-492d-b400-79ec8725c16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:48.759580 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abd7e1-6e1f-492d-b400-79ec8725c16c None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:48.763155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abd7e1-6e1f-492d-b400-79ec8725c16c None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:48.763700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abd7e1-6e1f-492d-b400-79ec8725c16c None admin] PATH_INFO: `/v3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:48.766298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abd7e1-6e1f-492d-b400-79ec8725c16c None admin] RBAC: Authorizing `identity:get_group(group_id=259e3ab57d9e4c2dbb5cc6e5fccf5aed)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:48.770114 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abd7e1-6e1f-492d-b400-79ec8725c16c None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:48.773936 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 183/371] 10.222.0.62 () {56 vars in 1180 bytes} [Tue Oct 4 14:14:48 2022] GET /identity/v3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed => generated 226 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:48.781762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abd7e1-6e1f-492d-b400-79ec8725c16c None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:48.798233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b864c-7108-4a46-b41b-b06a57121a9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:48.800479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b864c-7108-4a46-b41b-b06a57121a9e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:48.846551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:48.967882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 189/372] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:14:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:14:48.970364 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b864c-7108-4a46-b41b-b06a57121a9e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:48.997237 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abd7e1-6e1f-492d-b400-79ec8725c16c None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:49.024428 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:49.051928 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bd564-bb64-4605-b5c7-e935666cd3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:49.052903 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bd564-bb64-4605-b5c7-e935666cd3bd None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:49.053400 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bd564-bb64-4605-b5c7-e935666cd3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:49.053865 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bd564-bb64-4605-b5c7-e935666cd3bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:49.186498 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bd564-bb64-4605-b5c7-e935666cd3bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:49.191327 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bd564-bb64-4605-b5c7-e935666cd3bd None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:49.214467 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b864c-7108-4a46-b41b-b06a57121a9e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:49.292922 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:49.308364 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecc5bf-bb58-4a02-8397-51602b70834b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:49.311599 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecc5bf-bb58-4a02-8397-51602b70834b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:49.312732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecc5bf-bb58-4a02-8397-51602b70834b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:49.313772 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecc5bf-bb58-4a02-8397-51602b70834b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:49.315406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcecc5bf-bb58-4a02-8397-51602b70834b None admin] RBAC: Adding query filter params (group.id=259e3ab57d9e4c2dbb5cc6e5fccf5aed, role.id=eb2435bb443d4469899fb3830f4ee5b1, scope.project.id=660126a36fe74ee0b2c60ecb51c62269) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:49.316885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcecc5bf-bb58-4a02-8397-51602b70834b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:49.319807 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcecc5bf-bb58-4a02-8397-51602b70834b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:49.333785 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 190/373] 10.222.0.62 () {56 vars in 1376 bytes} [Tue Oct 4 14:14:48 2022] GET /identity/v3/role_assignments?group.id=259e3ab57d9e4c2dbb5cc6e5fccf5aed&scope.project.id=660126a36fe74ee0b2c60ecb51c62269&role.id=eb2435bb443d4469899fb3830f4ee5b1 => generated 260 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:49.335668 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecc5bf-bb58-4a02-8397-51602b70834b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:49.514404 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 184/374] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:14:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 740 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:14:49.521061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bd564-bb64-4605-b5c7-e935666cd3bd None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:49.577314 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecc5bf-bb58-4a02-8397-51602b70834b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:49.578452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:49.652012 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2835d-7c3e-48f8-91fc-32d3b8bdf670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:49.653587 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2835d-7c3e-48f8-91fc-32d3b8bdf670 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:49.654286 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2835d-7c3e-48f8-91fc-32d3b8bdf670 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:49.655036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2835d-7c3e-48f8-91fc-32d3b8bdf670 None admin] PATH_INFO: `/v3/projects/d6e81a80a6484baf89f76501cdc63799` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:49.658729 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2835d-7c3e-48f8-91fc-32d3b8bdf670 None admin] RBAC: Authorizing `identity:get_project(project_id=d6e81a80a6484baf89f76501cdc63799)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:49.662413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2835d-7c3e-48f8-91fc-32d3b8bdf670 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:49.667558 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 191/375] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:49 2022] GET /identity/v3/projects/d6e81a80a6484baf89f76501cdc63799 => generated 344 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:49.670189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21a846-2725-4b0e-b53a-52cce8ae3e95 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:49.670936 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21a846-2725-4b0e-b53a-52cce8ae3e95 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:49.671608 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21a846-2725-4b0e-b53a-52cce8ae3e95 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:49.674467 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 192/376] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:49.676256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21a846-2725-4b0e-b53a-52cce8ae3e95 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:49.750938 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bd564-bb64-4605-b5c7-e935666cd3bd None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:49.770176 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:49.825230 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21a846-2725-4b0e-b53a-52cce8ae3e95 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:49.843119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d65e4a-6f29-4413-b8da-c552acf76993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:49.846910 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d65e4a-6f29-4413-b8da-c552acf76993 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:49.847688 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d65e4a-6f29-4413-b8da-c552acf76993 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:49.849007 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d65e4a-6f29-4413-b8da-c552acf76993 None admin] PATH_INFO: `/v3/projects/660126a36fe74ee0b2c60ecb51c62269` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:49.851546 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d65e4a-6f29-4413-b8da-c552acf76993 None admin] RBAC: Authorizing `identity:get_project(project_id=660126a36fe74ee0b2c60ecb51c62269)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:49.854770 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d65e4a-6f29-4413-b8da-c552acf76993 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:49.859143 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 185/377] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:49 2022] GET /identity/v3/projects/660126a36fe74ee0b2c60ecb51c62269 => generated 302 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:14:49.862806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708be53-3803-4607-8e23-e3dbe24ff736 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:49.863550 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708be53-3803-4607-8e23-e3dbe24ff736 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:49.865021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708be53-3803-4607-8e23-e3dbe24ff736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:49.883694 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cb2f9-b2a7-471c-b5f3-39f41b293334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:49.884461 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cb2f9-b2a7-471c-b5f3-39f41b293334 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:49.884746 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cb2f9-b2a7-471c-b5f3-39f41b293334 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:49.885018 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cb2f9-b2a7-471c-b5f3-39f41b293334 None admin] PATH_INFO: `/v3/groups/9dcd7dc3757c4719bae3a035f339015e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:49.894142 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cb2f9-b2a7-471c-b5f3-39f41b293334 None admin] RBAC: Authorizing `identity:get_group(group_id=9dcd7dc3757c4719bae3a035f339015e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:49.895886 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cb2f9-b2a7-471c-b5f3-39f41b293334 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:49.898192 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 193/378] 10.222.0.62 () {56 vars in 1180 bytes} [Tue Oct 4 14:14:49 2022] GET /identity/v3/groups/9dcd7dc3757c4719bae3a035f339015e => generated 229 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:49.899062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cb2f9-b2a7-471c-b5f3-39f41b293334 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:49.911745 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-b708be53-3803-4607-8e23-e3dbe24ff736 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:49.915321 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b708be53-3803-4607-8e23-e3dbe24ff736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:50.045467 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cb2f9-b2a7-471c-b5f3-39f41b293334 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:50.081974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:50.100821 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 186/379] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:50.103347 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708be53-3803-4607-8e23-e3dbe24ff736 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:50.104844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868666ab-b155-4aa2-be9e-298cd7f34c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:50.105517 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868666ab-b155-4aa2-be9e-298cd7f34c9e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:50.105792 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868666ab-b155-4aa2-be9e-298cd7f34c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:50.106052 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868666ab-b155-4aa2-be9e-298cd7f34c9e None admin] PATH_INFO: `/v3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:50.107371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868666ab-b155-4aa2-be9e-298cd7f34c9e None admin] RBAC: Authorizing `identity:get_group(group_id=259e3ab57d9e4c2dbb5cc6e5fccf5aed)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:50.108912 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868666ab-b155-4aa2-be9e-298cd7f34c9e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:50.119914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 194/380] 10.222.0.62 () {56 vars in 1180 bytes} [Tue Oct 4 14:14:49 2022] GET /identity/v3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:50.121792 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868666ab-b155-4aa2-be9e-298cd7f34c9e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:50.160597 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:50.356994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708be53-3803-4607-8e23-e3dbe24ff736 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:50.393104 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868666ab-b155-4aa2-be9e-298cd7f34c9e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:50.431245 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24b93b-6175-459b-995c-9b472938a1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:50.433117 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24b93b-6175-459b-995c-9b472938a1f7 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:50.433943 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24b93b-6175-459b-995c-9b472938a1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:50.434697 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24b93b-6175-459b-995c-9b472938a1f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:50.436756 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24b93b-6175-459b-995c-9b472938a1f7 None admin] RBAC: Adding query filter params (group.id=9dcd7dc3757c4719bae3a035f339015e, role.id=a16b6daeda5b4a67992f3c12514ca90e, scope.project.id=d6e81a80a6484baf89f76501cdc63799) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:50.437622 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24b93b-6175-459b-995c-9b472938a1f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:50.442097 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24b93b-6175-459b-995c-9b472938a1f7 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:50.442963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566a86d-6cad-4a11-b3d1-af03c124c3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:50.443789 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566a86d-6cad-4a11-b3d1-af03c124c3b9 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:50.444215 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566a86d-6cad-4a11-b3d1-af03c124c3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:50.444629 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566a86d-6cad-4a11-b3d1-af03c124c3b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:50.445515 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566a86d-6cad-4a11-b3d1-af03c124c3b9 None admin] RBAC: Adding query filter params (group.id=259e3ab57d9e4c2dbb5cc6e5fccf5aed, role.id=c3d8f302f6714108ac91c25b8a32d36b, scope.project.id=660126a36fe74ee0b2c60ecb51c62269) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:50.445991 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566a86d-6cad-4a11-b3d1-af03c124c3b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:50.447760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566a86d-6cad-4a11-b3d1-af03c124c3b9 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:50.459757 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 187/381] 10.222.0.62 () {56 vars in 1376 bytes} [Tue Oct 4 14:14:50 2022] GET /identity/v3/role_assignments?group.id=9dcd7dc3757c4719bae3a035f339015e&scope.project.id=d6e81a80a6484baf89f76501cdc63799&role.id=a16b6daeda5b4a67992f3c12514ca90e => generated 260 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:50.459757 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271a21c-6831-4986-a06f-0c95065a0f97 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:50.459757 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271a21c-6831-4986-a06f-0c95065a0f97 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:50.459757 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271a21c-6831-4986-a06f-0c95065a0f97 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:50.460850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 195/382] 10.222.0.62 () {56 vars in 1376 bytes} [Tue Oct 4 14:14:50 2022] GET /identity/v3/role_assignments?group.id=259e3ab57d9e4c2dbb5cc6e5fccf5aed&scope.project.id=660126a36fe74ee0b2c60ecb51c62269&role.id=c3d8f302f6714108ac91c25b8a32d36b => generated 260 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:50.462676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 188/383] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:50.478976 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f73e11-6715-4a43-9465-ffa1a63252bb None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:50.479507 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f73e11-6715-4a43-9465-ffa1a63252bb None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:50.480249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f73e11-6715-4a43-9465-ffa1a63252bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:50.503336 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271a21c-6831-4986-a06f-0c95065a0f97 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:50.511492 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-30f73e11-6715-4a43-9465-ffa1a63252bb None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:50.513407 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-30f73e11-6715-4a43-9465-ffa1a63252bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:50.643225 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:50.678150 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 196/384] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 14:14:50.739925 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:50.769879 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271a21c-6831-4986-a06f-0c95065a0f97 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:50.828621 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ab3db-fda9-49b3-97df-2dcaff61585b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:50.830717 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ab3db-fda9-49b3-97df-2dcaff61585b None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:50.831018 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ab3db-fda9-49b3-97df-2dcaff61585b None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:50.831268 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ab3db-fda9-49b3-97df-2dcaff61585b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:50.848274 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ab3db-fda9-49b3-97df-2dcaff61585b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:50.853699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-278ab3db-fda9-49b3-97df-2dcaff61585b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:50.853699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:50.853699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:50.853699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:50.853699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:50.853699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:50.853699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:50.853699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:50.853699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:50.853699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:50.853699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:50.853699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:50.853699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:50.853699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:50.853699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:50.853699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:50.855426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:50.855426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:50.855426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:50.855426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:50.855426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:50.855426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:50.855426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:50.855426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:50.855426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:50.855426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:50.855426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:50.855426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:50.855426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:50.855426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:50.855426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:50.855426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:50.857064 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:50.857064 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:50.857064 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:50.857064 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:50.857064 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:50.857064 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:50.857064 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:50.857064 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:50.857064 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:50.857064 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:50.857064 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:50.857064 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:14:50.857064 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 189/385] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:50.862754 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f73e11-6715-4a43-9465-ffa1a63252bb None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:51.005175 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f73e11-6715-4a43-9465-ffa1a63252bb None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:51.053003 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba78fa3-ebbf-4d9e-86f4-cccdfda32364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:51.054000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba78fa3-ebbf-4d9e-86f4-cccdfda32364 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:51.054000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba78fa3-ebbf-4d9e-86f4-cccdfda32364 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:51.054254 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba78fa3-ebbf-4d9e-86f4-cccdfda32364 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:51.054857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba78fa3-ebbf-4d9e-86f4-cccdfda32364 None admin] RBAC: Adding query filter params (name=member) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:51.055158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba78fa3-ebbf-4d9e-86f4-cccdfda32364 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:51.056667 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba78fa3-ebbf-4d9e-86f4-cccdfda32364 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:51.068554 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 197/386] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:14:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:51.077037 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ab3db-fda9-49b3-97df-2dcaff61585b None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:51.234341 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ab3db-fda9-49b3-97df-2dcaff61585b None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:51.277394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6f1f1-0c23-4902-8013-d60c00cc2f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:51.277947 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6f1f1-0c23-4902-8013-d60c00cc2f47 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:51.278314 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6f1f1-0c23-4902-8013-d60c00cc2f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:51.278570 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6f1f1-0c23-4902-8013-d60c00cc2f47 None admin] PATH_INFO: `/v3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:51.279669 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6f1f1-0c23-4902-8013-d60c00cc2f47 None admin] RBAC: Authorizing `identity:get_group(group_id=259e3ab57d9e4c2dbb5cc6e5fccf5aed)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:51.281275 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6f1f1-0c23-4902-8013-d60c00cc2f47 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:51.284133 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 190/387] 10.222.0.62 () {56 vars in 1180 bytes} [Tue Oct 4 14:14:51 2022] GET /identity/v3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:51.291201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba78fa3-ebbf-4d9e-86f4-cccdfda32364 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:51.293026 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6f1f1-0c23-4902-8013-d60c00cc2f47 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:51.306221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:51.429130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:51.463686 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6f1f1-0c23-4902-8013-d60c00cc2f47 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:51.512214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed28cf-26fc-492c-b7bb-6d97b381f2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:51.512924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed28cf-26fc-492c-b7bb-6d97b381f2de None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:51.513204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed28cf-26fc-492c-b7bb-6d97b381f2de None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:51.513473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed28cf-26fc-492c-b7bb-6d97b381f2de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:51.540526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed28cf-26fc-492c-b7bb-6d97b381f2de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:51.548196 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba78fa3-ebbf-4d9e-86f4-cccdfda32364 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:51.553871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-f6ed28cf-26fc-492c-b7bb-6d97b381f2de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:14:51.553871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:51.553871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:51.553871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:51.553871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:51.553871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:51.553871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:51.553871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:51.553871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:51.553871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:51.553871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:51.553871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:51.553871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:51.553871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:51.553871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:51.553871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:51.555639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:51.555639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:51.555639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:51.555639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:51.555639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:51.555639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:51.555639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:51.555639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:51.555639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:51.555639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:51.555639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:51.555639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:51.555639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:51.555639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:51.555639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:51.555639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:51.557304 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:51.557304 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:51.557304 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:51.557304 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:51.557304 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:51.557304 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:51.557304 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:51.557304 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:51.557304 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:51.557304 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:51.557304 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:14:51.557304 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:14:51.557304 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 191/388] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Oct 4 14:14:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:51.561113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed28cf-26fc-492c-b7bb-6d97b381f2de None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:51.635057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5008b-9189-4566-87fb-4425bdd9d473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:51.635738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5008b-9189-4566-87fb-4425bdd9d473 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:51.636018 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5008b-9189-4566-87fb-4425bdd9d473 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:51.639129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5008b-9189-4566-87fb-4425bdd9d473 None admin] PATH_INFO: `/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:51.640530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5008b-9189-4566-87fb-4425bdd9d473 None admin] RBAC: Authorizing `identity:get_project(project_id=0c72ec4a5e6f40ac84de3c903eedf1d3)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:51.642171 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5008b-9189-4566-87fb-4425bdd9d473 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:51.650210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 198/389] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:51 2022] GET /identity/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3 => generated 298 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:51.656451 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5008b-9189-4566-87fb-4425bdd9d473 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:51.727610 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:51.827166 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed28cf-26fc-492c-b7bb-6d97b381f2de None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:51.852188 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5008b-9189-4566-87fb-4425bdd9d473 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:51.895267 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32210d04-d6b4-4647-849e-650853ebf07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:51.895923 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32210d04-d6b4-4647-849e-650853ebf07b None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:51.896205 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32210d04-d6b4-4647-849e-650853ebf07b None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:51.896479 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32210d04-d6b4-4647-849e-650853ebf07b None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:51.897176 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32210d04-d6b4-4647-849e-650853ebf07b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:51.897483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32210d04-d6b4-4647-849e-650853ebf07b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:51.899029 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32210d04-d6b4-4647-849e-650853ebf07b None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:51.913768 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 192/390] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:14:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:51.915177 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32210d04-d6b4-4647-849e-650853ebf07b None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:51.917064 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:51.977777 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68ca9a-f301-47d8-86d7-a4b4c1c2ff4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:51.978468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68ca9a-f301-47d8-86d7-a4b4c1c2ff4c None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:51.978887 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68ca9a-f301-47d8-86d7-a4b4c1c2ff4c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:51.979172 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68ca9a-f301-47d8-86d7-a4b4c1c2ff4c None admin] PATH_INFO: `/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:51.986150 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68ca9a-f301-47d8-86d7-a4b4c1c2ff4c None admin] RBAC: Authorizing `identity:create_grant(project_id=0c72ec4a5e6f40ac84de3c903eedf1d3, group_id=259e3ab57d9e4c2dbb5cc6e5fccf5aed, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:51.987749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68ca9a-f301-47d8-86d7-a4b4c1c2ff4c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:52.026027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 199/391] 10.222.0.62 () {58 vars in 1442 bytes} [Tue Oct 4 14:14:51 2022] PUT /identity/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:14:52.046361 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32210d04-d6b4-4647-849e-650853ebf07b None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:52.088248 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:52.095303 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43046b15-32e6-49fe-8f79-b002bb2a0e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:52.096201 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43046b15-32e6-49fe-8f79-b002bb2a0e69 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:52.096501 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43046b15-32e6-49fe-8f79-b002bb2a0e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:52.096767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43046b15-32e6-49fe-8f79-b002bb2a0e69 None admin] PATH_INFO: `/v3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:52.098377 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43046b15-32e6-49fe-8f79-b002bb2a0e69 None admin] RBAC: Authorizing `identity:get_group(group_id=259e3ab57d9e4c2dbb5cc6e5fccf5aed)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:52.100006 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43046b15-32e6-49fe-8f79-b002bb2a0e69 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:52.105285 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 193/392] 10.222.0.62 () {56 vars in 1180 bytes} [Tue Oct 4 14:14:51 2022] GET /identity/v3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:52.108575 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68ca9a-f301-47d8-86d7-a4b4c1c2ff4c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:52.277034 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68ca9a-f301-47d8-86d7-a4b4c1c2ff4c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:52.337333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d33898-7841-42fc-b6df-01d80439045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:52.337991 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d33898-7841-42fc-b6df-01d80439045c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:52.338341 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d33898-7841-42fc-b6df-01d80439045c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:52.338526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d33898-7841-42fc-b6df-01d80439045c None admin] PATH_INFO: `/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:52.339815 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d33898-7841-42fc-b6df-01d80439045c None admin] RBAC: Authorizing `identity:get_project(project_id=0c72ec4a5e6f40ac84de3c903eedf1d3)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:52.341376 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d33898-7841-42fc-b6df-01d80439045c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:52.345117 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 200/393] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:52 2022] GET /identity/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:14:52.350344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43046b15-32e6-49fe-8f79-b002bb2a0e69 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:52.378007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aff5b7-dfb1-419e-8a16-fa8fb0b42c49 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:52.378265 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aff5b7-dfb1-419e-8a16-fa8fb0b42c49 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:52.378590 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aff5b7-dfb1-419e-8a16-fa8fb0b42c49 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:52.381299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 201/394] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:52.389776 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7f2f8-addb-4073-98df-2118b36cc34a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:52.390191 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7f2f8-addb-4073-98df-2118b36cc34a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:52.390473 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7f2f8-addb-4073-98df-2118b36cc34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:52.414868 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-92e7f2f8-addb-4073-98df-2118b36cc34a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:52.416213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-92e7f2f8-addb-4073-98df-2118b36cc34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:52.487674 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:52.488201 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43046b15-32e6-49fe-8f79-b002bb2a0e69 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:52.533470 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53599199-52b0-4b8e-a95c-77b0afa3c5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:52.534316 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53599199-52b0-4b8e-a95c-77b0afa3c5b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:52.534602 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53599199-52b0-4b8e-a95c-77b0afa3c5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:52.534883 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53599199-52b0-4b8e-a95c-77b0afa3c5b6 None admin] PATH_INFO: `/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed/roles/c3d8f302f6714108ac91c25b8a32d36b` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:52.539687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53599199-52b0-4b8e-a95c-77b0afa3c5b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c72ec4a5e6f40ac84de3c903eedf1d3, group_id=259e3ab57d9e4c2dbb5cc6e5fccf5aed, role_id=c3d8f302f6714108ac91c25b8a32d36b)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:52.539687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53599199-52b0-4b8e-a95c-77b0afa3c5b6 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:52.560515 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 194/395] 10.222.0.62 () {58 vars in 1442 bytes} [Tue Oct 4 14:14:52 2022] PUT /identity/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed/roles/c3d8f302f6714108ac91c25b8a32d36b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:14:52.568843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 202/396] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 14:14:52.897310 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53599199-52b0-4b8e-a95c-77b0afa3c5b6 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:52.969937 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:53.027989 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53599199-52b0-4b8e-a95c-77b0afa3c5b6 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:53.088619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4672243-152c-4b6a-9e47-4ebfb7ed4e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:53.090136 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4672243-152c-4b6a-9e47-4ebfb7ed4e0d None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:53.090136 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4672243-152c-4b6a-9e47-4ebfb7ed4e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:53.090136 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4672243-152c-4b6a-9e47-4ebfb7ed4e0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:53.107387 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4672243-152c-4b6a-9e47-4ebfb7ed4e0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:53.113974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-c4672243-152c-4b6a-9e47-4ebfb7ed4e0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:53.113974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:53.113974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:53.113974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:53.113974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:53.113974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:53.113974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:53.113974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:53.113974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:53.113974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:53.113974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:53.113974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:53.113974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:53.113974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:53.113974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:53.113974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:53.115027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:53.115027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:53.115027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:53.115027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:53.115027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:53.115027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:53.115027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:53.115027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:53.115027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:53.115027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:53.115027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:53.115027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:53.115027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:53.115027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:53.115027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:53.115027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:53.115924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:53.115924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:53.115924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:53.115924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:53.115924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:53.115924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:53.115924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:53.115924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:53.115924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:53.115924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:53.115924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:53.115924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:14:53.119197 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 195/397] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:53.121860 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7f2f8-addb-4073-98df-2118b36cc34a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:53.351774 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7f2f8-addb-4073-98df-2118b36cc34a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:53.419019 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e42ae6-0bad-4642-8164-e9ea739564eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:53.419662 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e42ae6-0bad-4642-8164-e9ea739564eb None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:53.419965 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e42ae6-0bad-4642-8164-e9ea739564eb None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:53.420420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e42ae6-0bad-4642-8164-e9ea739564eb None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:53.421018 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e42ae6-0bad-4642-8164-e9ea739564eb None admin] RBAC: Adding query filter params (name=member) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:53.421321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e42ae6-0bad-4642-8164-e9ea739564eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:53.423812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e42ae6-0bad-4642-8164-e9ea739564eb None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:53.434571 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 203/398] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:14:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:53.440897 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4672243-152c-4b6a-9e47-4ebfb7ed4e0d None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:53.603984 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4672243-152c-4b6a-9e47-4ebfb7ed4e0d None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:53.629483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:53.663950 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a7362-e362-4a64-8bcd-9f09e40b326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:53.665002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a7362-e362-4a64-8bcd-9f09e40b326f None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:53.665461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a7362-e362-4a64-8bcd-9f09e40b326f None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:53.665922 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a7362-e362-4a64-8bcd-9f09e40b326f None admin] PATH_INFO: `/v3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:53.668006 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a7362-e362-4a64-8bcd-9f09e40b326f None admin] RBAC: Authorizing `identity:get_group(group_id=259e3ab57d9e4c2dbb5cc6e5fccf5aed)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:53.670819 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a7362-e362-4a64-8bcd-9f09e40b326f None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:53.679039 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 196/399] 10.222.0.62 () {56 vars in 1180 bytes} [Tue Oct 4 14:14:53 2022] GET /identity/v3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:14:53.684604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e42ae6-0bad-4642-8164-e9ea739564eb None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:53.796170 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:53.918868 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e42ae6-0bad-4642-8164-e9ea739564eb None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:53.925525 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fd42a-5122-4cb7-9e86-31d77b8a379a None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:53.925853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fd42a-5122-4cb7-9e86-31d77b8a379a None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:53.926139 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fd42a-5122-4cb7-9e86-31d77b8a379a None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:53.927755 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 197/400] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:53.933531 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904d23f-f54d-4c1a-817c-4e286d6a23b7 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:53.933824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904d23f-f54d-4c1a-817c-4e286d6a23b7 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:53.934082 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904d23f-f54d-4c1a-817c-4e286d6a23b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:53.964123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-e904d23f-f54d-4c1a-817c-4e286d6a23b7 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:53.965393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e904d23f-f54d-4c1a-817c-4e286d6a23b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:54.017717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe2ac0-09ec-499b-a6ef-ee10995fb6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:54.018814 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe2ac0-09ec-499b-a6ef-ee10995fb6a6 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:54.019314 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe2ac0-09ec-499b-a6ef-ee10995fb6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:54.019860 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe2ac0-09ec-499b-a6ef-ee10995fb6a6 None admin] PATH_INFO: `/v3/projects/660126a36fe74ee0b2c60ecb51c62269` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:54.021588 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe2ac0-09ec-499b-a6ef-ee10995fb6a6 None admin] RBAC: Authorizing `identity:get_project(project_id=660126a36fe74ee0b2c60ecb51c62269)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:54.023371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe2ac0-09ec-499b-a6ef-ee10995fb6a6 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:54.028337 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 204/401] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:53 2022] GET /identity/v3/projects/660126a36fe74ee0b2c60ecb51c62269 => generated 302 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:54.038748 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe2ac0-09ec-499b-a6ef-ee10995fb6a6 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:54.120601 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 198/402] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 14:14:54.236606 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe2ac0-09ec-499b-a6ef-ee10995fb6a6 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:54.252051 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:54.293382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e84bf5-8d3b-41f3-8407-0e88482fd35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:54.294084 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e84bf5-8d3b-41f3-8407-0e88482fd35f None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:54.294363 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e84bf5-8d3b-41f3-8407-0e88482fd35f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:54.294640 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e84bf5-8d3b-41f3-8407-0e88482fd35f None admin] PATH_INFO: `/v3/projects/660126a36fe74ee0b2c60ecb51c62269/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:54.298120 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e84bf5-8d3b-41f3-8407-0e88482fd35f None admin] RBAC: Authorizing `identity:create_grant(project_id=660126a36fe74ee0b2c60ecb51c62269, group_id=259e3ab57d9e4c2dbb5cc6e5fccf5aed, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:54.301067 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e84bf5-8d3b-41f3-8407-0e88482fd35f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:54.339162 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 205/403] 10.222.0.62 () {58 vars in 1442 bytes} [Tue Oct 4 14:14:54 2022] PUT /identity/v3/projects/660126a36fe74ee0b2c60ecb51c62269/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:14:54.427272 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858de54-d47f-4913-9911-5274ce9b1a61 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:54.427569 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858de54-d47f-4913-9911-5274ce9b1a61 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:54.427840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858de54-d47f-4913-9911-5274ce9b1a61 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:54.429667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 199/404] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:54.442264 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5425a5-2131-491b-8add-b222072b1b1f None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:54.442742 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5425a5-2131-491b-8add-b222072b1b1f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:54.443200 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5425a5-2131-491b-8add-b222072b1b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:54.481045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858de54-d47f-4913-9911-5274ce9b1a61 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:54.484176 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ee5425a5-2131-491b-8add-b222072b1b1f None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:54.490322 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ee5425a5-2131-491b-8add-b222072b1b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:54.683140 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858de54-d47f-4913-9911-5274ce9b1a61 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:54.702955 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:54.711912 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 206/405] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:54.728418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081162ef-9b8f-41af-a809-f230c2cd0a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:54.729071 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081162ef-9b8f-41af-a809-f230c2cd0a4e None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:54.729368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081162ef-9b8f-41af-a809-f230c2cd0a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:54.729610 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081162ef-9b8f-41af-a809-f230c2cd0a4e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:54.744829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081162ef-9b8f-41af-a809-f230c2cd0a4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:54.749789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-081162ef-9b8f-41af-a809-f230c2cd0a4e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:14:54.749789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:54.749789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:54.749789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:54.749789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:54.749789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:54.749789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:54.749789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:54.749789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:54.749789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:54.749789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:54.749789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:54.749789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:54.749789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:54.749789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:54.749789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:54.753866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:54.753866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:54.753866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:54.753866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:54.753866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:54.753866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:54.753866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:54.753866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:54.753866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:54.753866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:54.753866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:54.753866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:54.753866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:54.753866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:54.753866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:54.753866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:54.757944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:54.757944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:54.757944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:54.757944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:54.757944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:54.757944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:54.757944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:54.757944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:54.757944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:54.757944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:54.757944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:14:54.757944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:14:54.757944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 200/406] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Oct 4 14:14:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:54.762598 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5425a5-2131-491b-8add-b222072b1b1f None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:54.940823 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:54.945435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5425a5-2131-491b-8add-b222072b1b1f None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:54.985722 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37f8e7-741f-4dbd-8253-e0570ddc47dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:54.986349 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37f8e7-741f-4dbd-8253-e0570ddc47dc None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:54.986624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37f8e7-741f-4dbd-8253-e0570ddc47dc None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:54.986890 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37f8e7-741f-4dbd-8253-e0570ddc47dc None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:54.987577 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37f8e7-741f-4dbd-8253-e0570ddc47dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:54.987899 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37f8e7-741f-4dbd-8253-e0570ddc47dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:54.989283 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37f8e7-741f-4dbd-8253-e0570ddc47dc None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:54.999581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 207/407] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:14:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:55.004936 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081162ef-9b8f-41af-a809-f230c2cd0a4e None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:55.099331 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37f8e7-741f-4dbd-8253-e0570ddc47dc None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:55.218500 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081162ef-9b8f-41af-a809-f230c2cd0a4e None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:55.315526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979b810-b071-4e90-88ca-10d943770980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:55.316124 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979b810-b071-4e90-88ca-10d943770980 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:55.316403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979b810-b071-4e90-88ca-10d943770980 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:55.316672 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979b810-b071-4e90-88ca-10d943770980 None admin] PATH_INFO: `/v3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:55.319379 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979b810-b071-4e90-88ca-10d943770980 None admin] RBAC: Authorizing `identity:get_group(group_id=259e3ab57d9e4c2dbb5cc6e5fccf5aed)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:55.320889 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979b810-b071-4e90-88ca-10d943770980 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:55.322892 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 201/408] 10.222.0.62 () {56 vars in 1180 bytes} [Tue Oct 4 14:14:55 2022] GET /identity/v3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed => generated 226 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:14:55.329428 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979b810-b071-4e90-88ca-10d943770980 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:55.379642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37f8e7-741f-4dbd-8253-e0570ddc47dc None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:55.451442 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:55.453158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4dea1-72d0-497f-a9b0-07a995e70a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:55.454985 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4dea1-72d0-497f-a9b0-07a995e70a56 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:55.457905 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4dea1-72d0-497f-a9b0-07a995e70a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:55.458253 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4dea1-72d0-497f-a9b0-07a995e70a56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:55.493513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4dea1-72d0-497f-a9b0-07a995e70a56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:55.504047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-b7d4dea1-72d0-497f-a9b0-07a995e70a56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:14:55.504047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:55.504047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:55.504047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:55.504047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:55.504047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:55.504047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:55.504047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:55.504047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:55.504047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:55.504047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:55.504047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:55.504047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:55.504047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:55.504047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:55.504047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:55.505073 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:55.505073 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:55.505073 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:55.505073 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:55.505073 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:55.505073 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:55.505073 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:55.505073 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:55.505073 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:55.505073 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:55.505073 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:55.505073 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:55.505073 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:55.505073 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:55.505073 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:55.505073 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:55.505880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:55.505880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:55.505880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:55.505880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:55.505880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:55.505880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:55.505880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:55.505880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:55.505880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:55.505880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:55.505880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:14:55.505880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:14:55.507171 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 208/409] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:14:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:14:55.517439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4dea1-72d0-497f-a9b0-07a995e70a56 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:55.580794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:55.600232 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979b810-b071-4e90-88ca-10d943770980 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:55.667376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be4862-5a6e-470b-ac32-e95ba91f091c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:55.669512 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be4862-5a6e-470b-ac32-e95ba91f091c None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:55.670339 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be4862-5a6e-470b-ac32-e95ba91f091c None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:55.675073 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be4862-5a6e-470b-ac32-e95ba91f091c None admin] PATH_INFO: `/v3/projects/660126a36fe74ee0b2c60ecb51c62269` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:55.677088 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be4862-5a6e-470b-ac32-e95ba91f091c None admin] RBAC: Authorizing `identity:get_project(project_id=660126a36fe74ee0b2c60ecb51c62269)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:55.678944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be4862-5a6e-470b-ac32-e95ba91f091c None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:55.684968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 202/410] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:55 2022] GET /identity/v3/projects/660126a36fe74ee0b2c60ecb51c62269 => generated 302 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:55.691262 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be4862-5a6e-470b-ac32-e95ba91f091c None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:55.818829 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4dea1-72d0-497f-a9b0-07a995e70a56 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:55.899971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d57c9b-5cc9-4be7-b031-ddd7e43d68f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:55.900658 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d57c9b-5cc9-4be7-b031-ddd7e43d68f7 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:55.901006 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d57c9b-5cc9-4be7-b031-ddd7e43d68f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:55.901555 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d57c9b-5cc9-4be7-b031-ddd7e43d68f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:55.902271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d57c9b-5cc9-4be7-b031-ddd7e43d68f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:55.902576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d57c9b-5cc9-4be7-b031-ddd7e43d68f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:55.904311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d57c9b-5cc9-4be7-b031-ddd7e43d68f7 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:55.919206 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 209/411] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:55.919206 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2410e-9b26-4630-aea5-9147a6795d38 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:55.919206 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2410e-9b26-4630-aea5-9147a6795d38 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:55.919206 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2410e-9b26-4630-aea5-9147a6795d38 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:55.919206 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 210/412] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:55.920318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dd0ba-efb8-4dc8-972b-7516d288f384 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:55.920601 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dd0ba-efb8-4dc8-972b-7516d288f384 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:55.920873 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dd0ba-efb8-4dc8-972b-7516d288f384 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:55.923852 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 211/413] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:55.927156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056dd0ba-efb8-4dc8-972b-7516d288f384 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:55.951879 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be4862-5a6e-470b-ac32-e95ba91f091c None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:55.975744 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:56.008222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05474e-09aa-4d31-b18e-bf7898228508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:56.009203 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05474e-09aa-4d31-b18e-bf7898228508 None admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:56.009478 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05474e-09aa-4d31-b18e-bf7898228508 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:56.009753 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05474e-09aa-4d31-b18e-bf7898228508 None admin] PATH_INFO: `/v3/projects/660126a36fe74ee0b2c60ecb51c62269/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed/roles/c3d8f302f6714108ac91c25b8a32d36b` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:56.012350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05474e-09aa-4d31-b18e-bf7898228508 None admin] RBAC: Authorizing `identity:create_grant(project_id=660126a36fe74ee0b2c60ecb51c62269, group_id=259e3ab57d9e4c2dbb5cc6e5fccf5aed, role_id=c3d8f302f6714108ac91c25b8a32d36b)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:56.013902 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05474e-09aa-4d31-b18e-bf7898228508 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:56.033077 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 203/414] 10.222.0.62 () {58 vars in 1442 bytes} [Tue Oct 4 14:14:55 2022] PUT /identity/v3/projects/660126a36fe74ee0b2c60ecb51c62269/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed/roles/c3d8f302f6714108ac91c25b8a32d36b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:14:56.034550 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7f078-d1a0-4611-b476-d4372e5285e0 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:56.034815 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7f078-d1a0-4611-b476-d4372e5285e0 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:56.035099 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7f078-d1a0-4611-b476-d4372e5285e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:56.070701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-11e7f078-d1a0-4611-b476-d4372e5285e0 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:56.072737 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-11e7f078-d1a0-4611-b476-d4372e5285e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:56.089973 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:56.119332 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056dd0ba-efb8-4dc8-972b-7516d288f384 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:56.169962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f03123-8943-4d56-9e3c-e8abc41cf500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:56.170723 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f03123-8943-4d56-9e3c-e8abc41cf500 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:56.171208 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f03123-8943-4d56-9e3c-e8abc41cf500 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:56.171581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f03123-8943-4d56-9e3c-e8abc41cf500 None admin] PATH_INFO: `/v3/groups/9dcd7dc3757c4719bae3a035f339015e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:56.173870 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f03123-8943-4d56-9e3c-e8abc41cf500 None admin] RBAC: Authorizing `identity:get_group(group_id=9dcd7dc3757c4719bae3a035f339015e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:56.176053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f03123-8943-4d56-9e3c-e8abc41cf500 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:56.183756 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 212/415] 10.222.0.62 () {56 vars in 1180 bytes} [Tue Oct 4 14:14:55 2022] GET /identity/v3/groups/9dcd7dc3757c4719bae3a035f339015e => generated 229 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:56.183756 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea73e77-3149-47dd-8d17-1a7108b9c77c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:56.183756 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea73e77-3149-47dd-8d17-1a7108b9c77c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:56.183756 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea73e77-3149-47dd-8d17-1a7108b9c77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:56.203620 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-fea73e77-3149-47dd-8d17-1a7108b9c77c None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:56.205127 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-fea73e77-3149-47dd-8d17-1a7108b9c77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:56.232607 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 204/416] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:56.235414 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7f078-d1a0-4611-b476-d4372e5285e0 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:56.296449 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 213/417] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:56.465053 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7f078-d1a0-4611-b476-d4372e5285e0 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:56.467369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:56.523666 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521fc30-2de3-49b4-8f56-837593d0e3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:56.524396 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521fc30-2de3-49b4-8f56-837593d0e3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:56.524707 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521fc30-2de3-49b4-8f56-837593d0e3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:56.524931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521fc30-2de3-49b4-8f56-837593d0e3d6 None admin] PATH_INFO: `/v3/projects/d6e81a80a6484baf89f76501cdc63799` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:56.526249 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521fc30-2de3-49b4-8f56-837593d0e3d6 None admin] RBAC: Authorizing `identity:get_project(project_id=d6e81a80a6484baf89f76501cdc63799)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:56.527803 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521fc30-2de3-49b4-8f56-837593d0e3d6 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:56.530095 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 205/418] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:56 2022] GET /identity/v3/projects/d6e81a80a6484baf89f76501cdc63799 => generated 344 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:56.540847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea73e77-3149-47dd-8d17-1a7108b9c77c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:56.699032 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:56.721257 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521fc30-2de3-49b4-8f56-837593d0e3d6 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:56.738236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea73e77-3149-47dd-8d17-1a7108b9c77c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:56.825839 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6915e-2c10-4898-a3fb-896921f7b86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:56.826996 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6915e-2c10-4898-a3fb-896921f7b86d None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:56.827482 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6915e-2c10-4898-a3fb-896921f7b86d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:56.828459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6915e-2c10-4898-a3fb-896921f7b86d None admin] PATH_INFO: `/v3/projects/d6e81a80a6484baf89f76501cdc63799/groups/9dcd7dc3757c4719bae3a035f339015e/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:56.832905 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6915e-2c10-4898-a3fb-896921f7b86d None admin] RBAC: Authorizing `identity:create_grant(project_id=d6e81a80a6484baf89f76501cdc63799, group_id=9dcd7dc3757c4719bae3a035f339015e, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:56.835896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6915e-2c10-4898-a3fb-896921f7b86d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:56.860641 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 214/419] 10.222.0.62 () {58 vars in 1442 bytes} [Tue Oct 4 14:14:56 2022] PUT /identity/v3/projects/d6e81a80a6484baf89f76501cdc63799/groups/9dcd7dc3757c4719bae3a035f339015e/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:14:56.862689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6915e-2c10-4898-a3fb-896921f7b86d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:56.893008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521fc30-2de3-49b4-8f56-837593d0e3d6 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:56.974154 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c981b50-b569-4b38-af46-021f39267efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:56.975106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c981b50-b569-4b38-af46-021f39267efd None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:56.975664 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c981b50-b569-4b38-af46-021f39267efd None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:56.976195 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c981b50-b569-4b38-af46-021f39267efd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:57.038414 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c981b50-b569-4b38-af46-021f39267efd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:57.061284 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-6c981b50-b569-4b38-af46-021f39267efd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:57.061284 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:57.061284 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:57.061284 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:57.061284 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:57.061284 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:57.061284 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:57.061284 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:57.061284 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:57.061284 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:57.061284 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:57.061284 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:57.061284 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:57.061284 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:57.061284 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:57.061284 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:57.064041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:57.064041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:57.064041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:57.064041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:57.064041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:57.064041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:57.064041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:57.064041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:57.064041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:57.064041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:57.064041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:57.064041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:57.064041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:57.064041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:57.064041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:57.064041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:57.065703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:57.065703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:57.065703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:57.065703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:57.065703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:57.065703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:57.065703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:57.065703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:57.065703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:57.065703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:57.065703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:57.065703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:14:57.070636 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 206/420] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:57.088584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c981b50-b569-4b38-af46-021f39267efd None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:57.146224 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6915e-2c10-4898-a3fb-896921f7b86d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:57.191567 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:57.219230 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107aa212-78b3-4094-bd28-2c2cf4bab762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:57.220355 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107aa212-78b3-4094-bd28-2c2cf4bab762 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:57.220938 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107aa212-78b3-4094-bd28-2c2cf4bab762 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:57.221416 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107aa212-78b3-4094-bd28-2c2cf4bab762 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:57.238997 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:57.246172 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107aa212-78b3-4094-bd28-2c2cf4bab762 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:57.260091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-107aa212-78b3-4094-bd28-2c2cf4bab762 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:14:57.260091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:57.260091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:57.260091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:57.260091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:57.260091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:57.260091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:57.260091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:57.260091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:57.260091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:57.260091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:57.260091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:57.260091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:57.260091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:57.260091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:57.260091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:57.261514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:57.261514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:57.261514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:57.261514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:57.261514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:57.261514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:57.261514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:57.261514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:57.261514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:57.261514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:57.261514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:57.261514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:57.261514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:57.261514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:57.261514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:57.261514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:57.262531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:57.262531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:57.262531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:57.262531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:57.262531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:57.262531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:57.262531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:57.262531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:57.262531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:57.262531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:57.262531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:14:57.262531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:14:57.263265 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 215/421] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Oct 4 14:14:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:57.274307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107aa212-78b3-4094-bd28-2c2cf4bab762 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:57.384872 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c981b50-b569-4b38-af46-021f39267efd None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:57.521082 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199313f-7d6e-4c52-be0e-0f339c90cc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:57.522062 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199313f-7d6e-4c52-be0e-0f339c90cc11 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:57.522548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199313f-7d6e-4c52-be0e-0f339c90cc11 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:57.523023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199313f-7d6e-4c52-be0e-0f339c90cc11 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:57.524298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199313f-7d6e-4c52-be0e-0f339c90cc11 None admin] RBAC: Adding query filter params (name=member) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:57.524832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199313f-7d6e-4c52-be0e-0f339c90cc11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:57.527656 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199313f-7d6e-4c52-be0e-0f339c90cc11 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:57.571755 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 207/422] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:14:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:14:57.585771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199313f-7d6e-4c52-be0e-0f339c90cc11 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:57.655538 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107aa212-78b3-4094-bd28-2c2cf4bab762 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:57.770886 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383e996-ae4c-4ac5-99bf-0568f11387c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:57.772013 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383e996-ae4c-4ac5-99bf-0568f11387c6 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:57.772395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383e996-ae4c-4ac5-99bf-0568f11387c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:57.772804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383e996-ae4c-4ac5-99bf-0568f11387c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:57.773888 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383e996-ae4c-4ac5-99bf-0568f11387c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:57.774426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383e996-ae4c-4ac5-99bf-0568f11387c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:57.783358 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383e996-ae4c-4ac5-99bf-0568f11387c6 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:57.809269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 216/423] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:14:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 535 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:57.817172 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383e996-ae4c-4ac5-99bf-0568f11387c6 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:57.929697 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:57.970501 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199313f-7d6e-4c52-be0e-0f339c90cc11 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:58.048426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:58.083572 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b4e3a-25a6-42dc-9e2a-e95ca2e4d3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:58.084452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b4e3a-25a6-42dc-9e2a-e95ca2e4d3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:58.084739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b4e3a-25a6-42dc-9e2a-e95ca2e4d3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:58.085005 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b4e3a-25a6-42dc-9e2a-e95ca2e4d3e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:58.122799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383e996-ae4c-4ac5-99bf-0568f11387c6 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:58.184732 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b4e3a-25a6-42dc-9e2a-e95ca2e4d3e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:58.185841 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a8875-949c-4d4b-a17b-1adf80e3372d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:58.186832 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a8875-949c-4d4b-a17b-1adf80e3372d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:58.187166 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b4e3a-25a6-42dc-9e2a-e95ca2e4d3e3 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:58.187279 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a8875-949c-4d4b-a17b-1adf80e3372d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:58.188967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a8875-949c-4d4b-a17b-1adf80e3372d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:58.324117 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a8875-949c-4d4b-a17b-1adf80e3372d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:58.327042 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a8875-949c-4d4b-a17b-1adf80e3372d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:58.384157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:58.411883 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 208/424] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:14:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 827 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:14:58.413726 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7b3a1-55fd-4f5b-93a0-0d3e5624ad65 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:58.414290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7b3a1-55fd-4f5b-93a0-0d3e5624ad65 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:58.414758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7b3a1-55fd-4f5b-93a0-0d3e5624ad65 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:58.416379 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 209/425] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:14:58.428775 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7b3a1-55fd-4f5b-93a0-0d3e5624ad65 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:58.429070 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:58.534217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 217/426] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:14:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 14:14:58.536860 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e09984-f0e2-4c23-a289-033c75d000c4 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:58.537702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e09984-f0e2-4c23-a289-033c75d000c4 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:58.538422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e09984-f0e2-4c23-a289-033c75d000c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:58.575579 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-04e09984-f0e2-4c23-a289-033c75d000c4 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:58.577746 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-04e09984-f0e2-4c23-a289-033c75d000c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:58.634819 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7b3a1-55fd-4f5b-93a0-0d3e5624ad65 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:58.701332 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891da11b-b8e3-4c7f-a1ab-e59c890dbbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:58.702747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891da11b-b8e3-4c7f-a1ab-e59c890dbbea None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:58.703074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891da11b-b8e3-4c7f-a1ab-e59c890dbbea None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:58.704217 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891da11b-b8e3-4c7f-a1ab-e59c890dbbea None admin] PATH_INFO: `/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:58.706393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891da11b-b8e3-4c7f-a1ab-e59c890dbbea None admin] RBAC: Authorizing `identity:get_project(project_id=0c72ec4a5e6f40ac84de3c903eedf1d3)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:58.709171 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891da11b-b8e3-4c7f-a1ab-e59c890dbbea None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:58.720338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 210/427] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:58 2022] GET /identity/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3 => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:58.722219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891da11b-b8e3-4c7f-a1ab-e59c890dbbea None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:58.726554 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 218/428] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:14:58.728902 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e09984-f0e2-4c23-a289-033c75d000c4 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:58.878542 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:58.970916 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:58.992434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891da11b-b8e3-4c7f-a1ab-e59c890dbbea None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:59.002112 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e09984-f0e2-4c23-a289-033c75d000c4 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:59.044461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2212d-76ed-4840-a4f1-007bc95b8308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:59.045116 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2212d-76ed-4840-a4f1-007bc95b8308 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:59.045379 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2212d-76ed-4840-a4f1-007bc95b8308 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:59.045653 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2212d-76ed-4840-a4f1-007bc95b8308 None admin] PATH_INFO: `/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:59.046967 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2212d-76ed-4840-a4f1-007bc95b8308 None admin] RBAC: Authorizing `identity:get_project(project_id=0c72ec4a5e6f40ac84de3c903eedf1d3)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:59.049084 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2212d-76ed-4840-a4f1-007bc95b8308 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:59.051082 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 211/429] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:14:58 2022] GET /identity/v3/projects/0c72ec4a5e6f40ac84de3c903eedf1d3 => generated 298 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:59.056807 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2212d-76ed-4840-a4f1-007bc95b8308 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:59.111283 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa274f-0dbb-4697-bccf-ad72d3cfb917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:59.111964 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa274f-0dbb-4697-bccf-ad72d3cfb917 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:59.112238 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa274f-0dbb-4697-bccf-ad72d3cfb917 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:59.112502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa274f-0dbb-4697-bccf-ad72d3cfb917 None admin] PATH_INFO: `/v3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:59.113844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa274f-0dbb-4697-bccf-ad72d3cfb917 None admin] RBAC: Authorizing `identity:get_group(group_id=259e3ab57d9e4c2dbb5cc6e5fccf5aed)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:59.115276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa274f-0dbb-4697-bccf-ad72d3cfb917 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:59.118110 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 219/430] 10.222.0.62 () {56 vars in 1180 bytes} [Tue Oct 4 14:14:58 2022] GET /identity/v3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed => generated 226 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:59.127211 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa274f-0dbb-4697-bccf-ad72d3cfb917 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:59.285954 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2212d-76ed-4840-a4f1-007bc95b8308 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:59.320141 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa274f-0dbb-4697-bccf-ad72d3cfb917 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:59.344351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:59.357937 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049403f-7e11-4241-b60b-1425776bd509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:59.359209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049403f-7e11-4241-b60b-1425776bd509 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:59.360360 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049403f-7e11-4241-b60b-1425776bd509 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:59.360985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049403f-7e11-4241-b60b-1425776bd509 None admin] PATH_INFO: `/v3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:59.363434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049403f-7e11-4241-b60b-1425776bd509 None admin] RBAC: Authorizing `identity:get_group(group_id=259e3ab57d9e4c2dbb5cc6e5fccf5aed)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:59.363967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac1732-4dc4-48bb-b09c-57883120a365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:59.364786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac1732-4dc4-48bb-b09c-57883120a365 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:59.365152 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac1732-4dc4-48bb-b09c-57883120a365 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:59.365516 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac1732-4dc4-48bb-b09c-57883120a365 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:59.366362 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac1732-4dc4-48bb-b09c-57883120a365 None admin] RBAC: Adding query filter params (group.id=259e3ab57d9e4c2dbb5cc6e5fccf5aed, role.id=eb2435bb443d4469899fb3830f4ee5b1, scope.project.id=0c72ec4a5e6f40ac84de3c903eedf1d3) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:59.366536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049403f-7e11-4241-b60b-1425776bd509 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:59.366846 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac1732-4dc4-48bb-b09c-57883120a365 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:59.368483 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac1732-4dc4-48bb-b09c-57883120a365 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:59.369928 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 212/431] 10.222.0.62 () {56 vars in 1180 bytes} [Tue Oct 4 14:14:59 2022] GET /identity/v3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed => generated 226 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:14:59.371395 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049403f-7e11-4241-b60b-1425776bd509 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:59.381716 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 220/432] 10.222.0.62 () {56 vars in 1376 bytes} [Tue Oct 4 14:14:59 2022] GET /identity/v3/role_assignments?group.id=259e3ab57d9e4c2dbb5cc6e5fccf5aed&scope.project.id=0c72ec4a5e6f40ac84de3c903eedf1d3&role.id=eb2435bb443d4469899fb3830f4ee5b1 => generated 611 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:14:59.382861 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac1732-4dc4-48bb-b09c-57883120a365 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:59.490639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:59.601439 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049403f-7e11-4241-b60b-1425776bd509 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:59.666265 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d704b4-6c39-4e07-9b91-e80772365687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:59.666941 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d704b4-6c39-4e07-9b91-e80772365687 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:59.667220 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d704b4-6c39-4e07-9b91-e80772365687 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:59.667493 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d704b4-6c39-4e07-9b91-e80772365687 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:59.696206 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d704b4-6c39-4e07-9b91-e80772365687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:14:59.709155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-c0d704b4-6c39-4e07-9b91-e80772365687 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:59.709155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:14:59.709155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:14:59.709155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:14:59.709155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:14:59.709155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:14:59.709155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:14:59.709155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:14:59.709155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:14:59.709155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:14:59.709155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:14:59.709155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:14:59.709155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:14:59.709155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:14:59.709155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:14:59.709155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:14:59.710947 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:14:59.710947 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:14:59.710947 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:14:59.710947 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:14:59.710947 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:14:59.710947 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:14:59.710947 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:14:59.710947 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:14:59.710947 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:14:59.710947 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:14:59.710947 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:14:59.710947 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:14:59.710947 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:14:59.710947 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:14:59.710947 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:14:59.710947 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:14:59.712581 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:14:59.712581 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:14:59.712581 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:14:59.712581 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:14:59.712581 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:14:59.712581 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:14:59.712581 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:14:59.712581 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:14:59.712581 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:14:59.712581 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:14:59.712581 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 14:14:59.712581 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:14:59.716560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 213/433] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:14:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:14:59.723508 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac1732-4dc4-48bb-b09c-57883120a365 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:14:59.729390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d704b4-6c39-4e07-9b91-e80772365687 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:14:59.781546 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf497a8-8ec7-4c45-b9b4-bf8174ef75a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:14:59.783627 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf497a8-8ec7-4c45-b9b4-bf8174ef75a3 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:59.784673 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf497a8-8ec7-4c45-b9b4-bf8174ef75a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:59.785776 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf497a8-8ec7-4c45-b9b4-bf8174ef75a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:59.787555 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf497a8-8ec7-4c45-b9b4-bf8174ef75a3 None admin] RBAC: Adding query filter params (group.id=259e3ab57d9e4c2dbb5cc6e5fccf5aed, role.id=c3d8f302f6714108ac91c25b8a32d36b, scope.project.id=0c72ec4a5e6f40ac84de3c903eedf1d3) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:14:59.788493 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf497a8-8ec7-4c45-b9b4-bf8174ef75a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:14:59.791794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf497a8-8ec7-4c45-b9b4-bf8174ef75a3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:14:59.809563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 221/434] 10.222.0.62 () {56 vars in 1376 bytes} [Tue Oct 4 14:14:59 2022] GET /identity/v3/role_assignments?group.id=259e3ab57d9e4c2dbb5cc6e5fccf5aed&scope.project.id=0c72ec4a5e6f40ac84de3c903eedf1d3&role.id=c3d8f302f6714108ac91c25b8a32d36b => generated 611 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:14:59.861299 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:14:59.931013 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16bf3b-79d4-49db-8dbd-1a409023989a None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:59.931483 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16bf3b-79d4-49db-8dbd-1a409023989a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:59.931584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16bf3b-79d4-49db-8dbd-1a409023989a None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:59.933170 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 222/435] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:14:59.940059 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff889f7-ad56-43bc-8f1e-47d7bcd36918 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:14:59.940441 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff889f7-ad56-43bc-8f1e-47d7bcd36918 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:14:59.940673 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff889f7-ad56-43bc-8f1e-47d7bcd36918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:14:59.962932 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-6ff889f7-ad56-43bc-8f1e-47d7bcd36918 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:14:59.964243 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6ff889f7-ad56-43bc-8f1e-47d7bcd36918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:14:59.971205 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d704b4-6c39-4e07-9b91-e80772365687 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:00.053759 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8649a3-a2dd-49cb-a4ca-bcb481f6053d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:00.054768 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8649a3-a2dd-49cb-a4ca-bcb481f6053d None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:00.054768 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8649a3-a2dd-49cb-a4ca-bcb481f6053d None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:00.055003 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8649a3-a2dd-49cb-a4ca-bcb481f6053d None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:00.055678 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8649a3-a2dd-49cb-a4ca-bcb481f6053d None admin] RBAC: Adding query filter params (name=member) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:00.056014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8649a3-a2dd-49cb-a4ca-bcb481f6053d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:00.057537 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8649a3-a2dd-49cb-a4ca-bcb481f6053d None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:00.073294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 214/436] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:14:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:15:00.079686 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8649a3-a2dd-49cb-a4ca-bcb481f6053d None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:00.121199 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 223/437] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 14:15:00.262495 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8649a3-a2dd-49cb-a4ca-bcb481f6053d None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:00.292024 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:00.302612 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe488d-beda-4947-86ce-d048037d2861 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:00.303060 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe488d-beda-4947-86ce-d048037d2861 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:00.303526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe488d-beda-4947-86ce-d048037d2861 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:00.308062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 224/438] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:00.317785 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6e8d8-b0a7-44d0-b867-655bd45da24f None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:00.318233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6e8d8-b0a7-44d0-b867-655bd45da24f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:00.318683 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6e8d8-b0a7-44d0-b867-655bd45da24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:00.320510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecee49-f981-45f2-af16-6b82ee048b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:00.321150 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecee49-f981-45f2-af16-6b82ee048b62 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:00.321449 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecee49-f981-45f2-af16-6b82ee048b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:00.321725 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecee49-f981-45f2-af16-6b82ee048b62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:00.357376 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ead6e8d8-b0a7-44d0-b867-655bd45da24f None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:00.359391 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ead6e8d8-b0a7-44d0-b867-655bd45da24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:00.386264 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:00.451221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ecee49-f981-45f2-af16-6b82ee048b62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:00.454244 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ecee49-f981-45f2-af16-6b82ee048b62 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:00.515442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 225/439] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:00.601068 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6e8d8-b0a7-44d0-b867-655bd45da24f None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:00.668091 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 215/440] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:15:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 14:15:00.677473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecee49-f981-45f2-af16-6b82ee048b62 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:00.712459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:00.791336 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6e8d8-b0a7-44d0-b867-655bd45da24f None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:00.843274 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10a7cc-fbaf-4894-8619-45a2ba23e85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:00.845190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10a7cc-fbaf-4894-8619-45a2ba23e85c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:00.845615 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10a7cc-fbaf-4894-8619-45a2ba23e85c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:00.846004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10a7cc-fbaf-4894-8619-45a2ba23e85c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:00.857829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecee49-f981-45f2-af16-6b82ee048b62 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:00.860300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10a7cc-fbaf-4894-8619-45a2ba23e85c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:15:00.866882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-3b10a7cc-fbaf-4894-8619-45a2ba23e85c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:15:00.866882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:00.866882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:00.866882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:00.866882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:00.866882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:00.866882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:00.866882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:00.866882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:00.866882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:00.866882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:00.866882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:00.866882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:15:00.866882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:15:00.866882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:15:00.866882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:15:00.868702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:15:00.868702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:15:00.868702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:15:00.868702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:15:00.868702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:00.868702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:00.868702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:00.868702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:00.868702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:00.868702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:00.868702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:00.868702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:00.868702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:00.868702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:00.868702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:00.868702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:00.870258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:00.870258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:00.870258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:00.870258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:00.870258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:15:00.870258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:15:00.870258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:15:00.870258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:15:00.870258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:15:00.870258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:15:00.870258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:15:00.870258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:00.876320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 226/441] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Oct 4 14:15:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:15:00.877474 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10a7cc-fbaf-4894-8619-45a2ba23e85c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:00.893027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:00.919263 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2d15f-5f50-4f68-9716-e5c017ee32cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:00.920181 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2d15f-5f50-4f68-9716-e5c017ee32cf None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:00.920603 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2d15f-5f50-4f68-9716-e5c017ee32cf None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:00.920989 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2d15f-5f50-4f68-9716-e5c017ee32cf None admin] PATH_INFO: `/v3/projects/660126a36fe74ee0b2c60ecb51c62269` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:00.922677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2d15f-5f50-4f68-9716-e5c017ee32cf None admin] RBAC: Authorizing `identity:get_project(project_id=660126a36fe74ee0b2c60ecb51c62269)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:00.925140 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2d15f-5f50-4f68-9716-e5c017ee32cf None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:00.928202 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 216/442] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:15:00 2022] GET /identity/v3/projects/660126a36fe74ee0b2c60ecb51c62269 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:00.936380 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2d15f-5f50-4f68-9716-e5c017ee32cf None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:01.048966 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10a7cc-fbaf-4894-8619-45a2ba23e85c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:01.072596 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:01.100830 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2d15f-5f50-4f68-9716-e5c017ee32cf None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:01.107970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ea568-8d38-4b89-9cc6-d6b3e6b1fb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:01.108868 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ea568-8d38-4b89-9cc6-d6b3e6b1fb61 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:01.109234 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ea568-8d38-4b89-9cc6-d6b3e6b1fb61 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:01.110935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ea568-8d38-4b89-9cc6-d6b3e6b1fb61 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:01.111668 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ea568-8d38-4b89-9cc6-d6b3e6b1fb61 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:01.112005 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ea568-8d38-4b89-9cc6-d6b3e6b1fb61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:01.113524 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ea568-8d38-4b89-9cc6-d6b3e6b1fb61 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:01.125963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 227/443] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:15:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:01.127083 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ea568-8d38-4b89-9cc6-d6b3e6b1fb61 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:01.161961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c4dc0-353e-4a96-be73-222562c1922c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:01.163091 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c4dc0-353e-4a96-be73-222562c1922c None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:01.163578 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c4dc0-353e-4a96-be73-222562c1922c None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:01.164107 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c4dc0-353e-4a96-be73-222562c1922c None admin] PATH_INFO: `/v3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:01.166363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c4dc0-353e-4a96-be73-222562c1922c None admin] RBAC: Authorizing `identity:get_group(group_id=259e3ab57d9e4c2dbb5cc6e5fccf5aed)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:01.168071 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c4dc0-353e-4a96-be73-222562c1922c None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:01.169851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 217/444] 10.222.0.62 () {56 vars in 1180 bytes} [Tue Oct 4 14:15:00 2022] GET /identity/v3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:15:01.170614 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c4dc0-353e-4a96-be73-222562c1922c None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:01.230228 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:01.270401 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ea568-8d38-4b89-9cc6-d6b3e6b1fb61 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:01.311530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768fc21-6fdd-4457-b07e-7fb24f77c0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:01.312213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768fc21-6fdd-4457-b07e-7fb24f77c0b8 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:01.312492 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768fc21-6fdd-4457-b07e-7fb24f77c0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:01.313120 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768fc21-6fdd-4457-b07e-7fb24f77c0b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:01.326356 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768fc21-6fdd-4457-b07e-7fb24f77c0b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:15:01.333126 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-7768fc21-6fdd-4457-b07e-7fb24f77c0b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:15:01.333126 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:01.333126 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:01.333126 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:01.333126 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:01.333126 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:01.333126 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:01.333126 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:01.333126 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:01.333126 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:01.333126 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:01.333126 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:01.333126 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:15:01.333126 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:15:01.333126 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:15:01.333126 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:15:01.334368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:15:01.334368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:15:01.334368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:15:01.334368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:15:01.334368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:01.334368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:01.334368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:01.334368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:01.334368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:01.334368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:01.334368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:01.334368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:01.334368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:01.334368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:01.334368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:01.334368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:01.335962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:01.335962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:01.335962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:01.335962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:01.335962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:15:01.335962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:15:01.335962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:15:01.335962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:15:01.335962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:15:01.335962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:15:01.335962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:15:01.335962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:01.337982 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c4dc0-353e-4a96-be73-222562c1922c None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:01.338134 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 228/445] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:15:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:01.338134 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768fc21-6fdd-4457-b07e-7fb24f77c0b8 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:01.386976 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7642fd-9f24-4e9c-aaf7-523378af87e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:01.387836 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7642fd-9f24-4e9c-aaf7-523378af87e2 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:01.388328 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7642fd-9f24-4e9c-aaf7-523378af87e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:01.388758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7642fd-9f24-4e9c-aaf7-523378af87e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:01.420667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:01.476382 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7642fd-9f24-4e9c-aaf7-523378af87e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:01.477799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768fc21-6fdd-4457-b07e-7fb24f77c0b8 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:01.478970 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7642fd-9f24-4e9c-aaf7-523378af87e2 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:01.516403 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:01.525796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a450076-9c10-4247-98e0-fdcc0f71a186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:01.526717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a450076-9c10-4247-98e0-fdcc0f71a186 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:01.527122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a450076-9c10-4247-98e0-fdcc0f71a186 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:01.527519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a450076-9c10-4247-98e0-fdcc0f71a186 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:01.528741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a450076-9c10-4247-98e0-fdcc0f71a186 None admin] RBAC: Adding query filter params (group.id=259e3ab57d9e4c2dbb5cc6e5fccf5aed, role.id=eb2435bb443d4469899fb3830f4ee5b1, scope.project.id=660126a36fe74ee0b2c60ecb51c62269) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:01.529235 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a450076-9c10-4247-98e0-fdcc0f71a186 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:01.530850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a450076-9c10-4247-98e0-fdcc0f71a186 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:01.539868 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 229/446] 10.222.0.62 () {56 vars in 1376 bytes} [Tue Oct 4 14:15:01 2022] GET /identity/v3/role_assignments?group.id=259e3ab57d9e4c2dbb5cc6e5fccf5aed&scope.project.id=660126a36fe74ee0b2c60ecb51c62269&role.id=eb2435bb443d4469899fb3830f4ee5b1 => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:01.541236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a450076-9c10-4247-98e0-fdcc0f71a186 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:01.670848 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 218/447] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:15:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:15:01.678222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7642fd-9f24-4e9c-aaf7-523378af87e2 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:01.714598 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a450076-9c10-4247-98e0-fdcc0f71a186 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:01.751249 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:01.782311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d96c19-abf8-4a22-be57-e59b45a2955d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:01.783368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d96c19-abf8-4a22-be57-e59b45a2955d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:01.784895 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d96c19-abf8-4a22-be57-e59b45a2955d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:01.784895 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d96c19-abf8-4a22-be57-e59b45a2955d None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:01.786410 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d96c19-abf8-4a22-be57-e59b45a2955d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:01.786410 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d96c19-abf8-4a22-be57-e59b45a2955d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:01.791447 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d96c19-abf8-4a22-be57-e59b45a2955d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:01.808061 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 230/448] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:15:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:01.809079 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d96c19-abf8-4a22-be57-e59b45a2955d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:01.834389 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7642fd-9f24-4e9c-aaf7-523378af87e2 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:01.885079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbf5c7-4b77-4714-b28a-3f2068f034c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:01.887399 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbf5c7-4b77-4714-b28a-3f2068f034c7 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:01.887684 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbf5c7-4b77-4714-b28a-3f2068f034c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:01.888027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbf5c7-4b77-4714-b28a-3f2068f034c7 None admin] PATH_INFO: `/v3/projects/660126a36fe74ee0b2c60ecb51c62269` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:01.890093 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbf5c7-4b77-4714-b28a-3f2068f034c7 None admin] RBAC: Authorizing `identity:get_project(project_id=660126a36fe74ee0b2c60ecb51c62269)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:01.892569 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbf5c7-4b77-4714-b28a-3f2068f034c7 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:01.895223 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 219/449] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:15:01 2022] GET /identity/v3/projects/660126a36fe74ee0b2c60ecb51c62269 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:15:01.900951 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbf5c7-4b77-4714-b28a-3f2068f034c7 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:01.914083 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:02.002808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d96c19-abf8-4a22-be57-e59b45a2955d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:02.062371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67262163-b503-46a2-8ac8-3953b4b3bc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:02.063513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67262163-b503-46a2-8ac8-3953b4b3bc6a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:02.063932 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67262163-b503-46a2-8ac8-3953b4b3bc6a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:02.064484 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67262163-b503-46a2-8ac8-3953b4b3bc6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:02.077659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbf5c7-4b77-4714-b28a-3f2068f034c7 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:02.123006 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:02.138036 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af5ef8-c299-4bb9-8106-882e7460c7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:02.138864 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af5ef8-c299-4bb9-8106-882e7460c7d0 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:02.139219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af5ef8-c299-4bb9-8106-882e7460c7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:02.139670 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af5ef8-c299-4bb9-8106-882e7460c7d0 None admin] PATH_INFO: `/v3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:02.141134 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af5ef8-c299-4bb9-8106-882e7460c7d0 None admin] RBAC: Authorizing `identity:get_group(group_id=259e3ab57d9e4c2dbb5cc6e5fccf5aed)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:02.142868 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af5ef8-c299-4bb9-8106-882e7460c7d0 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:02.145253 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 220/450] 10.222.0.62 () {56 vars in 1180 bytes} [Tue Oct 4 14:15:01 2022] GET /identity/v3/groups/259e3ab57d9e4c2dbb5cc6e5fccf5aed => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:15:02.147277 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67262163-b503-46a2-8ac8-3953b4b3bc6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:02.148856 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67262163-b503-46a2-8ac8-3953b4b3bc6a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:02.151565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af5ef8-c299-4bb9-8106-882e7460c7d0 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:02.216275 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:02.272464 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 231/451] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:15:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:15:02.278476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67262163-b503-46a2-8ac8-3953b4b3bc6a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:02.291918 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af5ef8-c299-4bb9-8106-882e7460c7d0 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:02.341872 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51ba07-89eb-49b4-a359-5cf2741ce5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:02.342657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51ba07-89eb-49b4-a359-5cf2741ce5d0 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:02.343068 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51ba07-89eb-49b4-a359-5cf2741ce5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:02.343524 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51ba07-89eb-49b4-a359-5cf2741ce5d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:02.345695 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51ba07-89eb-49b4-a359-5cf2741ce5d0 None admin] RBAC: Adding query filter params (group.id=259e3ab57d9e4c2dbb5cc6e5fccf5aed, role.id=c3d8f302f6714108ac91c25b8a32d36b, scope.project.id=660126a36fe74ee0b2c60ecb51c62269) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:02.346230 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51ba07-89eb-49b4-a359-5cf2741ce5d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:02.348885 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51ba07-89eb-49b4-a359-5cf2741ce5d0 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:02.359216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 221/452] 10.222.0.62 () {56 vars in 1376 bytes} [Tue Oct 4 14:15:02 2022] GET /identity/v3/role_assignments?group.id=259e3ab57d9e4c2dbb5cc6e5fccf5aed&scope.project.id=660126a36fe74ee0b2c60ecb51c62269&role.id=c3d8f302f6714108ac91c25b8a32d36b => generated 611 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:15:02.410034 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67262163-b503-46a2-8ac8-3953b4b3bc6a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:02.480806 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4997fb-9d21-43ac-80b6-937212b5517a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:02.481740 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4997fb-9d21-43ac-80b6-937212b5517a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:02.482281 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4997fb-9d21-43ac-80b6-937212b5517a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:02.482789 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4997fb-9d21-43ac-80b6-937212b5517a None admin] PATH_INFO: `/v3/projects/d6e81a80a6484baf89f76501cdc63799` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:02.485572 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4997fb-9d21-43ac-80b6-937212b5517a None admin] RBAC: Authorizing `identity:get_project(project_id=d6e81a80a6484baf89f76501cdc63799)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:02.488412 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4997fb-9d21-43ac-80b6-937212b5517a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:02.491625 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 232/453] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:15:02 2022] GET /identity/v3/projects/d6e81a80a6484baf89f76501cdc63799 => generated 344 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:15:02.498354 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51ba07-89eb-49b4-a359-5cf2741ce5d0 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:02.594328 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:02.663465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51ba07-89eb-49b4-a359-5cf2741ce5d0 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:02.719461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579d9e2-d208-4469-90ad-e473b730820b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:02.720233 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579d9e2-d208-4469-90ad-e473b730820b None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:02.720649 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579d9e2-d208-4469-90ad-e473b730820b None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:02.721065 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579d9e2-d208-4469-90ad-e473b730820b None admin] PATH_INFO: `/v3/groups/9dcd7dc3757c4719bae3a035f339015e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:02.722730 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579d9e2-d208-4469-90ad-e473b730820b None admin] RBAC: Authorizing `identity:get_group(group_id=9dcd7dc3757c4719bae3a035f339015e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:02.724740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579d9e2-d208-4469-90ad-e473b730820b None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:02.726571 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 222/454] 10.222.0.62 () {56 vars in 1180 bytes} [Tue Oct 4 14:15:02 2022] GET /identity/v3/groups/9dcd7dc3757c4719bae3a035f339015e => generated 229 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:02.735312 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4997fb-9d21-43ac-80b6-937212b5517a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:02.784738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:02.883800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4997fb-9d21-43ac-80b6-937212b5517a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:02.925015 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b9a59-2bfc-4fc3-b7c3-283e4bef7b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:02.925689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b9a59-2bfc-4fc3-b7c3-283e4bef7b20 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:02.926004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b9a59-2bfc-4fc3-b7c3-283e4bef7b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:02.926312 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b9a59-2bfc-4fc3-b7c3-283e4bef7b20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:02.927093 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b9a59-2bfc-4fc3-b7c3-283e4bef7b20 None admin] RBAC: Adding query filter params (group.id=9dcd7dc3757c4719bae3a035f339015e, role.id=a16b6daeda5b4a67992f3c12514ca90e, scope.project.id=d6e81a80a6484baf89f76501cdc63799) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:02.927430 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b9a59-2bfc-4fc3-b7c3-283e4bef7b20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:02.928993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b9a59-2bfc-4fc3-b7c3-283e4bef7b20 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:02.936036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 233/455] 10.222.0.62 () {56 vars in 1376 bytes} [Tue Oct 4 14:15:02 2022] GET /identity/v3/role_assignments?group.id=9dcd7dc3757c4719bae3a035f339015e&scope.project.id=d6e81a80a6484baf89f76501cdc63799&role.id=a16b6daeda5b4a67992f3c12514ca90e => generated 611 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:15:06.051623 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f800806-53a6-4254-a97f-883108edb1dc None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:06.052208 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f800806-53a6-4254-a97f-883108edb1dc None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:06.052208 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f800806-53a6-4254-a97f-883108edb1dc None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:06.053932 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 223/456] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:06.060565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8df162-80ca-4fa7-97ff-d3ad2bc88da5 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:06.061075 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8df162-80ca-4fa7-97ff-d3ad2bc88da5 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:06.061335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8df162-80ca-4fa7-97ff-d3ad2bc88da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:06.100549 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-fb8df162-80ca-4fa7-97ff-d3ad2bc88da5 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:06.102506 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-fb8df162-80ca-4fa7-97ff-d3ad2bc88da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:06.227927 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 234/457] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 14:15:06.657078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b6c11-cd29-428e-9c95-01ca7c8a79ba None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:06.657430 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b6c11-cd29-428e-9c95-01ca7c8a79ba None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:06.657625 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b6c11-cd29-428e-9c95-01ca7c8a79ba None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:06.659661 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 224/458] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:06.666433 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f5d56-aaaa-4523-aca6-1c107a2aaca1 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:06.667185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f5d56-aaaa-4523-aca6-1c107a2aaca1 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:06.667743 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f5d56-aaaa-4523-aca6-1c107a2aaca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:06.672316 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b6c11-cd29-428e-9c95-01ca7c8a79ba None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:06.704085 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-258f5d56-aaaa-4523-aca6-1c107a2aaca1 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:06.708915 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-258f5d56-aaaa-4523-aca6-1c107a2aaca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:06.739918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:06.852843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 235/459] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:06.894997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b6c11-cd29-428e-9c95-01ca7c8a79ba None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:06.943271 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:06.967631 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35104339-b007-4a4c-81ed-e8f7e885fab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:06.968323 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35104339-b007-4a4c-81ed-e8f7e885fab7 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:06.968641 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35104339-b007-4a4c-81ed-e8f7e885fab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:06.969048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35104339-b007-4a4c-81ed-e8f7e885fab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:06.987941 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35104339-b007-4a4c-81ed-e8f7e885fab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:06.989465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35104339-b007-4a4c-81ed-e8f7e885fab7 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:07.013964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-35104339-b007-4a4c-81ed-e8f7e885fab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:07.013964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:07.013964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:07.013964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:07.013964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:07.013964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:07.013964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:07.013964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:07.013964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:07.013964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:07.013964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:07.013964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:07.013964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:07.013964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:07.013964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:07.013964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:07.014961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:07.014961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:07.014961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:07.014961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:07.014961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:07.014961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:07.014961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:07.014961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:07.014961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:07.014961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:07.014961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:07.014961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:07.014961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:07.014961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:07.014961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:07.014961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:07.014961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:07.015939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:07.015939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:07.015939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:07.015939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 225/460] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:07.022185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f5d56-aaaa-4523-aca6-1c107a2aaca1 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:07.033797 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6affe5-7e91-4a42-adc9-d4a20b918fd0 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:07.034149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6affe5-7e91-4a42-adc9-d4a20b918fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:07.034343 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6affe5-7e91-4a42-adc9-d4a20b918fd0 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:07.038399 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 226/461] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:07.042550 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6298f-8ced-4d31-90c3-c4e786ec821d None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:07.042834 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6298f-8ced-4d31-90c3-c4e786ec821d None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:07.043084 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6298f-8ced-4d31-90c3-c4e786ec821d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:07.080866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-6bc6298f-8ced-4d31-90c3-c4e786ec821d None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:07.082128 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-6bc6298f-8ced-4d31-90c3-c4e786ec821d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:07.226921 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 227/462] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 14:15:07.233712 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f5d56-aaaa-4523-aca6-1c107a2aaca1 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:07.241645 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6298f-8ced-4d31-90c3-c4e786ec821d None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:07.297242 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343fecf-dfb0-4d76-a8c2-7475f89a610a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:07.298412 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343fecf-dfb0-4d76-a8c2-7475f89a610a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:07.298866 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343fecf-dfb0-4d76-a8c2-7475f89a610a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:07.299302 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343fecf-dfb0-4d76-a8c2-7475f89a610a None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:07.300310 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343fecf-dfb0-4d76-a8c2-7475f89a610a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:07.301200 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343fecf-dfb0-4d76-a8c2-7475f89a610a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:07.304221 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343fecf-dfb0-4d76-a8c2-7475f89a610a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:07.333422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 236/463] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:07.339620 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343fecf-dfb0-4d76-a8c2-7475f89a610a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:07.360310 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:07.427752 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6298f-8ced-4d31-90c3-c4e786ec821d None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:07.431240 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:07.474490 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb411e1-8854-4ad4-8ff1-26fdc78b1b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:07.475221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb411e1-8854-4ad4-8ff1-26fdc78b1b89 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:07.475508 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb411e1-8854-4ad4-8ff1-26fdc78b1b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:07.475852 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb411e1-8854-4ad4-8ff1-26fdc78b1b89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:07.489454 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb411e1-8854-4ad4-8ff1-26fdc78b1b89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:07.490904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb411e1-8854-4ad4-8ff1-26fdc78b1b89 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:07.508985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-1fb411e1-8854-4ad4-8ff1-26fdc78b1b89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:07.508985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:07.508985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:07.508985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:07.508985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:07.508985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:07.508985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:07.508985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:07.508985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:07.508985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:07.508985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:07.508985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:07.508985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:07.508985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:07.508985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:07.508985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:07.510137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:07.510137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:07.510137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:07.510137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:07.510137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:07.510137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:07.510137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:07.510137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:07.510137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:07.510137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:07.510137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:07.510137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:07.510137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:07.510137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:07.510137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:07.510137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:07.510137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:07.511018 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:07.511018 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:07.511018 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:07.511018 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 228/464] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:15:07.517856 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3149bd-9fa5-4e1d-8622-95a060e39bf3 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:07.518224 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3149bd-9fa5-4e1d-8622-95a060e39bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:07.518510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3149bd-9fa5-4e1d-8622-95a060e39bf3 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:07.520185 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 229/465] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:07.521039 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3149bd-9fa5-4e1d-8622-95a060e39bf3 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:07.550388 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343fecf-dfb0-4d76-a8c2-7475f89a610a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:07.594409 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91769726-94fd-4125-9d8c-9c59e41fbab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:07.595180 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91769726-94fd-4125-9d8c-9c59e41fbab5 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:07.595577 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91769726-94fd-4125-9d8c-9c59e41fbab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:07.595878 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91769726-94fd-4125-9d8c-9c59e41fbab5 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:07.596653 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91769726-94fd-4125-9d8c-9c59e41fbab5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:07.598117 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91769726-94fd-4125-9d8c-9c59e41fbab5 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:07.624079 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 237/466] 10.222.0.62 () {60 vars in 1132 bytes} [Tue Oct 4 14:15:07 2022] POST /identity/v3/users => generated 248 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:15:07.625835 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b135fdd-8bd4-4ee2-904a-5321d148315e None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:07.626242 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b135fdd-8bd4-4ee2-904a-5321d148315e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:07.626552 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b135fdd-8bd4-4ee2-904a-5321d148315e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:07.658183 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-1b135fdd-8bd4-4ee2-904a-5321d148315e None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:07.661417 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1b135fdd-8bd4-4ee2-904a-5321d148315e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:07.665216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3149bd-9fa5-4e1d-8622-95a060e39bf3 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:07.733254 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df0428-18eb-4f57-8e34-ea11efcfbe3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:07.733883 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df0428-18eb-4f57-8e34-ea11efcfbe3b None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:07.734168 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df0428-18eb-4f57-8e34-ea11efcfbe3b None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:07.734531 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df0428-18eb-4f57-8e34-ea11efcfbe3b None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:07.735876 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df0428-18eb-4f57-8e34-ea11efcfbe3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:07.736201 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df0428-18eb-4f57-8e34-ea11efcfbe3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:07.737677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df0428-18eb-4f57-8e34-ea11efcfbe3b None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:07.756551 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 230/467] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:07.761628 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df0428-18eb-4f57-8e34-ea11efcfbe3b None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:07.776960 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:07.789058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:07.798457 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 238/468] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:07.800005 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b135fdd-8bd4-4ee2-904a-5321d148315e None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:07.950332 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b135fdd-8bd4-4ee2-904a-5321d148315e None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:07.987537 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df0428-18eb-4f57-8e34-ea11efcfbe3b None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:08.003505 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9466ad-8c6f-4823-a273-7a3478d0746f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:08.004598 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9466ad-8c6f-4823-a273-7a3478d0746f None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:08.005082 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9466ad-8c6f-4823-a273-7a3478d0746f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:08.005653 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9466ad-8c6f-4823-a273-7a3478d0746f None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:08.006531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9466ad-8c6f-4823-a273-7a3478d0746f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:08.008483 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9466ad-8c6f-4823-a273-7a3478d0746f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:08.039576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 239/469] 10.222.0.62 () {60 vars in 1132 bytes} [Tue Oct 4 14:15:07 2022] POST /identity/v3/users => generated 246 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:15:08.066305 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd5539-c0b2-4764-af08-4059a78a3464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:08.067414 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd5539-c0b2-4764-af08-4059a78a3464 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:08.067940 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd5539-c0b2-4764-af08-4059a78a3464 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:08.068396 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd5539-c0b2-4764-af08-4059a78a3464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:08.091631 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd5539-c0b2-4764-af08-4059a78a3464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:08.095066 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd5539-c0b2-4764-af08-4059a78a3464 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:08.126301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-a5cd5539-c0b2-4764-af08-4059a78a3464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:08.126301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:08.126301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:08.126301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:08.126301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:08.126301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:08.126301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:08.126301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:08.126301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:08.126301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:08.126301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:08.126301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:08.126301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:08.126301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:08.126301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:08.126301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:08.127281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:08.127281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:08.127281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:08.127281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:08.127281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:08.127281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:08.127281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:08.127281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:08.127281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:08.127281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:08.127281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:08.127281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:08.127281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:08.127281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:08.127281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:08.127281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:08.127281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:08.128295 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:08.128295 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:08.128295 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:08.129056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 231/470] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:08.134809 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9466ad-8c6f-4823-a273-7a3478d0746f None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:08.166514 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd5539-c0b2-4764-af08-4059a78a3464 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:08.206917 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:08.277370 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9466ad-8c6f-4823-a273-7a3478d0746f None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:08.322305 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:08.326045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09881235-4981-467f-b243-b37c3ad6aa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:08.326709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09881235-4981-467f-b243-b37c3ad6aa59 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:08.326990 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09881235-4981-467f-b243-b37c3ad6aa59 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:08.327261 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09881235-4981-467f-b243-b37c3ad6aa59 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:08.328315 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09881235-4981-467f-b243-b37c3ad6aa59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:08.328315 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09881235-4981-467f-b243-b37c3ad6aa59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:08.329734 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09881235-4981-467f-b243-b37c3ad6aa59 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:08.345503 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 240/471] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:08.352865 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09881235-4981-467f-b243-b37c3ad6aa59 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:08.399423 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd5539-c0b2-4764-af08-4059a78a3464 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:08.473226 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a44ed1-7940-47d8-922a-e3161f0aefd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:08.474645 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a44ed1-7940-47d8-922a-e3161f0aefd3 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:08.474645 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a44ed1-7940-47d8-922a-e3161f0aefd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:08.475286 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a44ed1-7940-47d8-922a-e3161f0aefd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:08.488330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09881235-4981-467f-b243-b37c3ad6aa59 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:08.504464 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:08.517069 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a44ed1-7940-47d8-922a-e3161f0aefd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:08.519973 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a44ed1-7940-47d8-922a-e3161f0aefd3 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:08.539530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd73f2c-5708-4465-a6ac-abf14460f47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:08.540893 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd73f2c-5708-4465-a6ac-abf14460f47a None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:08.541207 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd73f2c-5708-4465-a6ac-abf14460f47a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:08.541475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd73f2c-5708-4465-a6ac-abf14460f47a None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:08.542147 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd73f2c-5708-4465-a6ac-abf14460f47a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:08.543630 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd73f2c-5708-4465-a6ac-abf14460f47a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:08.551873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-69a44ed1-7940-47d8-922a-e3161f0aefd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:08.551873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:08.551873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:08.551873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:08.551873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:08.551873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:08.551873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:08.551873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:08.551873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:08.551873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:08.551873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:08.551873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:08.551873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:08.551873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:08.551873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:08.551873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:08.553651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:08.553651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:08.553651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:08.553651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:08.553651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:08.553651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:08.553651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:08.553651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:08.553651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:08.553651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:08.553651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:08.553651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:08.553651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:08.553651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:08.553651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:08.553651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:08.553651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:08.560471 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:08.560471 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:08.560471 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:08.560471 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 232/472] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:08.560471 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218a0d9-c3f7-49ed-85e0-488d56e59e07 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:08.560471 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218a0d9-c3f7-49ed-85e0-488d56e59e07 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:08.560471 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218a0d9-c3f7-49ed-85e0-488d56e59e07 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:08.564276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 233/473] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:08.567664 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218a0d9-c3f7-49ed-85e0-488d56e59e07 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:08.588646 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 241/474] 10.222.0.62 () {60 vars in 1132 bytes} [Tue Oct 4 14:15:08 2022] POST /identity/v3/users => generated 248 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:15:08.592267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918b47e-f688-4197-84a6-61f9ca906219 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:08.593065 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918b47e-f688-4197-84a6-61f9ca906219 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:08.595236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918b47e-f688-4197-84a6-61f9ca906219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:08.633758 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f918b47e-f688-4197-84a6-61f9ca906219 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:08.636231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f918b47e-f688-4197-84a6-61f9ca906219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:08.823853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218a0d9-c3f7-49ed-85e0-488d56e59e07 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:08.833618 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 242/475] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:08.868120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:08.896607 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9b0b7-e7cf-4f53-b2b6-71f3207208b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:08.897633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9b0b7-e7cf-4f53-b2b6-71f3207208b1 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:08.898121 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9b0b7-e7cf-4f53-b2b6-71f3207208b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:08.898679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9b0b7-e7cf-4f53-b2b6-71f3207208b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:08.899927 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9b0b7-e7cf-4f53-b2b6-71f3207208b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:08.900442 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9b0b7-e7cf-4f53-b2b6-71f3207208b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:08.903046 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9b0b7-e7cf-4f53-b2b6-71f3207208b1 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:08.926831 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 234/476] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:08.932599 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918b47e-f688-4197-84a6-61f9ca906219 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:09.120225 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:09.131058 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918b47e-f688-4197-84a6-61f9ca906219 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:09.201964 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04021ac-a1f1-4ed7-a09a-7ec67a3e4350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:09.202623 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04021ac-a1f1-4ed7-a09a-7ec67a3e4350 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:09.203499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04021ac-a1f1-4ed7-a09a-7ec67a3e4350 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:09.203922 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04021ac-a1f1-4ed7-a09a-7ec67a3e4350 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:09.205231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04021ac-a1f1-4ed7-a09a-7ec67a3e4350 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:09.206758 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04021ac-a1f1-4ed7-a09a-7ec67a3e4350 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:09.253426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 243/477] 10.222.0.62 () {60 vars in 1132 bytes} [Tue Oct 4 14:15:08 2022] POST /identity/v3/users => generated 249 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:15:09.382283 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9b0b7-e7cf-4f53-b2b6-71f3207208b1 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:09.623136 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9b0b7-e7cf-4f53-b2b6-71f3207208b1 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:09.667878 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fea0c7-6643-4ee9-997a-75f8c3022b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:09.668397 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fea0c7-6643-4ee9-997a-75f8c3022b93 None admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:09.668676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fea0c7-6643-4ee9-997a-75f8c3022b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:09.668949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fea0c7-6643-4ee9-997a-75f8c3022b93 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:09.669641 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fea0c7-6643-4ee9-997a-75f8c3022b93 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:09.671062 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fea0c7-6643-4ee9-997a-75f8c3022b93 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:09.680959 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.sql.core [None req-d3fea0c7-6643-4ee9-997a-75f8c3022b93 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 14:15:09.680959 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 04 14:15:09.680959 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [parameters: {'id': 'fc04d88e9a6948808c764627561ef80a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 04 14:15:09.680959 dv-cinder-860260-1-smb devstack@keystone.service[81468]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81468) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 14:15:09.698593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-d3fea0c7-6643-4ee9-997a-75f8c3022b93 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 04 14:15:09.698593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:09.698593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 14:15:09.698593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 14:15:09.698593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 14:15:09.698593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 14:15:09.698593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 14:15:09.698593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 14:15:09.698593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 14:15:09.698593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application conn.query(q) Oct 04 14:15:09.698593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 14:15:09.698593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 14:15:09.698593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 14:15:09.698593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application result.read() Oct 04 14:15:09.698593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 14:15:09.700368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 14:15:09.700368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 14:15:09.700368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 14:15:09.700368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 14:15:09.700368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 14:15:09.700368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 14:15:09.700368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 14:15:09.700368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 14:15:09.700368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:09.700368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 14:15:09.700368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:09.700368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:09.700368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 14:15:09.700368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 14:15:09.700368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 04 14:15:09.700368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return ref.to_dict() Oct 04 14:15:09.700368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 14:15:09.700368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application next(self.gen) Oct 04 14:15:09.702174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 14:15:09.702174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application yield resource Oct 04 14:15:09.702174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 14:15:09.702174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application next(self.gen) Oct 04 14:15:09.702174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 14:15:09.702174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 14:15:09.702174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 14:15:09.702174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 14:15:09.702174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 14:15:09.702174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise self.value Oct 04 14:15:09.702174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 14:15:09.702174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 14:15:09.702174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 14:15:09.702174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application session.commit() Oct 04 14:15:09.702174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 14:15:09.702174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 14:15:09.702174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 14:15:09.708761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 14:15:09.708761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 14:15:09.708761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self.session.flush() Oct 04 14:15:09.708761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 14:15:09.708761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 14:15:09.708761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 14:15:09.708761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 14:15:09.708761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 14:15:09.708761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application compat.raise_( Oct 04 14:15:09.708761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 14:15:09.708761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception Oct 04 14:15:09.708761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 14:15:09.708761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 14:15:09.708761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 14:15:09.708761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 14:15:09.708761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 14:15:09.708761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 14:15:09.709712 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 14:15:09.709712 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 14:15:09.709712 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 04 14:15:09.709712 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 04 14:15:09.709712 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 14:15:09.709712 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 14:15:09.709712 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 14:15:09.709712 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 14:15:09.709712 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 14:15:09.709712 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 14:15:09.709712 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 14:15:09.709712 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 14:15:09.709712 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 14:15:09.709712 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 14:15:09.709712 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 14:15:09.709712 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception Oct 04 14:15:09.710565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 14:15:09.710565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 14:15:09.710565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 14:15:09.710565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 14:15:09.710565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 14:15:09.710565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 14:15:09.710565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 14:15:09.710565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application conn.query(q) Oct 04 14:15:09.710565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 14:15:09.710565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 14:15:09.710565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 14:15:09.710565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application result.read() Oct 04 14:15:09.710565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 14:15:09.710565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 14:15:09.710565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 14:15:09.710565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 14:15:09.711434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 14:15:09.711434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 14:15:09.711434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 14:15:09.711434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 14:15:09.711434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 14:15:09.711434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 04 14:15:09.711434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [parameters: {'id': 'fc04d88e9a6948808c764627561ef80a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 04 14:15:09.711434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 14:15:09.711434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:09.711434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:15:09.711434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:09.711434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:09.711434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:09.711434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:09.711434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:09.711434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:09.712393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:09.712393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:09.712393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:09.712393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:09.712393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:09.712393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:09.712393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 04 14:15:09.712393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 04 14:15:09.712393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:09.712393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:09.712393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 04 14:15:09.712393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 04 14:15:09.712393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 14:15:09.712393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 14:15:09.712393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 04 14:15:09.712393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:09.713338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 235/478] 10.222.0.62 () {60 vars in 1131 bytes} [Tue Oct 4 14:15:09 2022] POST /identity/v3/roles => generated 144 bytes in 319 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:09.713418 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04021ac-a1f1-4ed7-a09a-7ec67a3e4350 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:09.847694 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04021ac-a1f1-4ed7-a09a-7ec67a3e4350 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:09.894977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc7067-c907-4473-94ba-5a2abb870bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:09.895663 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc7067-c907-4473-94ba-5a2abb870bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:09.895983 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc7067-c907-4473-94ba-5a2abb870bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:09.896312 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc7067-c907-4473-94ba-5a2abb870bb1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:09.909633 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc7067-c907-4473-94ba-5a2abb870bb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:15:09.916320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-0ffc7067-c907-4473-94ba-5a2abb870bb1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:15:09.916320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:09.916320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:09.916320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:09.916320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:09.916320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:09.916320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:09.916320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:09.916320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:09.916320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:09.916320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:09.916320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:09.916320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:15:09.916320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:15:09.916320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:15:09.916320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:15:09.917371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:15:09.917371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:15:09.917371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:15:09.917371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:15:09.917371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:09.917371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:09.917371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:09.917371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:09.917371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:09.917371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:09.917371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:09.917371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:09.917371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:09.917371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:09.917371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:09.917371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:09.918439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:09.918439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:09.918439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:09.918439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:09.918439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:15:09.918439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:15:09.918439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:15:09.918439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:15:09.918439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:15:09.918439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:15:09.918439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 14:15:09.918439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:09.918439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 244/479] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Oct 4 14:15:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:15:09.925168 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fea0c7-6643-4ee9-997a-75f8c3022b93 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:10.001662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:10.095571 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fea0c7-6643-4ee9-997a-75f8c3022b93 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:10.146595 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9b247-b799-43d8-b078-8099701156cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:10.147232 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9b247-b799-43d8-b078-8099701156cc None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:10.147511 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9b247-b799-43d8-b078-8099701156cc None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:10.147823 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9b247-b799-43d8-b078-8099701156cc None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:10.148518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9b247-b799-43d8-b078-8099701156cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:10.148820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9b247-b799-43d8-b078-8099701156cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:10.150235 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9b247-b799-43d8-b078-8099701156cc None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:10.160099 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 236/480] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:15:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:11.017202 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365c532-d87d-4d89-8ec3-86d48b5db9ac None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:11.017776 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365c532-d87d-4d89-8ec3-86d48b5db9ac None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:11.018052 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365c532-d87d-4d89-8ec3-86d48b5db9ac None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:11.020521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 245/481] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:11.026157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8ec79-84a0-44b9-969a-5961b4b9e6d5 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:11.026683 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8ec79-84a0-44b9-969a-5961b4b9e6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:11.026683 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8ec79-84a0-44b9-969a-5961b4b9e6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:11.051015 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-f7f8ec79-84a0-44b9-969a-5961b4b9e6d5 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:11.052253 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f7f8ec79-84a0-44b9-969a-5961b4b9e6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:11.165098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 237/482] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 14:15:11.582920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365c532-d87d-4d89-8ec3-86d48b5db9ac None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:11.615980 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:11.850751 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365c532-d87d-4d89-8ec3-86d48b5db9ac None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:11.941066 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19378bb7-dda5-4d30-b1a3-a52d0d789c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:11.942213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19378bb7-dda5-4d30-b1a3-a52d0d789c50 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:11.942719 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19378bb7-dda5-4d30-b1a3-a52d0d789c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:11.943206 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19378bb7-dda5-4d30-b1a3-a52d0d789c50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:11.973499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19378bb7-dda5-4d30-b1a3-a52d0d789c50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:15:11.983436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-19378bb7-dda5-4d30-b1a3-a52d0d789c50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:11.983436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:11.983436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:11.983436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:11.983436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:11.983436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:11.983436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:11.983436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:11.983436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:11.983436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:11.983436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:11.983436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:11.983436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:15:11.983436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:15:11.983436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:15:11.983436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:15:11.985703 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:15:11.985703 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:15:11.985703 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:15:11.985703 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:15:11.985703 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:11.985703 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:11.985703 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:11.985703 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:11.985703 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:11.985703 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:11.985703 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:11.985703 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:11.985703 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:11.985703 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:11.985703 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:11.985703 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:11.986514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:11.986514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:11.986514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:11.986514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:11.986514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:15:11.986514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:15:11.986514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:15:11.986514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:15:11.986514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:15:11.986514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:15:11.986514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:11.986514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:11.987128 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 246/483] 10.222.0.62 () {56 vars in 1102 bytes} [Tue Oct 4 14:15:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:11.996909 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8ec79-84a0-44b9-969a-5961b4b9e6d5 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:12.054813 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa08f8d-4041-40ce-9479-269a21ac0533 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:12.057452 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa08f8d-4041-40ce-9479-269a21ac0533 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:12.057452 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa08f8d-4041-40ce-9479-269a21ac0533 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:12.058361 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 247/484] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:12.064346 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:12.068469 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07fe09-2e2b-42c4-897c-09317a1aefa2 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:12.068971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07fe09-2e2b-42c4-897c-09317a1aefa2 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:12.069461 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07fe09-2e2b-42c4-897c-09317a1aefa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:12.104168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-1f07fe09-2e2b-42c4-897c-09317a1aefa2 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:12.105320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1f07fe09-2e2b-42c4-897c-09317a1aefa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:12.140908 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8ec79-84a0-44b9-969a-5961b4b9e6d5 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:12.180366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92508d-2554-4c03-9efb-b69133918fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:12.180997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92508d-2554-4c03-9efb-b69133918fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:12.181280 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92508d-2554-4c03-9efb-b69133918fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:12.181558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92508d-2554-4c03-9efb-b69133918fb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:12.182255 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92508d-2554-4c03-9efb-b69133918fb0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:12.182567 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92508d-2554-4c03-9efb-b69133918fb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:12.184209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92508d-2554-4c03-9efb-b69133918fb0 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:12.192903 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 248/485] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:12.194254 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea79bd4-3624-4781-a41a-c535c807f078 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:12.194540 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea79bd4-3624-4781-a41a-c535c807f078 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:12.194815 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea79bd4-3624-4781-a41a-c535c807f078 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:12.195089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 238/486] 10.222.0.62 () {56 vars in 1103 bytes} [Tue Oct 4 14:15:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:12.196547 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 249/487] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:12.205627 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc37812-6bf2-4c6e-a9f8-8632e14d87de None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:12.205975 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc37812-6bf2-4c6e-a9f8-8632e14d87de None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:12.206187 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc37812-6bf2-4c6e-a9f8-8632e14d87de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:12.206685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea79bd4-3624-4781-a41a-c535c807f078 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:12.209743 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:12.225935 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-adc37812-6bf2-4c6e-a9f8-8632e14d87de None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:12.227171 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-adc37812-6bf2-4c6e-a9f8-8632e14d87de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:12.305372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 239/488] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:12.335912 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea79bd4-3624-4781-a41a-c535c807f078 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:12.378504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466eb78d-c061-43a2-9e57-7d59d48d4b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:12.379073 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466eb78d-c061-43a2-9e57-7d59d48d4b6a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:12.379409 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466eb78d-c061-43a2-9e57-7d59d48d4b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:12.379686 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466eb78d-c061-43a2-9e57-7d59d48d4b6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:12.392393 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466eb78d-c061-43a2-9e57-7d59d48d4b6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:12.393938 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466eb78d-c061-43a2-9e57-7d59d48d4b6a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:12.413415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-466eb78d-c061-43a2-9e57-7d59d48d4b6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:12.413415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:12.413415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:12.413415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:12.413415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:12.413415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:12.413415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:12.413415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:12.413415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:12.413415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:12.413415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:12.413415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:12.413415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:12.413415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:12.413415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:12.413415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:12.414421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:12.414421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:12.414421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:12.414421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:12.414421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:12.414421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:12.414421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:12.414421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:12.414421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:12.414421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:12.414421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:12.414421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:12.414421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:12.414421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:12.414421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:12.414421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:12.414421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:12.415436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:12.415436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:12.415436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:12.415436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 250/489] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:12.423086 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc37812-6bf2-4c6e-a9f8-8632e14d87de None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:12.467091 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:12.554802 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc37812-6bf2-4c6e-a9f8-8632e14d87de None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:12.596017 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d236f0-7499-45a6-b8cd-7ef55a864599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:12.596659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d236f0-7499-45a6-b8cd-7ef55a864599 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:12.596940 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d236f0-7499-45a6-b8cd-7ef55a864599 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:12.597335 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d236f0-7499-45a6-b8cd-7ef55a864599 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:12.598119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d236f0-7499-45a6-b8cd-7ef55a864599 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:12.598429 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d236f0-7499-45a6-b8cd-7ef55a864599 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:12.600143 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d236f0-7499-45a6-b8cd-7ef55a864599 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:12.614565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 240/490] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:12.620365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466eb78d-c061-43a2-9e57-7d59d48d4b6a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:12.707536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2fdef-9d69-4a2b-9cf5-d6dd7aa23fbe None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:12.707730 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2fdef-9d69-4a2b-9cf5-d6dd7aa23fbe None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:12.708025 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2fdef-9d69-4a2b-9cf5-d6dd7aa23fbe None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:12.710916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 241/491] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:12.715517 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe6d82-0370-4002-9b4c-99e64077a927 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:12.715835 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe6d82-0370-4002-9b4c-99e64077a927 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:12.716110 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe6d82-0370-4002-9b4c-99e64077a927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:12.732840 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:12.735874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-9ebe6d82-0370-4002-9b4c-99e64077a927 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:12.737225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-9ebe6d82-0370-4002-9b4c-99e64077a927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:12.806047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466eb78d-c061-43a2-9e57-7d59d48d4b6a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:12.823894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 242/492] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:12.824953 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe6d82-0370-4002-9b4c-99e64077a927 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:12.846506 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:12.851966 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a498d-08de-4e7a-b274-f088925a762b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:12.852843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a498d-08de-4e7a-b274-f088925a762b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:12.853132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a498d-08de-4e7a-b274-f088925a762b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:12.853807 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a498d-08de-4e7a-b274-f088925a762b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:12.863838 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a498d-08de-4e7a-b274-f088925a762b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:12.865822 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a498d-08de-4e7a-b274-f088925a762b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:12.881185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-3f5a498d-08de-4e7a-b274-f088925a762b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 14:15:12.881185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:12.881185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:12.881185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:12.881185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:12.881185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:12.881185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:12.881185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:12.881185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:12.881185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:12.881185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:12.881185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:12.881185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:15:12.881185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:15:12.881185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:15:12.881185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:15:12.882195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:12.882195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:12.882195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:15:12.882195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:12.882195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:15:12.882195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:12.882195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:12.882195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:12.882195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:12.882195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:12.882195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:12.882195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:12.882195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:12.882195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:12.882195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:12.882195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:12.882195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:12.882195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:12.883094 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:12.883094 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:12.883094 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:15:12.883094 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:15:12.883094 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:15:12.883094 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:15:12.883094 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:15:12.883094 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:15:12.883094 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 14:15:12.883094 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:12.883094 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 251/493] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:15:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:12.892986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a498d-08de-4e7a-b274-f088925a762b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:12.941133 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe6d82-0370-4002-9b4c-99e64077a927 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:12.980987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855396c5-aab1-4b4a-a27f-aacba1ed6d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:12.981654 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855396c5-aab1-4b4a-a27f-aacba1ed6d57 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:12.981928 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855396c5-aab1-4b4a-a27f-aacba1ed6d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:12.982200 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855396c5-aab1-4b4a-a27f-aacba1ed6d57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:12.995369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855396c5-aab1-4b4a-a27f-aacba1ed6d57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:15:13.001041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-855396c5-aab1-4b4a-a27f-aacba1ed6d57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:13.001041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:13.001041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:13.001041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:13.001041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:13.001041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:13.001041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:13.001041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:13.001041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:13.001041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:13.001041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:13.001041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:13.001041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:15:13.001041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:15:13.001041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:15:13.001041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:15:13.003028 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:15:13.003028 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:15:13.003028 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:15:13.003028 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:15:13.003028 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:13.003028 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:13.003028 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:13.003028 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:13.003028 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:13.003028 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:13.003028 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:13.003028 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:13.003028 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:13.003028 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:13.003028 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:13.003028 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:13.004691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:13.004691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:13.004691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:13.004691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:13.004691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:15:13.004691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:15:13.004691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:15:13.004691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:15:13.004691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:15:13.004691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:15:13.004691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:13.004691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:13.004691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 243/494] 10.222.0.62 () {56 vars in 1102 bytes} [Tue Oct 4 14:15:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:13.004691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855396c5-aab1-4b4a-a27f-aacba1ed6d57 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:13.096834 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:13.100365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a498d-08de-4e7a-b274-f088925a762b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:13.121877 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855396c5-aab1-4b4a-a27f-aacba1ed6d57 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:13.128931 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:13.146476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3303b-8a83-4c23-bf67-ae57690d159b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:13.147438 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3303b-8a83-4c23-bf67-ae57690d159b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:13.147934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3303b-8a83-4c23-bf67-ae57690d159b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:13.148362 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3303b-8a83-4c23-bf67-ae57690d159b None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:13.149412 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3303b-8a83-4c23-bf67-ae57690d159b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:13.149893 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3303b-8a83-4c23-bf67-ae57690d159b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:13.151616 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3303b-8a83-4c23-bf67-ae57690d159b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:13.167671 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8d1da-4fb8-4695-8598-b62aee51ce91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:13.168384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8d1da-4fb8-4695-8598-b62aee51ce91 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:13.168663 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8d1da-4fb8-4695-8598-b62aee51ce91 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:13.168936 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8d1da-4fb8-4695-8598-b62aee51ce91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:13.183482 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8d1da-4fb8-4695-8598-b62aee51ce91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:15:13.188985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-3de8d1da-4fb8-4695-8598-b62aee51ce91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:13.188985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:13.188985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:13.188985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:13.188985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:13.188985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:13.188985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:13.188985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:13.188985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:13.188985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:13.188985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:13.188985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:13.188985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:15:13.188985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:15:13.188985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:15:13.188985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:15:13.190078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:15:13.190078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:15:13.190078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:15:13.190078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:15:13.190078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:13.190078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:13.190078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:13.190078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:13.190078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:13.190078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:13.190078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:13.190078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:13.190078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:13.190078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:13.190078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:13.190078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:13.190899 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:13.190899 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:13.190899 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:13.190899 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:13.190899 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:15:13.190899 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:15:13.190899 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:15:13.190899 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:15:13.190899 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:15:13.190899 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:15:13.190899 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:13.190899 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:13.190899 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 244/495] 10.222.0.62 () {56 vars in 1102 bytes} [Tue Oct 4 14:15:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:13.191545 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8d1da-4fb8-4695-8598-b62aee51ce91 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:13.216038 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 252/496] 10.222.0.62 () {56 vars in 1137 bytes} [Tue Oct 4 14:15:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:13.217381 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3303b-8a83-4c23-bf67-ae57690d159b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:13.310727 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8d1da-4fb8-4695-8598-b62aee51ce91 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:13.340979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3303b-8a83-4c23-bf67-ae57690d159b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:13.352295 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fa294-d92a-43b1-8451-50071a169cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:13.352915 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fa294-d92a-43b1-8451-50071a169cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:13.353196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fa294-d92a-43b1-8451-50071a169cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:13.353464 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fa294-d92a-43b1-8451-50071a169cd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:13.354173 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34fa294-d92a-43b1-8451-50071a169cd3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:13.354475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34fa294-d92a-43b1-8451-50071a169cd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:13.355909 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34fa294-d92a-43b1-8451-50071a169cd3 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:13.362412 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:13.367867 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 245/497] 10.222.0.62 () {56 vars in 1103 bytes} [Tue Oct 4 14:15:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:13.369021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fa294-d92a-43b1-8451-50071a169cd3 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:13.405375 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68deba64-70a1-4487-8765-69aa401f5bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:13.406694 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deba64-70a1-4487-8765-69aa401f5bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:13.408106 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deba64-70a1-4487-8765-69aa401f5bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:13.408563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deba64-70a1-4487-8765-69aa401f5bf8 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:13.409267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68deba64-70a1-4487-8765-69aa401f5bf8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:13.409570 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68deba64-70a1-4487-8765-69aa401f5bf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:13.410960 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68deba64-70a1-4487-8765-69aa401f5bf8 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:13.420361 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 253/498] 10.222.0.62 () {56 vars in 1103 bytes} [Tue Oct 4 14:15:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:13.422796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670ea8b-7caf-4003-9acb-45aa19478250 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:13.422796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670ea8b-7caf-4003-9acb-45aa19478250 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:13.423470 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670ea8b-7caf-4003-9acb-45aa19478250 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:13.425219 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 254/499] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:13.428661 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670ea8b-7caf-4003-9acb-45aa19478250 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:13.474709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:13.494332 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fa294-d92a-43b1-8451-50071a169cd3 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:13.553571 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df97a09-8da2-4d51-ae80-3e85c90350bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:13.554591 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df97a09-8da2-4d51-ae80-3e85c90350bf None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:13.555064 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df97a09-8da2-4d51-ae80-3e85c90350bf None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:13.555540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df97a09-8da2-4d51-ae80-3e85c90350bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:13.556881 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670ea8b-7caf-4003-9acb-45aa19478250 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:13.598729 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ace6d-e5cf-4234-b88c-eac5292cccbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:13.599296 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ace6d-e5cf-4234-b88c-eac5292cccbd None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:13.599576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ace6d-e5cf-4234-b88c-eac5292cccbd None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:13.599898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ace6d-e5cf-4234-b88c-eac5292cccbd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:13.613517 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ace6d-e5cf-4234-b88c-eac5292cccbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:15:13.619089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-864ace6d-e5cf-4234-b88c-eac5292cccbd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:13.619089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:13.619089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:13.619089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:13.619089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:13.619089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:13.619089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:13.619089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:13.619089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:13.619089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:13.619089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:13.619089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:13.619089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:15:13.619089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:15:13.619089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:15:13.619089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:15:13.624536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:15:13.624536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:15:13.624536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:15:13.624536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:15:13.624536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:13.624536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:13.624536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:13.624536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:13.624536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:13.624536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:13.624536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:13.624536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:13.624536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:13.624536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:13.624536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:13.624536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:13.626753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:13.626753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:13.626753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:13.626753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:13.626753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:15:13.626753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:15:13.626753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:15:13.626753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:15:13.626753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:15:13.626753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:15:13.626753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:13.626753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:13.626753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 255/500] 10.222.0.62 () {56 vars in 1102 bytes} [Tue Oct 4 14:15:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:13.626753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ace6d-e5cf-4234-b88c-eac5292cccbd None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:13.672483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:13.675816 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df97a09-8da2-4d51-ae80-3e85c90350bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:13.677990 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df97a09-8da2-4d51-ae80-3e85c90350bf None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:13.755177 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:13.766566 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ace6d-e5cf-4234-b88c-eac5292cccbd None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:13.814540 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846e659-de3e-4fdd-817c-7824a5490f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:13.815361 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846e659-de3e-4fdd-817c-7824a5490f80 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:13.815796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846e659-de3e-4fdd-817c-7824a5490f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:13.816206 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846e659-de3e-4fdd-817c-7824a5490f80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:13.822058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 246/501] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:15:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:15:13.823170 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df97a09-8da2-4d51-ae80-3e85c90350bf None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:13.831983 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846e659-de3e-4fdd-817c-7824a5490f80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:13.834498 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846e659-de3e-4fdd-817c-7824a5490f80 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:13.861267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-e846e659-de3e-4fdd-817c-7824a5490f80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:13.861267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:13.861267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:13.861267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:13.861267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:13.861267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:13.861267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:13.861267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:13.861267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:13.861267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:13.861267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:13.861267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:13.861267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:13.861267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:13.861267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:13.861267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:13.862299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:13.862299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:13.862299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:13.862299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:13.862299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:13.862299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:13.862299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:13.862299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:13.862299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:13.862299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:13.862299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:13.862299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:13.862299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:13.862299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:13.862299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:13.862299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:13.862299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:13.863265 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:13.863265 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:13.863265 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:13.863265 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 256/502] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:13.864966 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d512e0b-9b16-4b68-9ff5-cb8e846605d6 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:13.865366 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d512e0b-9b16-4b68-9ff5-cb8e846605d6 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:13.865760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d512e0b-9b16-4b68-9ff5-cb8e846605d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:13.894154 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-5d512e0b-9b16-4b68-9ff5-cb8e846605d6 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:13.895863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5d512e0b-9b16-4b68-9ff5-cb8e846605d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:13.996408 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:14.000433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df97a09-8da2-4d51-ae80-3e85c90350bf None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:14.006132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 257/503] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:14.007216 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d512e0b-9b16-4b68-9ff5-cb8e846605d6 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:14.067438 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4b5fa-3e65-48f8-8162-ff6443cf864d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:14.068389 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4b5fa-3e65-48f8-8162-ff6443cf864d None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:14.068822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4b5fa-3e65-48f8-8162-ff6443cf864d None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:14.069255 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4b5fa-3e65-48f8-8162-ff6443cf864d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:14.086421 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4b5fa-3e65-48f8-8162-ff6443cf864d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:14.088674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4b5fa-3e65-48f8-8162-ff6443cf864d None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:14.115561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-dee4b5fa-3e65-48f8-8162-ff6443cf864d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:14.115561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:14.115561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:14.115561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:14.115561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:14.115561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:14.115561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:14.115561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:14.115561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:14.115561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:14.115561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:14.115561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:14.115561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:14.115561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:14.115561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:14.115561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:14.118022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:14.118022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:14.118022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:14.118022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:14.118022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:14.118022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:14.118022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:14.118022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:14.118022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:14.118022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:14.118022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:14.118022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:14.118022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:14.118022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:14.118022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:14.118022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:14.118022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:14.122175 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:14.122175 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:14.122175 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:14.122175 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 247/504] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:14.122175 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4b5fa-3e65-48f8-8162-ff6443cf864d None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:14.161555 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:14.206571 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d512e0b-9b16-4b68-9ff5-cb8e846605d6 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:14.264082 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818f244-6168-4274-a231-46b84be0f9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:14.265043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818f244-6168-4274-a231-46b84be0f9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:14.266031 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818f244-6168-4274-a231-46b84be0f9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:14.266462 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818f244-6168-4274-a231-46b84be0f9a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:14.267626 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818f244-6168-4274-a231-46b84be0f9a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:14.268133 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818f244-6168-4274-a231-46b84be0f9a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:14.270584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818f244-6168-4274-a231-46b84be0f9a3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:14.286575 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 258/505] 10.222.0.62 () {56 vars in 1103 bytes} [Tue Oct 4 14:15:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:14.294481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818f244-6168-4274-a231-46b84be0f9a3 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:14.303630 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4b5fa-3e65-48f8-8162-ff6443cf864d None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:14.365007 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df39c5f-ebc0-4d52-b3fb-6c9dab71cdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:14.366065 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df39c5f-ebc0-4d52-b3fb-6c9dab71cdde None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:14.366461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df39c5f-ebc0-4d52-b3fb-6c9dab71cdde None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:14.366799 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df39c5f-ebc0-4d52-b3fb-6c9dab71cdde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:14.386265 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df39c5f-ebc0-4d52-b3fb-6c9dab71cdde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:14.388046 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df39c5f-ebc0-4d52-b3fb-6c9dab71cdde None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:14.414940 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-2df39c5f-ebc0-4d52-b3fb-6c9dab71cdde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:14.414940 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:14.414940 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:14.414940 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:14.414940 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:14.414940 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:14.414940 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:14.414940 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:14.414940 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:14.414940 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:14.414940 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:14.414940 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:14.414940 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:14.414940 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:14.414940 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:14.414940 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:14.417269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:14.417269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:14.417269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:14.417269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:14.417269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:14.417269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:14.417269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:14.417269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:14.417269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:14.417269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:14.417269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:14.417269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:14.417269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:14.417269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:14.417269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:14.417269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:14.417269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:14.419386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:14.419386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:14.419386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:14.419386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 248/506] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:14.419386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df39c5f-ebc0-4d52-b3fb-6c9dab71cdde None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:14.425656 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:14.458149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818f244-6168-4274-a231-46b84be0f9a3 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:14.497848 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea645b-b30f-4315-a752-b0e0c5cc9cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:14.498476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea645b-b30f-4315-a752-b0e0c5cc9cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:14.498752 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea645b-b30f-4315-a752-b0e0c5cc9cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:14.499023 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea645b-b30f-4315-a752-b0e0c5cc9cf9 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:14.499754 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea645b-b30f-4315-a752-b0e0c5cc9cf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:14.500664 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea645b-b30f-4315-a752-b0e0c5cc9cf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:14.502408 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea645b-b30f-4315-a752-b0e0c5cc9cf9 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:14.510420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:14.517364 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 259/507] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:14.518340 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea645b-b30f-4315-a752-b0e0c5cc9cf9 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:14.600449 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df39c5f-ebc0-4d52-b3fb-6c9dab71cdde None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:14.652269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dab49-2c04-441a-af5c-e49ae5ba6ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:14.653133 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dab49-2c04-441a-af5c-e49ae5ba6ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:14.653576 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dab49-2c04-441a-af5c-e49ae5ba6ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:14.654003 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dab49-2c04-441a-af5c-e49ae5ba6ff7 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:14.655080 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dab49-2c04-441a-af5c-e49ae5ba6ff7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:14.655479 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dab49-2c04-441a-af5c-e49ae5ba6ff7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:14.657849 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dab49-2c04-441a-af5c-e49ae5ba6ff7 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:14.673753 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 249/508] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:14.674939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dab49-2c04-441a-af5c-e49ae5ba6ff7 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:14.687072 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea645b-b30f-4315-a752-b0e0c5cc9cf9 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:14.731969 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f477c-3e81-472f-87e2-990ba90da1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:14.732704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f477c-3e81-472f-87e2-990ba90da1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:14.733038 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f477c-3e81-472f-87e2-990ba90da1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:14.733382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f477c-3e81-472f-87e2-990ba90da1a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:14.749161 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f477c-3e81-472f-87e2-990ba90da1a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:14.752379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f477c-3e81-472f-87e2-990ba90da1a3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:14.756812 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:14.773639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-2a2f477c-3e81-472f-87e2-990ba90da1a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:14.773639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:14.773639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:14.773639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:14.773639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:14.773639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:14.773639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:14.773639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:14.773639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:14.773639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:14.773639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:14.773639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:14.773639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:14.773639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:14.773639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:14.773639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:14.775479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:14.775479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:14.775479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:14.775479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:14.775479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:14.775479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:14.775479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:14.775479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:14.775479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:14.775479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:14.775479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:14.775479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:14.775479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:14.775479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:14.775479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:14.775479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:14.775479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:14.777461 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:14.777461 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:14.777461 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:14.779936 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 260/509] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:14.782079 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f477c-3e81-472f-87e2-990ba90da1a3 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:14.817438 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dab49-2c04-441a-af5c-e49ae5ba6ff7 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:14.849909 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:14.879394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5f19d-78b1-4f07-93e5-c14d7f796843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:14.880488 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5f19d-78b1-4f07-93e5-c14d7f796843 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:14.880918 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5f19d-78b1-4f07-93e5-c14d7f796843 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:14.881277 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5f19d-78b1-4f07-93e5-c14d7f796843 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:14.900814 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5f19d-78b1-4f07-93e5-c14d7f796843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:14.903555 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5f19d-78b1-4f07-93e5-c14d7f796843 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:14.911745 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f477c-3e81-472f-87e2-990ba90da1a3 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:14.928169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-6bc5f19d-78b1-4f07-93e5-c14d7f796843 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:14.928169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:14.928169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:14.928169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:14.928169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:14.928169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:14.928169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:14.928169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:14.928169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:14.928169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:14.928169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:14.928169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:14.928169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:14.928169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:14.928169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:14.928169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:14.929956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:14.929956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:14.929956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:14.929956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:14.929956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:14.929956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:14.929956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:14.929956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:14.929956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:14.929956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:14.929956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:14.929956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:14.929956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:14.929956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:14.929956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:14.929956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:14.929956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:14.931700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:14.931700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:14.931700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:14.931700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 250/510] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:14.931700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5f19d-78b1-4f07-93e5-c14d7f796843 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:14.967946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8c082-0d18-437e-8444-3ff00667248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:14.968981 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8c082-0d18-437e-8444-3ff00667248c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:14.969418 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8c082-0d18-437e-8444-3ff00667248c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:14.970010 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8c082-0d18-437e-8444-3ff00667248c None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:14.970897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8c082-0d18-437e-8444-3ff00667248c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:14.971351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8c082-0d18-437e-8444-3ff00667248c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:14.973745 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8c082-0d18-437e-8444-3ff00667248c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:15.001167 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 261/511] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:15.001167 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8c082-0d18-437e-8444-3ff00667248c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:15.080118 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5f19d-78b1-4f07-93e5-c14d7f796843 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:15.103876 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:15.130592 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769b7d1-a818-4bee-837b-a625d92fe5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:15.131454 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769b7d1-a818-4bee-837b-a625d92fe5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:15.131925 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769b7d1-a818-4bee-837b-a625d92fe5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:15.132265 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769b7d1-a818-4bee-837b-a625d92fe5a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:15.138411 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8c082-0d18-437e-8444-3ff00667248c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:15.143235 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769b7d1-a818-4bee-837b-a625d92fe5a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:15.145033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769b7d1-a818-4bee-837b-a625d92fe5a0 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:15.153721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:15.163783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-9769b7d1-a818-4bee-837b-a625d92fe5a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 14:15:15.163783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:15.163783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:15.163783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:15.163783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:15.163783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:15.163783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:15.163783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:15.163783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:15.163783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:15.163783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:15.163783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:15.163783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:15:15.163783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:15:15.163783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:15:15.163783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:15:15.173351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:15.173351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:15.173351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:15:15.173351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:15.173351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:15:15.173351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:15.173351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:15.173351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:15.173351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:15.173351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:15.173351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:15.173351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:15.173351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:15.173351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:15.173351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:15.173351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:15.173351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:15.173351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:15.175503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:15.175503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:15.175503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:15:15.175503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:15:15.175503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:15:15.175503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:15:15.175503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:15:15.175503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:15:15.175503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 14:15:15.175503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:15.175503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 251/512] 10.222.0.62 () {56 vars in 1093 bytes} [Tue Oct 4 14:15:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:15.175503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769b7d1-a818-4bee-837b-a625d92fe5a0 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:15.194117 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0b0dc-54d4-43da-80cf-04259cca0fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:15.195107 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0b0dc-54d4-43da-80cf-04259cca0fff None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:15.195533 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0b0dc-54d4-43da-80cf-04259cca0fff None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:15.195925 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0b0dc-54d4-43da-80cf-04259cca0fff None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:15.207745 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0b0dc-54d4-43da-80cf-04259cca0fff None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:15.209577 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0b0dc-54d4-43da-80cf-04259cca0fff None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:15.229091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-71c0b0dc-54d4-43da-80cf-04259cca0fff None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 14:15:15.229091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:15.229091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:15.229091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:15.229091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:15.229091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:15.229091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:15.229091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:15.229091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:15.229091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:15.229091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:15.229091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:15.229091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:15:15.229091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:15:15.229091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:15:15.229091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:15:15.230119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:15.230119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:15.230119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:15:15.230119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:15.230119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:15:15.230119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:15.230119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:15.230119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:15.230119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:15.230119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:15.230119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:15.230119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:15.230119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:15.230119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:15.230119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:15.230119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:15.230119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:15.230119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:15.230998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:15.230998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:15.230998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:15:15.230998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:15:15.230998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:15:15.230998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:15:15.230998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:15:15.230998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:15:15.230998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 14:15:15.230998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:15.231873 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 262/513] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:15:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:15.232956 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0b0dc-54d4-43da-80cf-04259cca0fff None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:15.314036 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769b7d1-a818-4bee-837b-a625d92fe5a0 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:15.363695 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53105234-bd4b-4e3e-93ee-ff7a2458d4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:15.364743 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53105234-bd4b-4e3e-93ee-ff7a2458d4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:15.365219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53105234-bd4b-4e3e-93ee-ff7a2458d4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:15.365851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53105234-bd4b-4e3e-93ee-ff7a2458d4a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:15.367123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53105234-bd4b-4e3e-93ee-ff7a2458d4a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:15.367627 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53105234-bd4b-4e3e-93ee-ff7a2458d4a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:15.369991 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0b0dc-54d4-43da-80cf-04259cca0fff None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:15.370262 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53105234-bd4b-4e3e-93ee-ff7a2458d4a3 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:15.389626 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 252/514] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:15.391619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53105234-bd4b-4e3e-93ee-ff7a2458d4a3 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:15.425617 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e2982-630a-4237-b065-c6eaab504e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:15.426141 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e2982-630a-4237-b065-c6eaab504e5a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:15.426480 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e2982-630a-4237-b065-c6eaab504e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:15.426755 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e2982-630a-4237-b065-c6eaab504e5a None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:15.427420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e2982-630a-4237-b065-c6eaab504e5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:15.427742 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e2982-630a-4237-b065-c6eaab504e5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:15.429152 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e2982-630a-4237-b065-c6eaab504e5a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:15.438569 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:15.447531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 263/515] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:15.448863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e2982-630a-4237-b065-c6eaab504e5a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:15.486146 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:15.532389 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53105234-bd4b-4e3e-93ee-ff7a2458d4a3 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:15.586973 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b492c9c-b20d-4d3c-bfee-b9a11cfe87d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:15.587242 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e2982-630a-4237-b065-c6eaab504e5a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:15.588051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b492c9c-b20d-4d3c-bfee-b9a11cfe87d1 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:15.588543 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b492c9c-b20d-4d3c-bfee-b9a11cfe87d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:15.589009 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b492c9c-b20d-4d3c-bfee-b9a11cfe87d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:15.601896 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b492c9c-b20d-4d3c-bfee-b9a11cfe87d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:15.604775 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b492c9c-b20d-4d3c-bfee-b9a11cfe87d1 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:15.627739 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681b04a-5bf6-414f-b097-b15664d4dc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:15.628045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-8b492c9c-b20d-4d3c-bfee-b9a11cfe87d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:15.628045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:15.628045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:15.628045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:15.628045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:15.628045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:15.628045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:15.628045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:15.628045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:15.628045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:15.628045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:15.628045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:15.628045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:15:15.628045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:15:15.628045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:15:15.629694 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:15:15.629694 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:15.629694 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:15.629694 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:15.629694 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:15.629694 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:15.629694 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:15.629694 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:15.629694 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:15.629694 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:15.629694 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:15.629694 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:15.629694 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:15.629694 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:15.629694 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:15.629694 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:15.629694 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:15.631334 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:15:15.631334 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:15:15.631334 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:15:15.631334 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:15:15.631334 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:15:15.631334 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:15:15.631334 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:15.631334 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:15.632226 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681b04a-5bf6-414f-b097-b15664d4dc7a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:15.632226 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681b04a-5bf6-414f-b097-b15664d4dc7a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:15.632226 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681b04a-5bf6-414f-b097-b15664d4dc7a None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:15.632226 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681b04a-5bf6-414f-b097-b15664d4dc7a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:15.632226 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681b04a-5bf6-414f-b097-b15664d4dc7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:15.632763 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 253/516] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:15:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:15.632896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681b04a-5bf6-414f-b097-b15664d4dc7a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:15.633020 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b492c9c-b20d-4d3c-bfee-b9a11cfe87d1 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:15.654027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 264/517] 10.222.0.62 () {56 vars in 1133 bytes} [Tue Oct 4 14:15:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:15.655485 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681b04a-5bf6-414f-b097-b15664d4dc7a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:15.775535 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:15.784974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b492c9c-b20d-4d3c-bfee-b9a11cfe87d1 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:15.788267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:15.806447 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681b04a-5bf6-414f-b097-b15664d4dc7a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:15.847440 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3c9fa-3a2b-4a9f-bd6b-15f65f170be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:15.848484 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3c9fa-3a2b-4a9f-bd6b-15f65f170be8 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:15.848956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3c9fa-3a2b-4a9f-bd6b-15f65f170be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:15.849417 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3c9fa-3a2b-4a9f-bd6b-15f65f170be8 None admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:15.849637 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3711ce-08ed-4577-8093-17d22e9f64b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:15.850289 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3711ce-08ed-4577-8093-17d22e9f64b3 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:15.850567 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3711ce-08ed-4577-8093-17d22e9f64b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:15.850745 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3c9fa-3a2b-4a9f-bd6b-15f65f170be8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:15.850885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3711ce-08ed-4577-8093-17d22e9f64b3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:15.851285 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3c9fa-3a2b-4a9f-bd6b-15f65f170be8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:15.854042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3c9fa-3a2b-4a9f-bd6b-15f65f170be8 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:15.859331 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3711ce-08ed-4577-8093-17d22e9f64b3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:15.861436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3711ce-08ed-4577-8093-17d22e9f64b3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:15.874271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-0e3711ce-08ed-4577-8093-17d22e9f64b3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 14:15:15.874271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:15.874271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:15.874271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:15.874271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:15.874271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:15.874271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:15.874271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:15.874271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:15.874271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:15.874271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:15.874271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:15.874271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:15:15.874271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:15:15.874271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:15:15.874271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:15:15.876136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:15.876136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:15.876136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:15:15.876136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:15.876136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:15:15.876136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:15.876136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:15.876136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:15.876136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:15.876136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:15.876136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:15.876136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:15.876136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:15.876136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:15.876136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:15.876136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:15.876136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:15.876136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:15.882526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:15.882526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:15.882526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:15:15.882526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:15:15.882526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:15:15.882526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:15:15.882526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:15:15.882526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:15:15.882526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 14:15:15.882526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:15.882526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 265/518] 10.222.0.62 () {56 vars in 1102 bytes} [Tue Oct 4 14:15:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:15.882526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3711ce-08ed-4577-8093-17d22e9f64b3 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:15.936995 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 254/519] 10.222.0.62 () {56 vars in 1137 bytes} [Tue Oct 4 14:15:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:15.936995 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3c9fa-3a2b-4a9f-bd6b-15f65f170be8 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:16.006207 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3711ce-08ed-4577-8093-17d22e9f64b3 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:16.046135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349563a2-69c3-4e01-b405-e72ddc0ba234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:16.046711 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349563a2-69c3-4e01-b405-e72ddc0ba234 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:16.047625 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349563a2-69c3-4e01-b405-e72ddc0ba234 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:16.047942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349563a2-69c3-4e01-b405-e72ddc0ba234 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:16.048594 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349563a2-69c3-4e01-b405-e72ddc0ba234 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:16.050095 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349563a2-69c3-4e01-b405-e72ddc0ba234 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:16.076128 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 266/520] 10.222.0.62 () {60 vars in 1132 bytes} [Tue Oct 4 14:15:15 2022] POST /identity/v3/users => generated 247 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:15:16.076785 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349563a2-69c3-4e01-b405-e72ddc0ba234 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:16.082555 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:16.125457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3c9fa-3a2b-4a9f-bd6b-15f65f170be8 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:16.178576 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf660bf-7464-43a3-870b-d1a0fe82e39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:16.179603 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf660bf-7464-43a3-870b-d1a0fe82e39a None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:16.179603 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf660bf-7464-43a3-870b-d1a0fe82e39a None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:16.179908 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf660bf-7464-43a3-870b-d1a0fe82e39a None admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:16.180506 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf660bf-7464-43a3-870b-d1a0fe82e39a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:16.180812 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf660bf-7464-43a3-870b-d1a0fe82e39a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:16.182318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf660bf-7464-43a3-870b-d1a0fe82e39a None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:16.216292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 255/521] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:15:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:16.217853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf660bf-7464-43a3-870b-d1a0fe82e39a None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:16.243140 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:16.274217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349563a2-69c3-4e01-b405-e72ddc0ba234 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:16.346612 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d899072-b77e-4f58-a94f-e9959bbc656f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:16.347346 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d899072-b77e-4f58-a94f-e9959bbc656f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:16.347650 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d899072-b77e-4f58-a94f-e9959bbc656f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:16.348091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d899072-b77e-4f58-a94f-e9959bbc656f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:16.410009 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf660bf-7464-43a3-870b-d1a0fe82e39a None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:16.467485 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d899072-b77e-4f58-a94f-e9959bbc656f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:16.470376 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d899072-b77e-4f58-a94f-e9959bbc656f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:16.470659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312b344-dc87-4aac-a466-567093d029e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:16.471659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312b344-dc87-4aac-a466-567093d029e7 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:16.472168 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312b344-dc87-4aac-a466-567093d029e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:16.472638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312b344-dc87-4aac-a466-567093d029e7 None admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:16.473975 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312b344-dc87-4aac-a466-567093d029e7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:16.474507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312b344-dc87-4aac-a466-567093d029e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:16.476547 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:16.477455 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312b344-dc87-4aac-a466-567093d029e7 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:16.511490 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 256/522] 10.222.0.62 () {56 vars in 1139 bytes} [Tue Oct 4 14:15:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:16.513102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312b344-dc87-4aac-a466-567093d029e7 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:16.625391 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:16.679944 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 267/523] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:15:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:15:16.679944 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d899072-b77e-4f58-a94f-e9959bbc656f None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:16.691855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312b344-dc87-4aac-a466-567093d029e7 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:16.738813 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192a78c-b098-41e1-8ab4-fe7275b07354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:16.739644 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192a78c-b098-41e1-8ab4-fe7275b07354 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:16.739970 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192a78c-b098-41e1-8ab4-fe7275b07354 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:16.740227 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192a78c-b098-41e1-8ab4-fe7275b07354 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:16.852260 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d899072-b77e-4f58-a94f-e9959bbc656f None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:16.858664 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:16.861238 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192a78c-b098-41e1-8ab4-fe7275b07354 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:16.864165 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192a78c-b098-41e1-8ab4-fe7275b07354 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:16.934575 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883a270-d808-43b4-96f1-e0fcce273429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:16.935701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883a270-d808-43b4-96f1-e0fcce273429 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:16.936304 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883a270-d808-43b4-96f1-e0fcce273429 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:16.936866 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883a270-d808-43b4-96f1-e0fcce273429 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:16.939184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883a270-d808-43b4-96f1-e0fcce273429 None admin] RBAC: Adding query filter params (role.id=e5d031634de14f1e86b912ddddfe7f8c, scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba, user.id=289b020c9cd242dca9b512803199daae) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:16.939928 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883a270-d808-43b4-96f1-e0fcce273429 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:16.942712 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883a270-d808-43b4-96f1-e0fcce273429 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:16.963806 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 268/524] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:15:16 2022] GET /identity/v3/role_assignments?user.id=289b020c9cd242dca9b512803199daae&scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba&role.id=e5d031634de14f1e86b912ddddfe7f8c => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:16.963806 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883a270-d808-43b4-96f1-e0fcce273429 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:17.023521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:17.110989 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 257/525] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:15:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:15:17.112870 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192a78c-b098-41e1-8ab4-fe7275b07354 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:17.206683 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883a270-d808-43b4-96f1-e0fcce273429 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:17.255116 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330bc59-de0b-489f-9647-6dd4f73a579f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:17.255789 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330bc59-de0b-489f-9647-6dd4f73a579f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:17.256047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330bc59-de0b-489f-9647-6dd4f73a579f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:17.256319 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330bc59-de0b-489f-9647-6dd4f73a579f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:17.315359 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:17.341592 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192a78c-b098-41e1-8ab4-fe7275b07354 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:17.397729 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330bc59-de0b-489f-9647-6dd4f73a579f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:17.401353 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330bc59-de0b-489f-9647-6dd4f73a579f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:17.418112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b46b5-e83b-43c4-bc59-3a343879bf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:17.419302 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b46b5-e83b-43c4-bc59-3a343879bf3d None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:17.419943 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b46b5-e83b-43c4-bc59-3a343879bf3d None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:17.422138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b46b5-e83b-43c4-bc59-3a343879bf3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:17.452357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b46b5-e83b-43c4-bc59-3a343879bf3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:17.456077 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b46b5-e83b-43c4-bc59-3a343879bf3d None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:17.483433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-669b46b5-e83b-43c4-bc59-3a343879bf3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:17.483433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:17.483433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:17.483433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:17.483433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:17.483433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:17.483433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:17.483433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:17.483433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:17.483433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:17.483433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:17.483433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:17.483433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:17.483433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:17.483433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:17.483433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:17.486023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:17.486023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:17.486023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:17.486023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:17.486023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:17.486023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:17.486023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:17.486023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:17.486023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:17.486023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:17.486023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:17.486023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:17.486023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:17.486023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:17.486023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:17.486023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:17.486023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:17.488113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:17.488113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:17.488113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:17.488113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 258/526] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:17.488113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b46b5-e83b-43c4-bc59-3a343879bf3d None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:17.525755 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:17.644344 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 269/527] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:15:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:15:17.646216 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330bc59-de0b-489f-9647-6dd4f73a579f None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:17.681842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b46b5-e83b-43c4-bc59-3a343879bf3d None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:17.755649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:17.779285 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266f352-8f6c-4b3c-885f-d02c57e6857a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:17.785281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266f352-8f6c-4b3c-885f-d02c57e6857a None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:17.785827 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266f352-8f6c-4b3c-885f-d02c57e6857a None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:17.786301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266f352-8f6c-4b3c-885f-d02c57e6857a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:17.808973 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330bc59-de0b-489f-9647-6dd4f73a579f None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:17.816831 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266f352-8f6c-4b3c-885f-d02c57e6857a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:17.826475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266f352-8f6c-4b3c-885f-d02c57e6857a None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:17.868510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-8266f352-8f6c-4b3c-885f-d02c57e6857a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:17.868510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:17.868510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:17.868510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:17.868510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:17.868510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:17.868510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:17.868510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:17.868510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:17.868510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:17.868510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:17.868510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:17.868510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:17.868510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:17.868510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:17.868510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:17.870320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:17.870320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:17.870320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:17.870320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:17.870320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:17.870320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:17.870320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:17.870320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:17.870320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:17.870320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:17.870320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:17.870320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:17.870320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:17.870320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:17.870320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:17.870320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:17.870320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:17.872087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:17.872087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:17.872087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:17.872426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eb059-0a0e-484d-8aaa-7a8d82b6b5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:17.872426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eb059-0a0e-484d-8aaa-7a8d82b6b5ca None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:17.872426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eb059-0a0e-484d-8aaa-7a8d82b6b5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:17.872426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eb059-0a0e-484d-8aaa-7a8d82b6b5ca None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:17.872903 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325eb059-0a0e-484d-8aaa-7a8d82b6b5ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:17.873030 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325eb059-0a0e-484d-8aaa-7a8d82b6b5ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:17.876239 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325eb059-0a0e-484d-8aaa-7a8d82b6b5ca None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:17.878618 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 259/528] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:17.880577 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266f352-8f6c-4b3c-885f-d02c57e6857a None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:17.894786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 270/529] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:17.895798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eb059-0a0e-484d-8aaa-7a8d82b6b5ca None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:18.036474 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eb059-0a0e-484d-8aaa-7a8d82b6b5ca None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:18.072017 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:18.084022 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604272b-52a8-4fae-a8b7-f9e158d70bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:18.084022 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604272b-52a8-4fae-a8b7-f9e158d70bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:18.084022 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604272b-52a8-4fae-a8b7-f9e158d70bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:18.084022 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604272b-52a8-4fae-a8b7-f9e158d70bf0 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:18.084710 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604272b-52a8-4fae-a8b7-f9e158d70bf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:18.085112 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604272b-52a8-4fae-a8b7-f9e158d70bf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:18.086481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604272b-52a8-4fae-a8b7-f9e158d70bf0 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:18.100359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:18.101665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 271/530] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:18.102791 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604272b-52a8-4fae-a8b7-f9e158d70bf0 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:18.153484 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266f352-8f6c-4b3c-885f-d02c57e6857a None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:18.226789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399627f-fb3b-46fd-9edf-09a195094487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:18.228152 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604272b-52a8-4fae-a8b7-f9e158d70bf0 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:18.228722 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399627f-fb3b-46fd-9edf-09a195094487 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:18.229785 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399627f-fb3b-46fd-9edf-09a195094487 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:18.230667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399627f-fb3b-46fd-9edf-09a195094487 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:18.253753 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399627f-fb3b-46fd-9edf-09a195094487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:18.257239 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399627f-fb3b-46fd-9edf-09a195094487 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:18.271849 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d291218-ee10-4a11-ba8f-b612984832e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:18.272508 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d291218-ee10-4a11-ba8f-b612984832e9 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:18.272809 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d291218-ee10-4a11-ba8f-b612984832e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:18.273261 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d291218-ee10-4a11-ba8f-b612984832e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:18.283539 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d291218-ee10-4a11-ba8f-b612984832e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:18.285172 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d291218-ee10-4a11-ba8f-b612984832e9 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:18.292665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-f399627f-fb3b-46fd-9edf-09a195094487 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:18.292665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:18.292665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:18.292665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:18.292665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:18.292665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:18.292665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:18.292665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:18.292665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:18.292665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:18.292665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:18.292665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:18.292665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:18.292665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:18.292665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:18.292665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:18.294383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:18.294383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:18.294383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:18.294383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:18.294383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:18.294383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:18.294383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:18.294383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:18.294383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:18.294383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:18.294383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:18.294383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:18.294383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:18.294383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:18.294383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:18.294383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:18.294383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:18.296165 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:18.296165 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:18.296165 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:18.303773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-7d291218-ee10-4a11-ba8f-b612984832e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:18.303773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:18.303773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:18.303773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:18.303773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:18.303773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:18.303773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:18.303773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:18.303773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:18.303773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:18.303773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:18.303773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:18.303773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:15:18.303773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:15:18.303773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:15:18.305805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:15:18.305805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:18.305805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:18.305805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:18.305805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:18.305805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:18.305805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:18.305805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:18.305805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:18.305805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:18.305805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:18.305805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:18.305805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:18.305805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:18.305805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:18.305805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:18.305805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:18.308420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:15:18.308420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:15:18.308420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:15:18.308420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:15:18.308420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:15:18.308420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:15:18.308420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:18.308420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:18.308420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 272/532] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:15:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:18.308420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d291218-ee10-4a11-ba8f-b612984832e9 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:18.309596 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 260/532] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:18.309596 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399627f-fb3b-46fd-9edf-09a195094487 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:18.401985 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:18.488950 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d291218-ee10-4a11-ba8f-b612984832e9 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:18.538208 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265d627-f65b-489e-8932-98a67d5fda16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:18.539010 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265d627-f65b-489e-8932-98a67d5fda16 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:18.539389 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265d627-f65b-489e-8932-98a67d5fda16 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:18.539808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265d627-f65b-489e-8932-98a67d5fda16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:18.546127 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399627f-fb3b-46fd-9edf-09a195094487 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:18.549685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265d627-f65b-489e-8932-98a67d5fda16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:18.551524 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265d627-f65b-489e-8932-98a67d5fda16 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:18.574466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-5265d627-f65b-489e-8932-98a67d5fda16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:18.574466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:18.574466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:18.574466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:18.574466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:18.574466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:18.574466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:18.574466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:18.574466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:18.574466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:18.574466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:18.574466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:18.574466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:15:18.574466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:15:18.574466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:15:18.575542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:15:18.575542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:18.575542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:18.575542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:18.575542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:18.575542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:18.575542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:18.575542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:18.575542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:18.575542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:18.575542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:18.575542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:18.575542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:18.575542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:18.575542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:18.575542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:18.575542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:18.576435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:15:18.576435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:15:18.576435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:15:18.576435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:15:18.576435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:15:18.576435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:15:18.576435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:18.576435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:18.579857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 273/533] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:15:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:18.581280 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265d627-f65b-489e-8932-98a67d5fda16 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:18.614159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:18.630495 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13d37a-2d05-4f1f-91d5-28351d3314dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:18.632229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13d37a-2d05-4f1f-91d5-28351d3314dd None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:18.632996 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13d37a-2d05-4f1f-91d5-28351d3314dd None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:18.633682 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13d37a-2d05-4f1f-91d5-28351d3314dd None admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:18.634599 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13d37a-2d05-4f1f-91d5-28351d3314dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:18.635191 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13d37a-2d05-4f1f-91d5-28351d3314dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:18.637756 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13d37a-2d05-4f1f-91d5-28351d3314dd None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:18.655555 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 261/534] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:15:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:15:18.657462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13d37a-2d05-4f1f-91d5-28351d3314dd None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:18.787917 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265d627-f65b-489e-8932-98a67d5fda16 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:18.801295 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13d37a-2d05-4f1f-91d5-28351d3314dd None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:18.809331 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:18.855356 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc1a0a-f1cb-44ee-b628-a1523413c681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:18.856317 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc1a0a-f1cb-44ee-b628-a1523413c681 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:18.856872 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc1a0a-f1cb-44ee-b628-a1523413c681 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:18.857339 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc1a0a-f1cb-44ee-b628-a1523413c681 None admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:18.857992 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c773ea2-00e7-4d3b-928a-8e6a0bd9caa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:18.858544 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc1a0a-f1cb-44ee-b628-a1523413c681 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:18.859153 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc1a0a-f1cb-44ee-b628-a1523413c681 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:18.859320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c773ea2-00e7-4d3b-928a-8e6a0bd9caa2 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:18.860265 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c773ea2-00e7-4d3b-928a-8e6a0bd9caa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:18.860841 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c773ea2-00e7-4d3b-928a-8e6a0bd9caa2 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:18.861514 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc1a0a-f1cb-44ee-b628-a1523413c681 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:18.861883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c773ea2-00e7-4d3b-928a-8e6a0bd9caa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:18.862484 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c773ea2-00e7-4d3b-928a-8e6a0bd9caa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:18.864996 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c773ea2-00e7-4d3b-928a-8e6a0bd9caa2 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:18.877561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 262/535] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:15:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:18.879572 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc1a0a-f1cb-44ee-b628-a1523413c681 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:18.889969 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 274/536] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:18.891661 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c773ea2-00e7-4d3b-928a-8e6a0bd9caa2 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:18.987464 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:19.045043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c773ea2-00e7-4d3b-928a-8e6a0bd9caa2 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:19.095455 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e59b67-87d9-4b6d-bed9-6559540e6663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:19.096409 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc1a0a-f1cb-44ee-b628-a1523413c681 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:19.096524 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e59b67-87d9-4b6d-bed9-6559540e6663 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:19.096961 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e59b67-87d9-4b6d-bed9-6559540e6663 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:19.097425 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e59b67-87d9-4b6d-bed9-6559540e6663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:19.098403 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e59b67-87d9-4b6d-bed9-6559540e6663 None admin] RBAC: Adding query filter params (role.id=e5d031634de14f1e86b912ddddfe7f8c, scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba, user.id=c5d3bf1c2d944d51a0fd0ff84be1c7e0) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:19.098892 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e59b67-87d9-4b6d-bed9-6559540e6663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:19.101002 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e59b67-87d9-4b6d-bed9-6559540e6663 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:19.110096 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 275/537] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:15:18 2022] GET /identity/v3/role_assignments?user.id=c5d3bf1c2d944d51a0fd0ff84be1c7e0&scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba&role.id=e5d031634de14f1e86b912ddddfe7f8c => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:19.111287 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e59b67-87d9-4b6d-bed9-6559540e6663 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:19.160091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:19.196217 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37148172-39b0-4f5e-bfc2-0f80c53ae924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:19.197700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37148172-39b0-4f5e-bfc2-0f80c53ae924 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:19.198211 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37148172-39b0-4f5e-bfc2-0f80c53ae924 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:19.198650 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37148172-39b0-4f5e-bfc2-0f80c53ae924 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:19.200237 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37148172-39b0-4f5e-bfc2-0f80c53ae924 None admin] RBAC: Adding query filter params (role.id=e5d031634de14f1e86b912ddddfe7f8c, scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba, user.id=151e7b9c7a7b46d58dc2f563d05775e2) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:19.200784 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37148172-39b0-4f5e-bfc2-0f80c53ae924 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:19.204560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37148172-39b0-4f5e-bfc2-0f80c53ae924 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:19.224606 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 263/538] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:15:18 2022] GET /identity/v3/role_assignments?user.id=151e7b9c7a7b46d58dc2f563d05775e2&scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba&role.id=e5d031634de14f1e86b912ddddfe7f8c => generated 259 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:19.262176 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e59b67-87d9-4b6d-bed9-6559540e6663 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:19.310856 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1a969-2cf1-41ed-b50b-7c6e97cf3f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:19.311794 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58134a4-530c-4256-b3b0-101fe63a60d1 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:19.312615 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58134a4-530c-4256-b3b0-101fe63a60d1 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:19.312892 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58134a4-530c-4256-b3b0-101fe63a60d1 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:19.313459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1a969-2cf1-41ed-b50b-7c6e97cf3f87 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:19.313944 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1a969-2cf1-41ed-b50b-7c6e97cf3f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:19.314405 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1a969-2cf1-41ed-b50b-7c6e97cf3f87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:19.314978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 264/539] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:19.323676 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1a969-2cf1-41ed-b50b-7c6e97cf3f87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:19.325258 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352653f1-2859-45cc-86ec-6a3a4d61edcf None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:19.325540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352653f1-2859-45cc-86ec-6a3a4d61edcf None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:19.325815 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352653f1-2859-45cc-86ec-6a3a4d61edcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:19.326443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1a969-2cf1-41ed-b50b-7c6e97cf3f87 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:19.342701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-35c1a969-2cf1-41ed-b50b-7c6e97cf3f87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:19.342701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:19.342701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:19.342701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:19.342701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:19.342701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:19.342701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:19.342701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:19.342701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:19.342701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:19.342701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:19.342701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:19.342701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:15:19.342701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:15:19.342701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:15:19.344580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:15:19.344580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:19.344580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:19.344580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:19.344580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:19.344580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:19.344580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:19.344580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:19.344580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:19.344580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:19.344580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:19.344580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:19.344580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:19.344580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:19.344580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:19.344580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:19.344580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:19.345700 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:15:19.345700 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:15:19.345700 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:15:19.345700 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:15:19.345700 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:15:19.345700 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:15:19.345700 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:19.345700 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:19.348424 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 276/540] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:15:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:19.358064 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1a969-2cf1-41ed-b50b-7c6e97cf3f87 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:19.372965 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-352653f1-2859-45cc-86ec-6a3a4d61edcf None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:19.374297 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-352653f1-2859-45cc-86ec-6a3a4d61edcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:19.508887 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:19.530802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1a969-2cf1-41ed-b50b-7c6e97cf3f87 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:19.534454 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 265/541] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:19.539234 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12beb843-8fa5-4543-9e1b-955334a07e98 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:19.539633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12beb843-8fa5-4543-9e1b-955334a07e98 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:19.539935 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12beb843-8fa5-4543-9e1b-955334a07e98 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:19.541581 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 266/542] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:15:19.550100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052d208-a0a0-4aee-b29a-59fb0efd8f4d None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:19.551010 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052d208-a0a0-4aee-b29a-59fb0efd8f4d None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:19.551010 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052d208-a0a0-4aee-b29a-59fb0efd8f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:19.571964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-f052d208-a0a0-4aee-b29a-59fb0efd8f4d None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:19.573372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f052d208-a0a0-4aee-b29a-59fb0efd8f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:19.602777 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b71c8-a4fc-4dce-812a-9242d14fb151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:19.603520 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b71c8-a4fc-4dce-812a-9242d14fb151 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:19.603827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b71c8-a4fc-4dce-812a-9242d14fb151 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:19.604166 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b71c8-a4fc-4dce-812a-9242d14fb151 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:19.605976 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b71c8-a4fc-4dce-812a-9242d14fb151 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:19.606311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b71c8-a4fc-4dce-812a-9242d14fb151 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:19.608885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b71c8-a4fc-4dce-812a-9242d14fb151 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:19.634384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:19.657467 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 277/543] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:15:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:15:19.665935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b71c8-a4fc-4dce-812a-9242d14fb151 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:19.746187 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 267/544] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 14:15:19.884945 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b71c8-a4fc-4dce-812a-9242d14fb151 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:19.975329 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723968cb-7f5d-46fb-a2f8-8eb330a42ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:19.976519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723968cb-7f5d-46fb-a2f8-8eb330a42ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:19.977003 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723968cb-7f5d-46fb-a2f8-8eb330a42ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:19.977483 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723968cb-7f5d-46fb-a2f8-8eb330a42ff9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:19.979005 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723968cb-7f5d-46fb-a2f8-8eb330a42ff9 None admin] RBAC: Adding query filter params (role.id=e5d031634de14f1e86b912ddddfe7f8c, scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba, user.id=624487005e4f4180a9d56a29a7daad1e) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:19.979543 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723968cb-7f5d-46fb-a2f8-8eb330a42ff9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:19.982015 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723968cb-7f5d-46fb-a2f8-8eb330a42ff9 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:19.998868 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 278/545] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:15:19 2022] GET /identity/v3/role_assignments?user.id=624487005e4f4180a9d56a29a7daad1e&scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba&role.id=e5d031634de14f1e86b912ddddfe7f8c => generated 259 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:15:20.063645 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052d208-a0a0-4aee-b29a-59fb0efd8f4d None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:20.095743 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723968cb-7f5d-46fb-a2f8-8eb330a42ff9 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:20.150590 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:20.299421 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052d208-a0a0-4aee-b29a-59fb0efd8f4d None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:20.336980 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723968cb-7f5d-46fb-a2f8-8eb330a42ff9 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:20.386426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d3b3f-f9f6-4b13-8b30-e0fa441b6892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:20.387093 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d3b3f-f9f6-4b13-8b30-e0fa441b6892 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:20.387370 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d3b3f-f9f6-4b13-8b30-e0fa441b6892 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:20.387781 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d3b3f-f9f6-4b13-8b30-e0fa441b6892 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:20.399745 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7cf028-f574-4929-9360-3a67a0de9d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:20.400475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cf028-f574-4929-9360-3a67a0de9d0e None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:20.400820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cf028-f574-4929-9360-3a67a0de9d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:20.401074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cf028-f574-4929-9360-3a67a0de9d0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:20.416645 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d3b3f-f9f6-4b13-8b30-e0fa441b6892 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:15:20.423040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-431d3b3f-f9f6-4b13-8b30-e0fa441b6892 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:20.423040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:20.423040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:20.423040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:20.423040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:20.423040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:20.423040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:20.423040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:20.423040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:20.423040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:20.423040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:20.423040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:20.423040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:15:20.423040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:15:20.423040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:15:20.423040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:15:20.424652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:15:20.424652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:15:20.424652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:15:20.424652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:15:20.424652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:20.424652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:20.424652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:20.424652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:20.424652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:20.424652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:20.424652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:20.424652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:20.424652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:20.424652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:20.424652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:20.424652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:20.425967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:20.425967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:20.425967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:20.425967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:20.425967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:15:20.425967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:15:20.425967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:15:20.425967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:15:20.425967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:15:20.425967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:15:20.425967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:20.425967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:20.427034 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 279/546] 10.222.0.62 () {56 vars in 1102 bytes} [Tue Oct 4 14:15:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:15:20.440075 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d3b3f-f9f6-4b13-8b30-e0fa441b6892 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:20.445420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7cf028-f574-4929-9360-3a67a0de9d0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:15:20.460884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-8e7cf028-f574-4929-9360-3a67a0de9d0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:20.460884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:20.460884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:20.460884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:20.460884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:20.460884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:20.460884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:20.460884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:20.460884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:20.460884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:20.460884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:20.460884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:20.460884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:15:20.460884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:15:20.460884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:15:20.460884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:15:20.462642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:15:20.462642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:15:20.462642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:15:20.462642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:15:20.462642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:20.462642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:20.462642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:20.462642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:20.462642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:20.462642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:20.462642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:20.462642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:20.462642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:20.462642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:20.462642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:20.462642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:20.464330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:20.464330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:20.464330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:20.464330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:20.464330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:15:20.464330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:15:20.464330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:15:20.464330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:15:20.464330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:15:20.464330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:15:20.464330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:20.464330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:20.474324 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 268/547] 10.222.0.62 () {56 vars in 1102 bytes} [Tue Oct 4 14:15:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:15:20.481357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7cf028-f574-4929-9360-3a67a0de9d0e None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:20.611923 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:20.709774 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:20.757550 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d3b3f-f9f6-4b13-8b30-e0fa441b6892 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:20.800861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7cf028-f574-4929-9360-3a67a0de9d0e None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:20.817270 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf584b-9762-420a-b483-3605df4ede3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:20.817917 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf584b-9762-420a-b483-3605df4ede3e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:20.818199 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf584b-9762-420a-b483-3605df4ede3e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:20.818458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf584b-9762-420a-b483-3605df4ede3e None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:20.819161 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf584b-9762-420a-b483-3605df4ede3e None admin] RBAC: Adding query filter params (name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:20.819465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf584b-9762-420a-b483-3605df4ede3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:20.821182 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf584b-9762-420a-b483-3605df4ede3e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:20.838796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 280/548] 10.222.0.62 () {56 vars in 1103 bytes} [Tue Oct 4 14:15:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:20.849750 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf584b-9762-420a-b483-3605df4ede3e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:20.869508 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b29cf-dd6b-454d-b090-023e433d9355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:20.870541 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b29cf-dd6b-454d-b090-023e433d9355 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:20.871049 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b29cf-dd6b-454d-b090-023e433d9355 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:20.871537 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b29cf-dd6b-454d-b090-023e433d9355 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:20.872474 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b29cf-dd6b-454d-b090-023e433d9355 None admin] RBAC: Adding query filter params (name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:20.872999 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b29cf-dd6b-454d-b090-023e433d9355 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:20.875923 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b29cf-dd6b-454d-b090-023e433d9355 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:20.892904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 269/549] 10.222.0.62 () {56 vars in 1103 bytes} [Tue Oct 4 14:15:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:20.900423 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b29cf-dd6b-454d-b090-023e433d9355 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:21.097406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf584b-9762-420a-b483-3605df4ede3e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:21.125807 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:21.142390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b29cf-dd6b-454d-b090-023e433d9355 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:21.183592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a462428-9f29-472c-9ab3-b91cb4d635e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:21.184283 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a462428-9f29-472c-9ab3-b91cb4d635e4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:21.184560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a462428-9f29-472c-9ab3-b91cb4d635e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:21.185139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a462428-9f29-472c-9ab3-b91cb4d635e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:21.200146 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:21.210910 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a462428-9f29-472c-9ab3-b91cb4d635e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:21.212430 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a462428-9f29-472c-9ab3-b91cb4d635e4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:21.232310 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45a288-65b5-46b7-b701-79c2b59f5201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:21.232968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45a288-65b5-46b7-b701-79c2b59f5201 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:21.233243 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45a288-65b5-46b7-b701-79c2b59f5201 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:21.233511 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45a288-65b5-46b7-b701-79c2b59f5201 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:21.244047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-6a462428-9f29-472c-9ab3-b91cb4d635e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:21.244047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:21.244047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:21.244047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:21.244047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:21.244047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:21.244047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:21.244047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:21.244047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:21.244047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:21.244047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:21.244047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:21.244047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:21.244047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:21.244047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:21.244047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:21.245045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:21.245045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:21.245045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:21.245045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:21.245045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:21.245045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:21.245045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:21.245045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:21.245045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:21.245045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:21.245045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:21.245045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:21.245045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:21.245045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:21.245045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:21.245045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:21.245045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:21.246133 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:21.246133 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:21.246133 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:21.251134 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 281/550] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:21.259991 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a462428-9f29-472c-9ab3-b91cb4d635e4 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:21.261614 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45a288-65b5-46b7-b701-79c2b59f5201 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:21.263417 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45a288-65b5-46b7-b701-79c2b59f5201 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:21.289667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-ed45a288-65b5-46b7-b701-79c2b59f5201 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:21.289667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:21.289667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:21.289667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:21.289667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:21.289667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:21.289667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:21.289667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:21.289667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:21.289667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:21.289667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:21.289667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:21.289667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:21.289667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:21.289667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:21.289667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:21.290696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:21.290696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:21.290696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:21.290696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:21.290696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:21.290696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:21.290696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:21.290696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:21.290696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:21.290696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:21.290696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:21.290696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:21.290696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:21.290696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:21.290696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:21.290696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:21.290696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:21.291590 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:21.291590 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:21.291590 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:21.295994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 270/551] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:21.309489 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45a288-65b5-46b7-b701-79c2b59f5201 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:21.392668 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a462428-9f29-472c-9ab3-b91cb4d635e4 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:21.445450 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073a44d-64af-4c8b-98e3-e8c28ee6ea56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:21.446133 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073a44d-64af-4c8b-98e3-e8c28ee6ea56 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:21.446414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073a44d-64af-4c8b-98e3-e8c28ee6ea56 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:21.446687 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073a44d-64af-4c8b-98e3-e8c28ee6ea56 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:21.447340 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073a44d-64af-4c8b-98e3-e8c28ee6ea56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:21.447640 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073a44d-64af-4c8b-98e3-e8c28ee6ea56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:21.449080 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073a44d-64af-4c8b-98e3-e8c28ee6ea56 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:21.477650 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 282/552] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:15:21.483900 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073a44d-64af-4c8b-98e3-e8c28ee6ea56 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:21.585287 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:21.595504 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45a288-65b5-46b7-b701-79c2b59f5201 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:21.652201 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d4f9e-2de3-4cb3-b89b-4a691bd098ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:21.653246 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d4f9e-2de3-4cb3-b89b-4a691bd098ef None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:21.653682 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d4f9e-2de3-4cb3-b89b-4a691bd098ef None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:21.656865 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d4f9e-2de3-4cb3-b89b-4a691bd098ef None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:21.657935 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d4f9e-2de3-4cb3-b89b-4a691bd098ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:21.658397 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d4f9e-2de3-4cb3-b89b-4a691bd098ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:21.665865 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d4f9e-2de3-4cb3-b89b-4a691bd098ef None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:21.703378 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 271/553] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:15:21.707764 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d4f9e-2de3-4cb3-b89b-4a691bd098ef None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:21.717963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073a44d-64af-4c8b-98e3-e8c28ee6ea56 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:21.728456 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:21.806892 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6091e34-d8b3-41e4-a588-32637c770baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:21.808959 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6091e34-d8b3-41e4-a588-32637c770baf None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:21.809722 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6091e34-d8b3-41e4-a588-32637c770baf None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:21.810805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6091e34-d8b3-41e4-a588-32637c770baf None admin] PATH_INFO: `/v3/users/swift` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:21.828707 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6091e34-d8b3-41e4-a588-32637c770baf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:21.832512 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6091e34-d8b3-41e4-a588-32637c770baf None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:21.862004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-b6091e34-d8b3-41e4-a588-32637c770baf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 14:15:21.862004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:21.862004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:21.862004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:21.862004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:21.862004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:21.862004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:21.862004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:21.862004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:21.862004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:21.862004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:21.862004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:21.862004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:15:21.862004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:15:21.862004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:15:21.862004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:15:21.863857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:21.863857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:21.863857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:15:21.863857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:21.863857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:15:21.863857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:21.863857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:21.863857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:21.863857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:21.863857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:21.863857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:21.863857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:21.863857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:21.863857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:21.863857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:21.863857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:21.863857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:21.863857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:21.865984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:21.865984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:21.865984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:15:21.865984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:15:21.865984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:15:21.865984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:15:21.865984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:15:21.865984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:15:21.865984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 14:15:21.865984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:21.870011 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 283/554] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:15:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:21.877261 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6091e34-d8b3-41e4-a588-32637c770baf None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:21.978737 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d4f9e-2de3-4cb3-b89b-4a691bd098ef None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:22.041341 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c949b-bd7a-433c-b002-a322716dddda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:22.042746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c949b-bd7a-433c-b002-a322716dddda None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:22.043024 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c949b-bd7a-433c-b002-a322716dddda None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:22.043293 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c949b-bd7a-433c-b002-a322716dddda None admin] PATH_INFO: `/v3/users/glance` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:22.057084 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c949b-bd7a-433c-b002-a322716dddda None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:22.058613 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c949b-bd7a-433c-b002-a322716dddda None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:22.089216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-5f4c949b-bd7a-433c-b002-a322716dddda None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 14:15:22.089216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:22.089216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:22.089216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:22.089216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:22.089216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:22.089216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:22.089216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:22.089216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:22.089216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:22.089216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:22.089216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:22.089216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:15:22.089216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:15:22.089216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:15:22.089216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:15:22.091565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:22.091565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:22.091565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:15:22.091565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:22.091565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:15:22.091565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:22.091565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:22.091565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:22.091565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:22.091565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:22.091565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:22.091565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:22.091565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:22.091565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:22.091565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:22.091565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:22.091565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:22.091565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:22.096236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:22.096236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:22.096236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:15:22.096236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:15:22.096236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:15:22.096236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:15:22.096236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:15:22.096236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:15:22.096236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 14:15:22.096236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:22.096236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 272/555] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:15:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:22.105513 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b9bf7-cf82-4d5a-aac0-f2a11730fc57 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:22.105513 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b9bf7-cf82-4d5a-aac0-f2a11730fc57 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:22.105513 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b9bf7-cf82-4d5a-aac0-f2a11730fc57 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:22.106601 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6091e34-d8b3-41e4-a588-32637c770baf None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:22.106862 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 273/556] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:22.111762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b9bf7-cf82-4d5a-aac0-f2a11730fc57 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:22.114409 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:22.153916 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba04132-1231-4978-8731-93a27c29aec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:22.154855 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba04132-1231-4978-8731-93a27c29aec0 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:22.155351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba04132-1231-4978-8731-93a27c29aec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:22.156523 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba04132-1231-4978-8731-93a27c29aec0 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:22.158228 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba04132-1231-4978-8731-93a27c29aec0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:22.158833 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba04132-1231-4978-8731-93a27c29aec0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:22.160616 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba04132-1231-4978-8731-93a27c29aec0 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:22.185408 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 284/557] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Oct 4 14:15:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:22.187562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6ffbb-735e-423e-958c-def223381393 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:22.188927 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6ffbb-735e-423e-958c-def223381393 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:22.189378 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6ffbb-735e-423e-958c-def223381393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:22.201452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:22.216918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e6e6ffbb-735e-423e-958c-def223381393 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:22.220475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e6e6ffbb-735e-423e-958c-def223381393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:22.246051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b9bf7-cf82-4d5a-aac0-f2a11730fc57 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:22.291115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19be5d-dbe8-44cf-9408-159e45a1341e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:22.291855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19be5d-dbe8-44cf-9408-159e45a1341e None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:22.292200 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19be5d-dbe8-44cf-9408-159e45a1341e None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:22.292545 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19be5d-dbe8-44cf-9408-159e45a1341e None admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:22.293389 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19be5d-dbe8-44cf-9408-159e45a1341e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:22.294054 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19be5d-dbe8-44cf-9408-159e45a1341e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:22.295313 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19be5d-dbe8-44cf-9408-159e45a1341e None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:22.322221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 274/558] 10.222.0.62 () {56 vars in 1137 bytes} [Tue Oct 4 14:15:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:22.322221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19be5d-dbe8-44cf-9408-159e45a1341e None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:22.344631 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 285/559] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:22.345855 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6ffbb-735e-423e-958c-def223381393 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:22.549695 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19be5d-dbe8-44cf-9408-159e45a1341e None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:22.608114 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:22.617343 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6ffbb-735e-423e-958c-def223381393 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:22.648678 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:22.683382 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f79cb-64ca-4a28-9ff1-95b69a6fcf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:22.684204 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3e509-2e5f-4490-be18-dc64be728493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:22.684416 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f79cb-64ca-4a28-9ff1-95b69a6fcf2b None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:22.684790 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3e509-2e5f-4490-be18-dc64be728493 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:22.684891 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f79cb-64ca-4a28-9ff1-95b69a6fcf2b None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:22.685070 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3e509-2e5f-4490-be18-dc64be728493 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:22.685342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3e509-2e5f-4490-be18-dc64be728493 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:22.685450 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f79cb-64ca-4a28-9ff1-95b69a6fcf2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:22.710687 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3e509-2e5f-4490-be18-dc64be728493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:22.712203 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3e509-2e5f-4490-be18-dc64be728493 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:22.736476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-34a3e509-2e5f-4490-be18-dc64be728493 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:22.736476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:22.736476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:22.736476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:22.736476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:22.736476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:22.736476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:22.736476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:22.736476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:22.736476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:22.736476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:22.736476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:22.736476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:22.736476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:22.736476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:22.736476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:22.737914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:22.737914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:22.737914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:22.737914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:22.737914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:22.737914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:22.737914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:22.737914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:22.737914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:22.737914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:22.737914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:22.737914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:22.737914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:22.737914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:22.737914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:22.737914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:22.737914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:22.738791 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:22.738791 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:22.738791 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:22.745580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 286/560] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:22.746876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3e509-2e5f-4490-be18-dc64be728493 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:22.801454 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f79cb-64ca-4a28-9ff1-95b69a6fcf2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:22.802977 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f79cb-64ca-4a28-9ff1-95b69a6fcf2b None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:22.909543 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3e509-2e5f-4490-be18-dc64be728493 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:22.950906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 275/561] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:15:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:15:22.952348 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f79cb-64ca-4a28-9ff1-95b69a6fcf2b None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:22.963856 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7464f-ddd4-4c95-bf8c-7a64e8623678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:22.964258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7464f-ddd4-4c95-bf8c-7a64e8623678 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:22.964604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7464f-ddd4-4c95-bf8c-7a64e8623678 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:22.964882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7464f-ddd4-4c95-bf8c-7a64e8623678 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:22.978686 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7464f-ddd4-4c95-bf8c-7a64e8623678 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:15:22.985327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-8ce7464f-ddd4-4c95-bf8c-7a64e8623678 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:22.985327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:22.985327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:22.985327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:22.985327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:22.985327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:22.985327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:22.985327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:22.985327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:22.985327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:22.985327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:22.985327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:22.985327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:15:22.985327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:15:22.985327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:15:22.985327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:15:22.987157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:15:22.987157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:15:22.987157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:15:22.987157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:15:22.987157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:22.987157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:22.987157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:22.987157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:22.987157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:22.987157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:22.987157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:22.987157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:22.987157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:22.987157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:22.987157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:22.987157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:22.989369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:22.989369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:22.989369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:22.989369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:22.989369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:15:22.989369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:15:22.989369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:15:22.989369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:15:22.989369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:15:22.989369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:15:22.989369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:22.989369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:22.989369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 287/562] 10.222.0.62 () {56 vars in 1102 bytes} [Tue Oct 4 14:15:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:22.990708 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:22.990846 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7464f-ddd4-4c95-bf8c-7a64e8623678 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:23.004450 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:23.098878 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f79cb-64ca-4a28-9ff1-95b69a6fcf2b None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:23.121768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7464f-ddd4-4c95-bf8c-7a64e8623678 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:23.148102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19c3c9-eeb5-4d0c-ba71-9fe81960e1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:23.149365 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19c3c9-eeb5-4d0c-ba71-9fe81960e1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:23.149930 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19c3c9-eeb5-4d0c-ba71-9fe81960e1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:23.150623 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19c3c9-eeb5-4d0c-ba71-9fe81960e1c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:23.152749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19c3c9-eeb5-4d0c-ba71-9fe81960e1c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:23.153564 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19c3c9-eeb5-4d0c-ba71-9fe81960e1c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:23.158094 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19c3c9-eeb5-4d0c-ba71-9fe81960e1c4 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:23.175509 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312e443-5c22-4bcd-aff6-e1abb0f89870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:23.176203 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312e443-5c22-4bcd-aff6-e1abb0f89870 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:23.176483 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312e443-5c22-4bcd-aff6-e1abb0f89870 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:23.176757 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312e443-5c22-4bcd-aff6-e1abb0f89870 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:23.179393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 276/563] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:23.180764 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ee1b6-267c-43e9-9e1d-20f837a1a446 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:23.181046 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ee1b6-267c-43e9-9e1d-20f837a1a446 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:23.181319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ee1b6-267c-43e9-9e1d-20f837a1a446 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:23.182925 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 277/564] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:23.183453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ee1b6-267c-43e9-9e1d-20f837a1a446 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:23.191849 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312e443-5c22-4bcd-aff6-e1abb0f89870 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:23.194216 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312e443-5c22-4bcd-aff6-e1abb0f89870 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:23.219062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-e312e443-5c22-4bcd-aff6-e1abb0f89870 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:23.219062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:23.219062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:23.219062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:23.219062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:23.219062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:23.219062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:23.219062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:23.219062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:23.219062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:23.219062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:23.219062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:23.219062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:23.219062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:23.219062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:23.219062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:23.220212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:23.220212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:23.220212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:23.220212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:23.220212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:23.220212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:23.220212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:23.220212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:23.220212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:23.220212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:23.220212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:23.220212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:23.220212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:23.220212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:23.220212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:23.220212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:23.220212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:23.221166 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:23.221166 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:23.221166 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:23.221166 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 288/565] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:23.222543 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e64af-73b0-4ea5-a2ed-d446ffda314c None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:23.222965 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e64af-73b0-4ea5-a2ed-d446ffda314c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:23.223416 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e64af-73b0-4ea5-a2ed-d446ffda314c None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:23.225925 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 289/566] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:23.227322 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e64af-73b0-4ea5-a2ed-d446ffda314c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:23.305352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:23.310100 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:23.324789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ee1b6-267c-43e9-9e1d-20f837a1a446 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:23.357452 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e64af-73b0-4ea5-a2ed-d446ffda314c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:23.367315 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddba3bf-3097-4d46-9b72-d15113721df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:23.368106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddba3bf-3097-4d46-9b72-d15113721df9 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:23.368481 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddba3bf-3097-4d46-9b72-d15113721df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:23.368939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddba3bf-3097-4d46-9b72-d15113721df9 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:23.369777 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddba3bf-3097-4d46-9b72-d15113721df9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:23.370131 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddba3bf-3097-4d46-9b72-d15113721df9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:23.372061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddba3bf-3097-4d46-9b72-d15113721df9 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:23.383831 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 278/567] 10.222.0.62 () {56 vars in 1103 bytes} [Tue Oct 4 14:15:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:23.385616 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d287519-4be2-4c4c-9646-0d9597b10570 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:23.385948 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d287519-4be2-4c4c-9646-0d9597b10570 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:23.386339 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d287519-4be2-4c4c-9646-0d9597b10570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:23.401326 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426fe3e-ab25-406b-b5fb-fb59d139eac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:23.401986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426fe3e-ab25-406b-b5fb-fb59d139eac9 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:23.402264 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426fe3e-ab25-406b-b5fb-fb59d139eac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:23.402535 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426fe3e-ab25-406b-b5fb-fb59d139eac9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:23.408313 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-1d287519-4be2-4c4c-9646-0d9597b10570 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:23.409534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-1d287519-4be2-4c4c-9646-0d9597b10570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:23.411103 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426fe3e-ab25-406b-b5fb-fb59d139eac9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:23.412596 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426fe3e-ab25-406b-b5fb-fb59d139eac9 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:23.425422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-3426fe3e-ab25-406b-b5fb-fb59d139eac9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:23.425422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:23.425422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:23.425422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:23.425422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:23.425422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:23.425422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:23.425422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:23.425422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:23.425422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:23.425422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:23.425422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:23.425422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:15:23.425422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:15:23.425422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:15:23.426443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:15:23.426443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:23.426443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:23.426443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:23.426443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:23.426443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:23.426443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:23.426443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:23.426443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:23.426443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:23.426443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:23.426443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:23.426443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:23.426443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:23.426443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:23.426443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:23.426443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:23.427355 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:15:23.427355 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:15:23.427355 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:15:23.427355 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:15:23.427355 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:15:23.427355 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:15:23.427355 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:23.427355 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:23.427355 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 290/568] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:15:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:23.428060 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426fe3e-ab25-406b-b5fb-fb59d139eac9 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:23.496917 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 279/569] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:23.498133 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1703bec-80e3-494f-b9c3-e0db58ab80fd None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:23.498434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1703bec-80e3-494f-b9c3-e0db58ab80fd None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:23.498676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1703bec-80e3-494f-b9c3-e0db58ab80fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:23.518653 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-e1703bec-80e3-494f-b9c3-e0db58ab80fd None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:23.519962 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e1703bec-80e3-494f-b9c3-e0db58ab80fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:23.564369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426fe3e-ab25-406b-b5fb-fb59d139eac9 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:23.596297 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:23.614320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259160c-0980-4207-a065-e943a2d13a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:23.619973 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 280/570] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:23.620176 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259160c-0980-4207-a065-e943a2d13a43 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:23.620176 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259160c-0980-4207-a065-e943a2d13a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:23.620176 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259160c-0980-4207-a065-e943a2d13a43 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:23.620450 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1703bec-80e3-494f-b9c3-e0db58ab80fd None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:23.620547 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259160c-0980-4207-a065-e943a2d13a43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:23.620547 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259160c-0980-4207-a065-e943a2d13a43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:23.620547 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259160c-0980-4207-a065-e943a2d13a43 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:23.638058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:23.641281 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 291/571] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:23.642313 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259160c-0980-4207-a065-e943a2d13a43 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:23.790842 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259160c-0980-4207-a065-e943a2d13a43 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:23.857642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1703bec-80e3-494f-b9c3-e0db58ab80fd None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:23.858173 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dda300-a9b1-48a2-a526-365960cbe27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:23.859488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dda300-a9b1-48a2-a526-365960cbe27c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:23.860233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dda300-a9b1-48a2-a526-365960cbe27c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:23.860730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dda300-a9b1-48a2-a526-365960cbe27c None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:23.862356 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dda300-a9b1-48a2-a526-365960cbe27c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:23.862872 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dda300-a9b1-48a2-a526-365960cbe27c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:23.865503 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dda300-a9b1-48a2-a526-365960cbe27c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:23.889335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 292/572] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:15:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:23.891557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dda300-a9b1-48a2-a526-365960cbe27c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:23.904036 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bbb35-c639-4ce3-a6ce-4723a40fc903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:23.904688 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bbb35-c639-4ce3-a6ce-4723a40fc903 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:23.904967 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bbb35-c639-4ce3-a6ce-4723a40fc903 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:23.905238 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bbb35-c639-4ce3-a6ce-4723a40fc903 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:23.918060 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bbb35-c639-4ce3-a6ce-4723a40fc903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:23.919677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bbb35-c639-4ce3-a6ce-4723a40fc903 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:23.937833 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-ee9bbb35-c639-4ce3-a6ce-4723a40fc903 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:23.937833 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:23.937833 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:23.937833 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:23.937833 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:23.937833 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:23.937833 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:23.937833 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:23.937833 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:23.937833 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:23.937833 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:23.937833 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:23.937833 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:23.937833 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:23.937833 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:23.937833 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:23.939486 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:23.939486 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:23.939486 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:23.939486 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:23.939486 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:23.939486 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:23.939486 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:23.939486 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:23.939486 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:23.939486 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:23.939486 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:23.939486 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:23.939486 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:23.939486 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:23.939486 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:23.939486 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:23.939486 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:23.940476 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:23.940476 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:23.940476 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:23.940476 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 281/573] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:23.940476 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bbb35-c639-4ce3-a6ce-4723a40fc903 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:23.966519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:24.009188 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:24.033721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dda300-a9b1-48a2-a526-365960cbe27c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:24.066412 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bbb35-c639-4ce3-a6ce-4723a40fc903 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:24.082660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d9f44-e96b-4325-accc-d838c79a4b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:24.083655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d9f44-e96b-4325-accc-d838c79a4b53 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:24.084144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d9f44-e96b-4325-accc-d838c79a4b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:24.084580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d9f44-e96b-4325-accc-d838c79a4b53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:24.095870 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d9f44-e96b-4325-accc-d838c79a4b53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:24.098391 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d9f44-e96b-4325-accc-d838c79a4b53 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:24.118885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-c96d9f44-e96b-4325-accc-d838c79a4b53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:24.118885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:24.118885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:24.118885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:24.118885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:24.118885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:24.118885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:24.118885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:24.118885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:24.118885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:24.118885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:24.118885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:24.118885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:15:24.118885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:15:24.118885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:15:24.120131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:15:24.120131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:24.120131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:24.120131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:24.120131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:24.120131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:24.120131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:24.120131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:24.120131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:24.120131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:24.120131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:24.120131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:24.120131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:24.120131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:24.120131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:24.120131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:24.120131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:24.121028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:15:24.121028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:15:24.121028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:15:24.121028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:15:24.121028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:15:24.121028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:15:24.121028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:24.121028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:24.121483 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 293/574] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:15:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:24.122359 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d9f44-e96b-4325-accc-d838c79a4b53 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:24.128467 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd956705-6eed-4cd3-b1c6-bfd5231d660f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:24.129514 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd956705-6eed-4cd3-b1c6-bfd5231d660f None admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:24.129949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd956705-6eed-4cd3-b1c6-bfd5231d660f None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:24.130378 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd956705-6eed-4cd3-b1c6-bfd5231d660f None admin] PATH_INFO: `/v3/projects/fd73ece314ef4f2eabb34e2a88d610ba/users/289b020c9cd242dca9b512803199daae/roles/e5d031634de14f1e86b912ddddfe7f8c` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:24.154101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd956705-6eed-4cd3-b1c6-bfd5231d660f None admin] RBAC: Authorizing `identity:create_grant(project_id=fd73ece314ef4f2eabb34e2a88d610ba, user_id=289b020c9cd242dca9b512803199daae, role_id=e5d031634de14f1e86b912ddddfe7f8c)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:24.155757 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd956705-6eed-4cd3-b1c6-bfd5231d660f None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:24.171037 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 282/575] 10.222.0.62 () {58 vars in 1439 bytes} [Tue Oct 4 14:15:23 2022] PUT /identity/v3/projects/fd73ece314ef4f2eabb34e2a88d610ba/users/289b020c9cd242dca9b512803199daae/roles/e5d031634de14f1e86b912ddddfe7f8c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:15:24.172829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd956705-6eed-4cd3-b1c6-bfd5231d660f None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:24.274499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d9f44-e96b-4325-accc-d838c79a4b53 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:24.276696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:24.313423 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd956705-6eed-4cd3-b1c6-bfd5231d660f None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:24.326342 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:24.331241 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c9fd9-02eb-4032-a5d8-a2b9813f268d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:24.331956 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c9fd9-02eb-4032-a5d8-a2b9813f268d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:24.332235 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c9fd9-02eb-4032-a5d8-a2b9813f268d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:24.332527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c9fd9-02eb-4032-a5d8-a2b9813f268d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:24.348769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c9fd9-02eb-4032-a5d8-a2b9813f268d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:15:24.355330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-446c9fd9-02eb-4032-a5d8-a2b9813f268d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:24.355330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:24.355330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:24.355330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:24.355330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:24.355330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:24.355330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:24.355330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:24.355330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:24.355330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:24.355330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:24.355330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:24.355330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:15:24.355330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:15:24.355330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:15:24.355330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:15:24.356519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:15:24.356519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:15:24.356519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:15:24.356519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:15:24.356519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:24.356519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:24.356519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:24.356519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:24.356519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:24.356519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:24.356519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:24.356519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:24.356519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:24.356519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:24.356519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:24.356519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:24.357614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:24.357614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:24.357614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:24.357614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:24.357614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:15:24.357614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:15:24.357614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:15:24.357614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:15:24.357614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:15:24.357614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:15:24.357614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:24.357614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:24.357614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 294/576] 10.222.0.62 () {56 vars in 1102 bytes} [Tue Oct 4 14:15:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:24.357614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c9fd9-02eb-4032-a5d8-a2b9813f268d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:24.376211 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae8a57-488e-458a-b68a-1e97e65d08ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:24.377245 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae8a57-488e-458a-b68a-1e97e65d08ad None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:24.377674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae8a57-488e-458a-b68a-1e97e65d08ad None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:24.378091 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae8a57-488e-458a-b68a-1e97e65d08ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:24.398426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae8a57-488e-458a-b68a-1e97e65d08ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:15:24.403473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-0dae8a57-488e-458a-b68a-1e97e65d08ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:24.403473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:24.403473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:24.403473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:24.403473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:24.403473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:24.403473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:24.403473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:24.403473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:24.403473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:24.403473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:24.403473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:24.403473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:15:24.403473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:15:24.403473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:15:24.403473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:15:24.406123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:15:24.406123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:15:24.406123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:15:24.406123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:15:24.406123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:24.406123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:24.406123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:24.406123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:24.406123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:24.406123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:24.406123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:24.406123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:24.406123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:24.406123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:24.406123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:24.406123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:24.411851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:24.411851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:24.411851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:24.411851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:24.411851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:15:24.411851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:15:24.411851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:15:24.411851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:15:24.411851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:15:24.411851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:15:24.411851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:24.411851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:24.411851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 283/577] 10.222.0.62 () {56 vars in 1102 bytes} [Tue Oct 4 14:15:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:24.411851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae8a57-488e-458a-b68a-1e97e65d08ad None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:24.521700 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c9fd9-02eb-4032-a5d8-a2b9813f268d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:24.530228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae8a57-488e-458a-b68a-1e97e65d08ad None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:24.580837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841391ec-105b-4e83-894b-51ea0c8befd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:24.581456 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada51e2-4fe6-42e8-9939-8dbf716ac08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:24.581668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841391ec-105b-4e83-894b-51ea0c8befd8 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:24.581807 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841391ec-105b-4e83-894b-51ea0c8befd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:24.582086 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841391ec-105b-4e83-894b-51ea0c8befd8 None admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:24.582447 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada51e2-4fe6-42e8-9939-8dbf716ac08b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:24.582704 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841391ec-105b-4e83-894b-51ea0c8befd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:24.582966 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada51e2-4fe6-42e8-9939-8dbf716ac08b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:24.583134 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841391ec-105b-4e83-894b-51ea0c8befd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:24.583456 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada51e2-4fe6-42e8-9939-8dbf716ac08b None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:24.584264 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada51e2-4fe6-42e8-9939-8dbf716ac08b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:24.584560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841391ec-105b-4e83-894b-51ea0c8befd8 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:24.584853 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada51e2-4fe6-42e8-9939-8dbf716ac08b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:24.586611 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada51e2-4fe6-42e8-9939-8dbf716ac08b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:24.610479 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 284/578] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:15:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:24.610479 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841391ec-105b-4e83-894b-51ea0c8befd8 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:24.610880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 295/579] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:24.610880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada51e2-4fe6-42e8-9939-8dbf716ac08b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:24.644630 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:24.649823 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:24.751241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841391ec-105b-4e83-894b-51ea0c8befd8 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:24.772342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada51e2-4fe6-42e8-9939-8dbf716ac08b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:24.810539 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09fe09-cae1-4ad3-bee6-aed6389fbac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:24.811557 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09fe09-cae1-4ad3-bee6-aed6389fbac8 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:24.812182 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09fe09-cae1-4ad3-bee6-aed6389fbac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:24.812634 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09fe09-cae1-4ad3-bee6-aed6389fbac8 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:24.814433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09fe09-cae1-4ad3-bee6-aed6389fbac8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:24.814890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09fe09-cae1-4ad3-bee6-aed6389fbac8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:24.817025 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09fe09-cae1-4ad3-bee6-aed6389fbac8 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:24.834453 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752291c7-4b4a-4cbf-ade0-6760697ee72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:24.835488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752291c7-4b4a-4cbf-ade0-6760697ee72f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:24.836012 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752291c7-4b4a-4cbf-ade0-6760697ee72f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:24.836497 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752291c7-4b4a-4cbf-ade0-6760697ee72f None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:24.837733 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752291c7-4b4a-4cbf-ade0-6760697ee72f None admin] RBAC: Adding query filter params (name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:24.838357 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752291c7-4b4a-4cbf-ade0-6760697ee72f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:24.839903 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 285/580] 10.222.0.62 () {56 vars in 1103 bytes} [Tue Oct 4 14:15:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:24.841099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752291c7-4b4a-4cbf-ade0-6760697ee72f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:24.841293 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09fe09-cae1-4ad3-bee6-aed6389fbac8 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:24.858233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 296/581] 10.222.0.62 () {56 vars in 1103 bytes} [Tue Oct 4 14:15:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:24.860980 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752291c7-4b4a-4cbf-ade0-6760697ee72f None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:25.006790 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:25.014403 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:25.028463 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09fe09-cae1-4ad3-bee6-aed6389fbac8 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:25.045122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752291c7-4b4a-4cbf-ade0-6760697ee72f None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:25.095259 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2e822-6d3e-43b0-8052-f09e4deb48b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:25.096006 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2e822-6d3e-43b0-8052-f09e4deb48b3 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:25.096298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2e822-6d3e-43b0-8052-f09e4deb48b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:25.096656 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2e822-6d3e-43b0-8052-f09e4deb48b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:25.097430 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2e822-6d3e-43b0-8052-f09e4deb48b3 None admin] RBAC: Adding query filter params (role.id=e5d031634de14f1e86b912ddddfe7f8c, scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba, user.id=4860d5958e724e568576a9067290a27e) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:25.097756 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2e822-6d3e-43b0-8052-f09e4deb48b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:25.099219 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726705a-669c-4942-b4c3-3c58bf921744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:25.099416 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2e822-6d3e-43b0-8052-f09e4deb48b3 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:25.100174 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726705a-669c-4942-b4c3-3c58bf921744 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:25.100647 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726705a-669c-4942-b4c3-3c58bf921744 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:25.101054 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726705a-669c-4942-b4c3-3c58bf921744 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:25.116383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 286/582] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:15:24 2022] GET /identity/v3/role_assignments?user.id=4860d5958e724e568576a9067290a27e&scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba&role.id=e5d031634de14f1e86b912ddddfe7f8c => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:25.116383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2e822-6d3e-43b0-8052-f09e4deb48b3 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:25.116760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726705a-669c-4942-b4c3-3c58bf921744 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:25.116760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726705a-669c-4942-b4c3-3c58bf921744 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:25.138307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-4726705a-669c-4942-b4c3-3c58bf921744 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 14:15:25.138307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:25.138307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:25.138307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:25.138307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:25.138307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:25.138307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:25.138307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:25.138307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:25.138307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:25.138307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:25.138307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:25.138307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:15:25.138307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:15:25.138307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:15:25.138307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:15:25.140780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:25.140780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:25.140780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:15:25.140780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:25.140780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:15:25.140780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:25.140780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:25.140780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:25.140780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:25.140780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:25.140780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:25.140780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:25.140780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:25.140780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:25.140780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:25.140780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:25.140780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:25.140780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:25.144058 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:25.144058 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:25.144058 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:15:25.144058 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:15:25.144058 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:15:25.144058 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:15:25.144058 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:15:25.144058 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:15:25.144058 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 14:15:25.144058 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:25.144058 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 297/583] 10.222.0.62 () {56 vars in 1093 bytes} [Tue Oct 4 14:15:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:25.144058 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726705a-669c-4942-b4c3-3c58bf921744 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:25.288392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726705a-669c-4942-b4c3-3c58bf921744 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:25.335668 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4198d2-4334-4287-b2b1-4922c74f8d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:25.336422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4198d2-4334-4287-b2b1-4922c74f8d2d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:25.336699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4198d2-4334-4287-b2b1-4922c74f8d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:25.336969 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4198d2-4334-4287-b2b1-4922c74f8d2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:25.351551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4198d2-4334-4287-b2b1-4922c74f8d2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:25.353108 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4198d2-4334-4287-b2b1-4922c74f8d2d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:25.353576 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2e822-6d3e-43b0-8052-f09e4deb48b3 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:25.357174 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:25.374636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-5e4198d2-4334-4287-b2b1-4922c74f8d2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:25.374636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:25.374636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:25.374636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:25.374636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:25.374636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:25.374636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:25.374636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:25.374636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:25.374636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:25.374636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:25.374636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:25.374636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:25.374636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:25.374636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:25.374636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:25.376504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:25.376504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:25.376504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:25.376504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:25.376504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:25.376504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:25.376504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:25.376504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:25.376504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:25.376504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:25.376504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:25.376504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:25.376504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:25.376504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:25.376504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:25.376504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:25.376504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:25.378091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:25.378091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:25.378091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:25.381296 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 298/584] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:25.382299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4198d2-4334-4287-b2b1-4922c74f8d2d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:25.455749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d64a0d-7f02-4e2b-b95f-62937db2c8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:25.456818 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d64a0d-7f02-4e2b-b95f-62937db2c8bc None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:25.457293 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d64a0d-7f02-4e2b-b95f-62937db2c8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:25.458840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d64a0d-7f02-4e2b-b95f-62937db2c8bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:25.485542 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d64a0d-7f02-4e2b-b95f-62937db2c8bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:25.488461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d64a0d-7f02-4e2b-b95f-62937db2c8bc None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:25.527494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-a2d64a0d-7f02-4e2b-b95f-62937db2c8bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:25.527494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:25.527494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:25.527494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:25.527494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:25.527494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:25.527494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:25.527494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:25.527494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:25.527494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:25.527494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:25.527494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:25.527494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:25.527494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:25.527494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:25.527494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:25.529331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:25.529331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:25.529331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:25.529331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:25.529331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:25.529331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:25.529331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:25.529331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:25.529331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:25.529331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:25.529331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:25.529331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:25.529331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:25.529331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:25.529331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:25.529331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:25.529331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:25.531165 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:25.531165 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:25.531165 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:25.540171 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4198d2-4334-4287-b2b1-4922c74f8d2d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:25.540535 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 287/585] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:25.542518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d64a0d-7f02-4e2b-b95f-62937db2c8bc None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:25.560564 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:25.607581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b84f30-aab9-4a4f-a27e-25237087c3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:25.610605 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b84f30-aab9-4a4f-a27e-25237087c3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:25.611207 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b84f30-aab9-4a4f-a27e-25237087c3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:25.611602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b84f30-aab9-4a4f-a27e-25237087c3b2 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:25.613262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b84f30-aab9-4a4f-a27e-25237087c3b2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:25.613766 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b84f30-aab9-4a4f-a27e-25237087c3b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:25.616783 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b84f30-aab9-4a4f-a27e-25237087c3b2 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:25.645426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 299/586] 10.222.0.62 () {56 vars in 1133 bytes} [Tue Oct 4 14:15:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:25.651085 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b84f30-aab9-4a4f-a27e-25237087c3b2 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:25.719529 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d64a0d-7f02-4e2b-b95f-62937db2c8bc None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:25.744979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:25.775069 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18baa7-ac33-486a-bdfe-bc447b3d694c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:25.776134 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18baa7-ac33-486a-bdfe-bc447b3d694c None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:25.776638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18baa7-ac33-486a-bdfe-bc447b3d694c None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:25.777158 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18baa7-ac33-486a-bdfe-bc447b3d694c None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:25.778786 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18baa7-ac33-486a-bdfe-bc447b3d694c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:25.779314 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18baa7-ac33-486a-bdfe-bc447b3d694c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:25.782275 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18baa7-ac33-486a-bdfe-bc447b3d694c None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:25.804082 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 288/587] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:25.805430 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18baa7-ac33-486a-bdfe-bc447b3d694c None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:25.825766 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b84f30-aab9-4a4f-a27e-25237087c3b2 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:25.890044 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ecd02-f18c-4fd1-87ec-80d4d55c4ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:25.891457 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ecd02-f18c-4fd1-87ec-80d4d55c4ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:25.892029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ecd02-f18c-4fd1-87ec-80d4d55c4ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:25.892555 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ecd02-f18c-4fd1-87ec-80d4d55c4ed1 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:25.893734 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ecd02-f18c-4fd1-87ec-80d4d55c4ed1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:25.894320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ecd02-f18c-4fd1-87ec-80d4d55c4ed1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:25.896933 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ecd02-f18c-4fd1-87ec-80d4d55c4ed1 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:25.906188 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:25.920427 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 300/588] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:25.923508 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ecd02-f18c-4fd1-87ec-80d4d55c4ed1 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:25.991415 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18baa7-ac33-486a-bdfe-bc447b3d694c None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:26.061061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f03170-6984-4dd5-97e8-5b27a330ba08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:26.062162 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f03170-6984-4dd5-97e8-5b27a330ba08 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:26.062593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f03170-6984-4dd5-97e8-5b27a330ba08 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:26.063870 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f03170-6984-4dd5-97e8-5b27a330ba08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:26.090230 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f03170-6984-4dd5-97e8-5b27a330ba08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:26.095608 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f03170-6984-4dd5-97e8-5b27a330ba08 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:26.120167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-18f03170-6984-4dd5-97e8-5b27a330ba08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:26.120167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:26.120167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:26.120167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:26.120167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:26.120167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:26.120167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:26.120167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:26.120167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:26.120167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:26.120167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:26.120167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:26.120167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:26.120167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:26.120167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:26.120167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:26.122172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:26.122172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:26.122172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:26.122172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:26.122172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:26.122172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:26.122172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:26.122172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:26.122172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:26.122172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:26.122172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:26.122172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:26.122172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:26.122172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:26.122172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:26.122172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:26.122172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:26.124242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:26.124242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:26.124242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:26.124242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 289/589] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:26.125334 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f03170-6984-4dd5-97e8-5b27a330ba08 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:26.155111 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ecd02-f18c-4fd1-87ec-80d4d55c4ed1 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:26.191511 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:26.242014 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46565637-331b-42fc-93a8-42b9f6059171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:26.243181 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46565637-331b-42fc-93a8-42b9f6059171 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:26.243360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46565637-331b-42fc-93a8-42b9f6059171 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:26.243695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46565637-331b-42fc-93a8-42b9f6059171 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:26.255925 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46565637-331b-42fc-93a8-42b9f6059171 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:26.257849 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46565637-331b-42fc-93a8-42b9f6059171 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:26.277732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-46565637-331b-42fc-93a8-42b9f6059171 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 14:15:26.277732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:26.277732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:26.277732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:26.277732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:26.277732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:26.277732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:26.277732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:26.277732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:26.277732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:26.277732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:26.277732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:26.277732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:15:26.277732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:15:26.277732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:15:26.277732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:15:26.279896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:26.279896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:26.279896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:15:26.279896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:26.279896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:15:26.279896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:26.279896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:26.279896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:26.279896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:26.279896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:26.279896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:26.279896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:26.279896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:26.279896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:26.279896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:26.279896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:26.279896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:26.279896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:26.282488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:26.282488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:26.282488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:15:26.282488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:15:26.282488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:15:26.282488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:15:26.282488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:15:26.282488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:15:26.282488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 14:15:26.282488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:26.285870 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 301/590] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:15:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:26.286945 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46565637-331b-42fc-93a8-42b9f6059171 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:26.299771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f03170-6984-4dd5-97e8-5b27a330ba08 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:26.344847 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:26.379538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa93e8f-e2f5-4460-8a0f-c09543fd9c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:26.380404 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa93e8f-e2f5-4460-8a0f-c09543fd9c7e None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:26.380866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa93e8f-e2f5-4460-8a0f-c09543fd9c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:26.381336 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa93e8f-e2f5-4460-8a0f-c09543fd9c7e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:26.397005 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa93e8f-e2f5-4460-8a0f-c09543fd9c7e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:26.399986 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa93e8f-e2f5-4460-8a0f-c09543fd9c7e None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:26.424350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-daa93e8f-e2f5-4460-8a0f-c09543fd9c7e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 14:15:26.424350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:26.424350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:26.424350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:26.424350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:26.424350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:26.424350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:26.424350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:26.424350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:26.424350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:26.424350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:26.424350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:26.424350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:15:26.424350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:15:26.424350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:15:26.424350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:15:26.426214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:26.426214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:26.426214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:15:26.426214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:26.426214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:15:26.426214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:26.426214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:26.426214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:26.426214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:26.426214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:26.426214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:26.426214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:26.426214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:26.426214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:26.426214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:26.426214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:26.426214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:26.426214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:26.428129 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:26.428129 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:26.428129 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:15:26.428129 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:15:26.428129 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:15:26.428129 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:15:26.428129 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:15:26.428129 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:15:26.428129 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 14:15:26.428129 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:26.428129 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 290/591] 10.222.0.62 () {56 vars in 1102 bytes} [Tue Oct 4 14:15:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:26.428129 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa93e8f-e2f5-4460-8a0f-c09543fd9c7e None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:26.525348 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46565637-331b-42fc-93a8-42b9f6059171 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:26.597754 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252d371-b3bf-4bac-9335-bd3531c160f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:26.598528 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252d371-b3bf-4bac-9335-bd3531c160f3 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:26.598802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252d371-b3bf-4bac-9335-bd3531c160f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:26.599070 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252d371-b3bf-4bac-9335-bd3531c160f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:26.599773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252d371-b3bf-4bac-9335-bd3531c160f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:26.600077 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252d371-b3bf-4bac-9335-bd3531c160f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:26.601685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252d371-b3bf-4bac-9335-bd3531c160f3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:26.621082 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 302/592] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:26.622019 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252d371-b3bf-4bac-9335-bd3531c160f3 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:26.648927 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa93e8f-e2f5-4460-8a0f-c09543fd9c7e None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:26.694474 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:26.715687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accdf3d-c30c-4647-a1b5-86c61f8d16af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:26.716760 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accdf3d-c30c-4647-a1b5-86c61f8d16af None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:26.717240 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accdf3d-c30c-4647-a1b5-86c61f8d16af None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:26.717734 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accdf3d-c30c-4647-a1b5-86c61f8d16af None admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:26.719688 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accdf3d-c30c-4647-a1b5-86c61f8d16af None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:26.720245 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accdf3d-c30c-4647-a1b5-86c61f8d16af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:26.723089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accdf3d-c30c-4647-a1b5-86c61f8d16af None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:26.759610 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 291/593] 10.222.0.62 () {56 vars in 1137 bytes} [Tue Oct 4 14:15:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:26.761218 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accdf3d-c30c-4647-a1b5-86c61f8d16af None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:26.801246 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252d371-b3bf-4bac-9335-bd3531c160f3 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:26.850523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:26.864309 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22987da9-3e72-4221-9c8e-5acdedd3eb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:26.865332 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22987da9-3e72-4221-9c8e-5acdedd3eb49 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:26.865811 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22987da9-3e72-4221-9c8e-5acdedd3eb49 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:26.866304 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22987da9-3e72-4221-9c8e-5acdedd3eb49 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:26.867662 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22987da9-3e72-4221-9c8e-5acdedd3eb49 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:26.868236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22987da9-3e72-4221-9c8e-5acdedd3eb49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:26.870993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22987da9-3e72-4221-9c8e-5acdedd3eb49 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:26.904541 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 303/594] 10.222.0.62 () {56 vars in 1139 bytes} [Tue Oct 4 14:15:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:26.907451 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f9f05-873c-4e40-adb0-18fd12492bde None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:26.907938 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f9f05-873c-4e40-adb0-18fd12492bde None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:26.908399 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f9f05-873c-4e40-adb0-18fd12492bde None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:26.911761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 304/595] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:26.912973 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f9f05-873c-4e40-adb0-18fd12492bde None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:26.979453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accdf3d-c30c-4647-a1b5-86c61f8d16af None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:27.040506 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b6532-535b-43fc-83c3-eb9d76adc2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:27.041162 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b6532-535b-43fc-83c3-eb9d76adc2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:27.041598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b6532-535b-43fc-83c3-eb9d76adc2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:27.041757 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b6532-535b-43fc-83c3-eb9d76adc2a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:27.055641 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b6532-535b-43fc-83c3-eb9d76adc2a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:27.059438 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b6532-535b-43fc-83c3-eb9d76adc2a6 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:27.074160 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:27.086190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f9f05-873c-4e40-adb0-18fd12492bde None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:27.086657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-ce4b6532-535b-43fc-83c3-eb9d76adc2a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:27.086657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:27.086657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:27.086657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:27.086657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:27.086657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:27.086657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:27.086657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:27.086657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:27.086657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:27.086657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:27.086657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:27.086657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:15:27.086657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:15:27.086657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:15:27.088838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:15:27.088838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:27.088838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:27.088838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:27.088838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:27.088838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:27.088838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:27.088838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:27.088838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:27.088838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:27.088838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:27.088838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:27.088838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:27.088838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:27.088838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:27.088838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:27.088838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:27.090577 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:15:27.090577 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:15:27.090577 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:15:27.090577 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:15:27.090577 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:15:27.090577 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:15:27.090577 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:27.090577 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:27.090577 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 292/596] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:15:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:27.090577 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b6532-535b-43fc-83c3-eb9d76adc2a6 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:27.149734 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edaa3f-4173-48a6-8085-27f8bf89d74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:27.150843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edaa3f-4173-48a6-8085-27f8bf89d74f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:27.151323 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edaa3f-4173-48a6-8085-27f8bf89d74f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:27.151846 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edaa3f-4173-48a6-8085-27f8bf89d74f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:27.172353 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7edaa3f-4173-48a6-8085-27f8bf89d74f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:27.174661 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7edaa3f-4173-48a6-8085-27f8bf89d74f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:27.199963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-d7edaa3f-4173-48a6-8085-27f8bf89d74f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:27.199963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:27.199963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:27.199963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:27.199963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:27.199963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:27.199963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:27.199963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:27.199963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:27.199963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:27.199963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:27.199963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:27.199963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:27.199963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:27.199963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:27.199963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:27.201721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:27.201721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:27.201721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:27.201721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:27.201721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:27.201721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:27.201721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:27.201721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:27.201721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:27.201721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:27.201721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:27.201721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:27.201721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:27.201721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:27.201721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:27.201721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:27.201721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:27.204905 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:27.204905 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:27.204905 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:27.215472 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 305/597] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:27.215472 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f2285-3b86-46b4-be6e-f2c8b4a76d76 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:27.215472 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f2285-3b86-46b4-be6e-f2c8b4a76d76 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:27.215472 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f2285-3b86-46b4-be6e-f2c8b4a76d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:27.244962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-905f2285-3b86-46b4-be6e-f2c8b4a76d76 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:27.246403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:27.246855 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-905f2285-3b86-46b4-be6e-f2c8b4a76d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:27.257447 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b6532-535b-43fc-83c3-eb9d76adc2a6 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:27.322567 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd93201-0ce4-46db-a31e-e40e9116c749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:27.323571 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd93201-0ce4-46db-a31e-e40e9116c749 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:27.324046 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd93201-0ce4-46db-a31e-e40e9116c749 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:27.324480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd93201-0ce4-46db-a31e-e40e9116c749 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:27.342091 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd93201-0ce4-46db-a31e-e40e9116c749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:27.344594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd93201-0ce4-46db-a31e-e40e9116c749 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:27.366083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-6bd93201-0ce4-46db-a31e-e40e9116c749 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:27.366083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:27.366083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:27.366083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:27.366083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:27.366083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:27.366083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:27.366083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:27.366083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:27.366083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:27.366083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:27.366083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:27.366083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:27.366083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:27.366083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:27.366083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:27.367113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:27.367113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:27.367113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:27.367113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:27.367113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:27.367113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:27.367113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:27.367113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:27.367113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:27.367113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:27.367113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:27.367113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:27.367113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:27.367113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:27.367113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:27.367113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:27.367113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:27.368041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:27.368041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:27.368041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:27.368041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 293/598] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:27.368702 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd93201-0ce4-46db-a31e-e40e9116c749 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:27.381703 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 306/599] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:27.383545 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f2285-3b86-46b4-be6e-f2c8b4a76d76 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:27.489656 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:27.522426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f2285-3b86-46b4-be6e-f2c8b4a76d76 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:27.571102 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac7f05-0fd9-49e3-843c-2941f8277076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:27.571755 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac7f05-0fd9-49e3-843c-2941f8277076 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:27.572044 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac7f05-0fd9-49e3-843c-2941f8277076 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:27.572314 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac7f05-0fd9-49e3-843c-2941f8277076 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:27.572972 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac7f05-0fd9-49e3-843c-2941f8277076 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:27.573271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac7f05-0fd9-49e3-843c-2941f8277076 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:27.574666 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac7f05-0fd9-49e3-843c-2941f8277076 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:27.590684 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 307/600] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:27.592242 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac7f05-0fd9-49e3-843c-2941f8277076 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:27.605603 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd93201-0ce4-46db-a31e-e40e9116c749 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:27.675297 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f245d-6520-44b0-8967-b8e4d591fea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:27.676342 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f245d-6520-44b0-8967-b8e4d591fea7 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:27.676816 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f245d-6520-44b0-8967-b8e4d591fea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:27.677266 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f245d-6520-44b0-8967-b8e4d591fea7 None admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:27.678549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f245d-6520-44b0-8967-b8e4d591fea7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:27.679066 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f245d-6520-44b0-8967-b8e4d591fea7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:27.681150 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f245d-6520-44b0-8967-b8e4d591fea7 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:27.702311 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 294/601] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:15:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:27.704524 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43218b91-1da8-4329-b3b7-f81857d33c07 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:27.704946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43218b91-1da8-4329-b3b7-f81857d33c07 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:27.705358 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43218b91-1da8-4329-b3b7-f81857d33c07 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:27.711793 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 295/602] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:27.711793 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43218b91-1da8-4329-b3b7-f81857d33c07 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:27.725485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:27.789578 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac7f05-0fd9-49e3-843c-2941f8277076 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:27.838298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a768bc0-79ae-4a7a-ab76-3ac188eeec40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:27.838952 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a768bc0-79ae-4a7a-ab76-3ac188eeec40 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:27.839224 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a768bc0-79ae-4a7a-ab76-3ac188eeec40 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:27.839489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a768bc0-79ae-4a7a-ab76-3ac188eeec40 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:27.840190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a768bc0-79ae-4a7a-ab76-3ac188eeec40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:27.840480 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a768bc0-79ae-4a7a-ab76-3ac188eeec40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:27.841895 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a768bc0-79ae-4a7a-ab76-3ac188eeec40 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:27.843778 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:27.856212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 308/603] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:27.857075 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a768bc0-79ae-4a7a-ab76-3ac188eeec40 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:27.866534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43218b91-1da8-4329-b3b7-f81857d33c07 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:27.917334 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e3078-2525-48e6-a690-1d3f0fdc03cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:27.918226 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e3078-2525-48e6-a690-1d3f0fdc03cd None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:27.918664 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e3078-2525-48e6-a690-1d3f0fdc03cd None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:27.919050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e3078-2525-48e6-a690-1d3f0fdc03cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:27.932355 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e3078-2525-48e6-a690-1d3f0fdc03cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:27.935099 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e3078-2525-48e6-a690-1d3f0fdc03cd None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:27.959344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-8a7e3078-2525-48e6-a690-1d3f0fdc03cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:27.959344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:27.959344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:27.959344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:27.959344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:27.959344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:27.959344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:27.959344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:27.959344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:27.959344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:27.959344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:27.959344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:27.959344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:15:27.959344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:15:27.959344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:15:27.960369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:15:27.960369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:27.960369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:27.960369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:27.960369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:27.960369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:27.960369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:27.960369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:27.960369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:27.960369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:27.960369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:27.960369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:27.960369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:27.960369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:27.960369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:27.960369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:27.960369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:27.961252 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:15:27.961252 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:15:27.961252 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:15:27.961252 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:15:27.961252 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:15:27.961252 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:15:27.961252 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:27.961252 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:27.961689 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 296/604] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:15:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:27.963586 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94acc4-cdce-4c1d-9084-4ac3da19de38 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:27.964079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94acc4-cdce-4c1d-9084-4ac3da19de38 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:27.964637 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94acc4-cdce-4c1d-9084-4ac3da19de38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:27.995018 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-7f94acc4-cdce-4c1d-9084-4ac3da19de38 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:27.996309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-7f94acc4-cdce-4c1d-9084-4ac3da19de38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:27.999635 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a768bc0-79ae-4a7a-ab76-3ac188eeec40 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:28.045452 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd0660-d2f0-4747-abfd-6963edff3a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:28.047005 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd0660-d2f0-4747-abfd-6963edff3a6b None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:28.047441 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd0660-d2f0-4747-abfd-6963edff3a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:28.047975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd0660-d2f0-4747-abfd-6963edff3a6b None admin] PATH_INFO: `/v3/projects/fd73ece314ef4f2eabb34e2a88d610ba/users/151e7b9c7a7b46d58dc2f563d05775e2/roles/e5d031634de14f1e86b912ddddfe7f8c` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:28.069387 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd0660-d2f0-4747-abfd-6963edff3a6b None admin] RBAC: Authorizing `identity:create_grant(project_id=fd73ece314ef4f2eabb34e2a88d610ba, user_id=151e7b9c7a7b46d58dc2f563d05775e2, role_id=e5d031634de14f1e86b912ddddfe7f8c)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:28.071617 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd0660-d2f0-4747-abfd-6963edff3a6b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:28.087987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:28.093576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 309/605] 10.222.0.62 () {58 vars in 1439 bytes} [Tue Oct 4 14:15:27 2022] PUT /identity/v3/projects/fd73ece314ef4f2eabb34e2a88d610ba/users/151e7b9c7a7b46d58dc2f563d05775e2/roles/e5d031634de14f1e86b912ddddfe7f8c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:15:28.095281 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd0660-d2f0-4747-abfd-6963edff3a6b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:28.108010 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 297/606] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:28.109625 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94acc4-cdce-4c1d-9084-4ac3da19de38 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:28.205140 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:28.311166 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94acc4-cdce-4c1d-9084-4ac3da19de38 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:28.332774 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd0660-d2f0-4747-abfd-6963edff3a6b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:28.367007 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b86e0-e1af-42c1-ad2b-0f9d35c0bbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:28.368050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b86e0-e1af-42c1-ad2b-0f9d35c0bbd1 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:28.368508 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b86e0-e1af-42c1-ad2b-0f9d35c0bbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:28.369053 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b86e0-e1af-42c1-ad2b-0f9d35c0bbd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:28.378997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b86e0-e1af-42c1-ad2b-0f9d35c0bbd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:28.380955 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b86e0-e1af-42c1-ad2b-0f9d35c0bbd1 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:28.393261 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100788f-fbc3-4776-bfb3-83e5b632c60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:28.393921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100788f-fbc3-4776-bfb3-83e5b632c60a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:28.394201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100788f-fbc3-4776-bfb3-83e5b632c60a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:28.394473 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100788f-fbc3-4776-bfb3-83e5b632c60a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:28.399149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-ba0b86e0-e1af-42c1-ad2b-0f9d35c0bbd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:28.399149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:28.399149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:28.399149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:28.399149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:28.399149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:28.399149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:28.399149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:28.399149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:28.399149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:28.399149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:28.399149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:28.399149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:15:28.399149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:15:28.399149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:15:28.400225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:15:28.400225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:28.400225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:28.400225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:28.400225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:28.400225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:28.400225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:28.400225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:28.400225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:28.400225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:28.400225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:28.400225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:28.400225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:28.400225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:28.400225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:28.400225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:28.400225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:28.401174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:15:28.401174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:15:28.401174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:15:28.401174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:15:28.401174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:15:28.401174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:15:28.401174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:28.401174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:28.401884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 298/607] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:15:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:28.403386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b86e0-e1af-42c1-ad2b-0f9d35c0bbd1 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:28.418321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100788f-fbc3-4776-bfb3-83e5b632c60a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:15:28.426475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-e100788f-fbc3-4776-bfb3-83e5b632c60a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:28.426475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:28.426475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:28.426475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:28.426475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:28.426475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:28.426475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:28.426475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:28.426475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:28.426475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:28.426475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:28.426475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:28.426475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:15:28.426475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:15:28.426475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:15:28.426475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:15:28.427548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:15:28.427548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:15:28.427548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:15:28.427548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:15:28.427548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:28.427548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:28.427548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:28.427548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:28.427548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:28.427548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:28.427548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:28.427548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:28.427548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:28.427548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:28.427548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:28.427548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:28.428525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:28.428525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:28.428525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:28.428525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:28.428525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:15:28.428525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:15:28.428525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:15:28.428525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:15:28.428525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:15:28.428525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:15:28.428525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:28.428525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:28.428525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 310/608] 10.222.0.62 () {56 vars in 1102 bytes} [Tue Oct 4 14:15:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:28.429612 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100788f-fbc3-4776-bfb3-83e5b632c60a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:28.496044 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:28.563590 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b86e0-e1af-42c1-ad2b-0f9d35c0bbd1 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:28.586957 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100788f-fbc3-4776-bfb3-83e5b632c60a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:28.590854 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:28.620436 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d924d-c2e7-4ceb-8fbf-bc1f61391a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:28.621817 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d924d-c2e7-4ceb-8fbf-bc1f61391a63 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:28.622925 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d924d-c2e7-4ceb-8fbf-bc1f61391a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:28.623753 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d924d-c2e7-4ceb-8fbf-bc1f61391a63 None admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:28.625260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d924d-c2e7-4ceb-8fbf-bc1f61391a63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:28.626119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d924d-c2e7-4ceb-8fbf-bc1f61391a63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:28.628768 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d924d-c2e7-4ceb-8fbf-bc1f61391a63 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:28.638771 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8577b04-2a7e-4f4e-9f2d-c40bf4e1a189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:28.639741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8577b04-2a7e-4f4e-9f2d-c40bf4e1a189 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:28.640167 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8577b04-2a7e-4f4e-9f2d-c40bf4e1a189 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:28.640557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8577b04-2a7e-4f4e-9f2d-c40bf4e1a189 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:28.642324 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8577b04-2a7e-4f4e-9f2d-c40bf4e1a189 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:28.642819 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8577b04-2a7e-4f4e-9f2d-c40bf4e1a189 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:28.645276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8577b04-2a7e-4f4e-9f2d-c40bf4e1a189 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:28.646200 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 299/609] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:15:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:28.647286 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d924d-c2e7-4ceb-8fbf-bc1f61391a63 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:28.668979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 311/610] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:15:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:28.675621 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8577b04-2a7e-4f4e-9f2d-c40bf4e1a189 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:28.792208 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d924d-c2e7-4ceb-8fbf-bc1f61391a63 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:28.814293 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:28.835918 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf6739-f039-4824-a6b6-605576367db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:28.836554 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf6739-f039-4824-a6b6-605576367db5 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:28.836834 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf6739-f039-4824-a6b6-605576367db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:28.837109 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf6739-f039-4824-a6b6-605576367db5 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:28.837799 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf6739-f039-4824-a6b6-605576367db5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:28.838104 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf6739-f039-4824-a6b6-605576367db5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:28.838763 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8577b04-2a7e-4f4e-9f2d-c40bf4e1a189 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:28.839556 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf6739-f039-4824-a6b6-605576367db5 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:28.862160 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 300/611] 10.222.0.62 () {56 vars in 1103 bytes} [Tue Oct 4 14:15:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:28.862160 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf6739-f039-4824-a6b6-605576367db5 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:28.920323 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47d3da-7171-4514-beef-45252d68cc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:28.921189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47d3da-7171-4514-beef-45252d68cc64 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:28.921722 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47d3da-7171-4514-beef-45252d68cc64 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:28.922319 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47d3da-7171-4514-beef-45252d68cc64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:28.943443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47d3da-7171-4514-beef-45252d68cc64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:15:28.953311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-6c47d3da-7171-4514-beef-45252d68cc64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:28.953311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:28.953311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:28.953311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:28.953311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:28.953311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:28.953311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:28.953311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:28.953311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:28.953311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:28.953311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:28.953311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:28.953311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:15:28.953311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:15:28.953311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:15:28.953311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:15:28.955573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:15:28.955573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:15:28.955573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:15:28.955573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:15:28.955573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:28.955573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:28.955573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:28.955573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:28.955573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:28.955573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:28.955573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:28.955573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:28.955573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:28.955573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:28.955573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:28.955573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:28.957735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:28.957735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:28.957735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:28.957735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:28.957735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:15:28.957735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:15:28.957735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:15:28.957735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:15:28.957735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:15:28.957735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:15:28.957735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:28.957735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:28.957735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 312/612] 10.222.0.62 () {56 vars in 1102 bytes} [Tue Oct 4 14:15:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:28.962929 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47d3da-7171-4514-beef-45252d68cc64 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:29.010985 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:29.050663 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf6739-f039-4824-a6b6-605576367db5 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:29.119424 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd5137-b391-40ad-bb79-8b9462c0a805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:29.120376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd5137-b391-40ad-bb79-8b9462c0a805 None admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:29.120376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd5137-b391-40ad-bb79-8b9462c0a805 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:29.120684 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd5137-b391-40ad-bb79-8b9462c0a805 None admin] PATH_INFO: `/v3/projects/fd73ece314ef4f2eabb34e2a88d610ba/users/c5d3bf1c2d944d51a0fd0ff84be1c7e0/roles/e5d031634de14f1e86b912ddddfe7f8c` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:29.127781 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47d3da-7171-4514-beef-45252d68cc64 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:29.141231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd5137-b391-40ad-bb79-8b9462c0a805 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd73ece314ef4f2eabb34e2a88d610ba, user_id=c5d3bf1c2d944d51a0fd0ff84be1c7e0, role_id=e5d031634de14f1e86b912ddddfe7f8c)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:29.143389 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd5137-b391-40ad-bb79-8b9462c0a805 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:29.162840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 301/613] 10.222.0.62 () {58 vars in 1439 bytes} [Tue Oct 4 14:15:28 2022] PUT /identity/v3/projects/fd73ece314ef4f2eabb34e2a88d610ba/users/c5d3bf1c2d944d51a0fd0ff84be1c7e0/roles/e5d031634de14f1e86b912ddddfe7f8c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:15:29.163767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd5137-b391-40ad-bb79-8b9462c0a805 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:29.195662 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cc452-1930-4f19-b238-606a4a5233e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:29.196473 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cc452-1930-4f19-b238-606a4a5233e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:29.196831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cc452-1930-4f19-b238-606a4a5233e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:29.197170 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cc452-1930-4f19-b238-606a4a5233e7 None admin] PATH_INFO: `/v3/projects/fd73ece314ef4f2eabb34e2a88d610ba/users/624487005e4f4180a9d56a29a7daad1e/roles/e5d031634de14f1e86b912ddddfe7f8c` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:29.224380 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:29.224645 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1cc452-1930-4f19-b238-606a4a5233e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd73ece314ef4f2eabb34e2a88d610ba, user_id=624487005e4f4180a9d56a29a7daad1e, role_id=e5d031634de14f1e86b912ddddfe7f8c)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:29.226699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1cc452-1930-4f19-b238-606a4a5233e7 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:29.248490 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 313/614] 10.222.0.62 () {58 vars in 1439 bytes} [Tue Oct 4 14:15:28 2022] PUT /identity/v3/projects/fd73ece314ef4f2eabb34e2a88d610ba/users/624487005e4f4180a9d56a29a7daad1e/roles/e5d031634de14f1e86b912ddddfe7f8c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:15:29.250674 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cc452-1930-4f19-b238-606a4a5233e7 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:29.434017 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd5137-b391-40ad-bb79-8b9462c0a805 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:29.480832 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:29.512781 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746b911-b330-4aec-8b76-6cddda2e0611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:29.513865 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746b911-b330-4aec-8b76-6cddda2e0611 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:29.514372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746b911-b330-4aec-8b76-6cddda2e0611 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:29.514886 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746b911-b330-4aec-8b76-6cddda2e0611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:29.530043 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746b911-b330-4aec-8b76-6cddda2e0611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:29.532615 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746b911-b330-4aec-8b76-6cddda2e0611 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:29.543114 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cc452-1930-4f19-b238-606a4a5233e7 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:29.563739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-8746b911-b330-4aec-8b76-6cddda2e0611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:29.563739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:29.563739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:29.563739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:29.563739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:29.563739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:29.563739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:29.563739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:29.563739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:29.563739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:29.563739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:29.563739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:29.563739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:29.563739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:29.563739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:29.563739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:29.564767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:29.564767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:29.564767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:29.564767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:29.564767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:29.564767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:29.564767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:29.564767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:29.564767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:29.564767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:29.564767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:29.564767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:29.564767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:29.564767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:29.564767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:29.564767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:29.564767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:29.565685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:29.565685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:29.565685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:29.565685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 302/615] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:29.569508 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746b911-b330-4aec-8b76-6cddda2e0611 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:29.619196 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66eba43-7b13-48c5-8213-fba9bbcc6a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:29.620248 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66eba43-7b13-48c5-8213-fba9bbcc6a80 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:29.620715 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66eba43-7b13-48c5-8213-fba9bbcc6a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:29.621180 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66eba43-7b13-48c5-8213-fba9bbcc6a80 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:29.622363 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66eba43-7b13-48c5-8213-fba9bbcc6a80 None admin] RBAC: Adding query filter params (name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:29.623027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66eba43-7b13-48c5-8213-fba9bbcc6a80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:29.626123 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66eba43-7b13-48c5-8213-fba9bbcc6a80 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:29.660057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 314/616] 10.222.0.62 () {56 vars in 1103 bytes} [Tue Oct 4 14:15:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:29.675568 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66eba43-7b13-48c5-8213-fba9bbcc6a80 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:29.815779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:29.860761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66eba43-7b13-48c5-8213-fba9bbcc6a80 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:29.865818 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746b911-b330-4aec-8b76-6cddda2e0611 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:29.940447 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0676f0-ab93-4753-95c7-7079783d96c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:29.941361 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0676f0-ab93-4753-95c7-7079783d96c4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:29.941631 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0676f0-ab93-4753-95c7-7079783d96c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:29.941991 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0676f0-ab93-4753-95c7-7079783d96c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:29.948286 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:29.957174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8405b8-c1e5-457c-b3fa-a86881e4c1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:29.957810 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8405b8-c1e5-457c-b3fa-a86881e4c1d7 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:29.958095 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8405b8-c1e5-457c-b3fa-a86881e4c1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:29.958487 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8405b8-c1e5-457c-b3fa-a86881e4c1d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:29.959162 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8405b8-c1e5-457c-b3fa-a86881e4c1d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:29.959467 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8405b8-c1e5-457c-b3fa-a86881e4c1d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:29.961120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8405b8-c1e5-457c-b3fa-a86881e4c1d7 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:29.968599 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0676f0-ab93-4753-95c7-7079783d96c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:29.970421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0676f0-ab93-4753-95c7-7079783d96c4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:29.995182 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 303/617] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:29.997868 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8405b8-c1e5-457c-b3fa-a86881e4c1d7 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:30.004779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-4b0676f0-ab93-4753-95c7-7079783d96c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:30.004779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:30.004779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:30.004779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:30.004779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:30.004779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:30.004779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:30.004779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:30.004779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:30.004779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:30.004779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:30.004779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:30.004779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:30.004779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:30.004779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:30.004779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:30.005977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:30.005977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:30.005977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:30.005977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:30.005977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:30.005977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:30.005977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:30.005977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:30.005977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:30.005977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:30.005977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:30.005977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:30.005977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:30.005977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:30.005977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:30.005977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:30.005977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:30.006967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:30.006967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:30.006967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:30.013233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 315/618] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:15:30.022520 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0676f0-ab93-4753-95c7-7079783d96c4 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:30.192982 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8405b8-c1e5-457c-b3fa-a86881e4c1d7 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:30.274154 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0676f0-ab93-4753-95c7-7079783d96c4 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:30.279107 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2369f-3ac3-47d7-92db-e0be887087aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:30.279840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2369f-3ac3-47d7-92db-e0be887087aa None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:30.280139 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2369f-3ac3-47d7-92db-e0be887087aa None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:30.280445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2369f-3ac3-47d7-92db-e0be887087aa None admin] PATH_INFO: `/v3/users/glance` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:30.296488 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2369f-3ac3-47d7-92db-e0be887087aa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:30.300091 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2369f-3ac3-47d7-92db-e0be887087aa None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:30.325002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-83f2369f-3ac3-47d7-92db-e0be887087aa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 14:15:30.325002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:30.325002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:30.325002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:30.325002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:30.325002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:30.325002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:30.325002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:30.325002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:30.325002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:30.325002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:30.325002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:30.325002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:15:30.325002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:15:30.325002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:15:30.325002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:15:30.326021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:30.326021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:30.326021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:15:30.326021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:30.326021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:15:30.326021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:30.326021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:30.326021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:30.326021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:30.326021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:30.326021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:30.326021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:30.326021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:30.326021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:30.326021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:30.326021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:30.326021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:30.326021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:30.327081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:30.327081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:30.327081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:15:30.327081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:15:30.327081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:15:30.327081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:15:30.327081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:15:30.327081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:15:30.327081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 14:15:30.327081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:30.335899 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 304/619] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:15:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:15:30.337533 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2369f-3ac3-47d7-92db-e0be887087aa None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:30.343115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:30.364432 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa770f83-d55b-4db7-8fbf-7ee2280c7be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:30.365082 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa770f83-d55b-4db7-8fbf-7ee2280c7be4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:30.365363 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa770f83-d55b-4db7-8fbf-7ee2280c7be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:30.365639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa770f83-d55b-4db7-8fbf-7ee2280c7be4 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:30.366408 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa770f83-d55b-4db7-8fbf-7ee2280c7be4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:30.366769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa770f83-d55b-4db7-8fbf-7ee2280c7be4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:30.368295 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa770f83-d55b-4db7-8fbf-7ee2280c7be4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:30.395295 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 316/620] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:15:30.404260 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa770f83-d55b-4db7-8fbf-7ee2280c7be4 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:30.476244 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:30.609669 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2369f-3ac3-47d7-92db-e0be887087aa None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:30.612266 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa770f83-d55b-4db7-8fbf-7ee2280c7be4 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:30.692674 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b70ac-b074-4408-b169-7f16a8d43670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:30.693335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b70ac-b074-4408-b169-7f16a8d43670 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:30.693612 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b70ac-b074-4408-b169-7f16a8d43670 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:30.693886 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b70ac-b074-4408-b169-7f16a8d43670 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:30.696190 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8492d-e290-44c0-8f15-d2e8a7f3852f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:30.696830 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8492d-e290-44c0-8f15-d2e8a7f3852f None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:30.697106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8492d-e290-44c0-8f15-d2e8a7f3852f None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:30.697379 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8492d-e290-44c0-8f15-d2e8a7f3852f None admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:30.698133 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8492d-e290-44c0-8f15-d2e8a7f3852f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:30.698437 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8492d-e290-44c0-8f15-d2e8a7f3852f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:30.699938 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8492d-e290-44c0-8f15-d2e8a7f3852f None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:30.715589 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b70ac-b074-4408-b169-7f16a8d43670 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:30.717133 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b70ac-b074-4408-b169-7f16a8d43670 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:30.741975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-116b70ac-b074-4408-b169-7f16a8d43670 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 14:15:30.741975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:30.741975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:30.741975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:30.741975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:30.741975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:30.741975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:30.741975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:30.741975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:30.741975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:30.741975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:30.741975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:30.741975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:15:30.741975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:15:30.741975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:15:30.741975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:15:30.742954 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:30.742954 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:30.742954 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:15:30.742954 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:30.742954 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:15:30.742954 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:30.742954 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:30.742954 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:30.742954 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:30.742954 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:30.742954 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:30.742954 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:30.742954 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:30.742954 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:30.742954 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:30.742954 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:30.742954 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:30.742954 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:30.743928 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:30.743928 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:30.743928 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:15:30.743928 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:15:30.743928 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:15:30.743928 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:15:30.743928 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:15:30.743928 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:15:30.743928 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 14:15:30.743928 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:30.743928 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 317/621] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:15:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:15:30.753807 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 305/622] 10.222.0.62 () {56 vars in 1137 bytes} [Tue Oct 4 14:15:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:30.754835 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b70ac-b074-4408-b169-7f16a8d43670 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:30.763090 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8492d-e290-44c0-8f15-d2e8a7f3852f None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:30.901017 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:30.941803 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b70ac-b074-4408-b169-7f16a8d43670 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:30.953093 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:30.992272 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8492d-e290-44c0-8f15-d2e8a7f3852f None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:30.997681 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047a59d-3f57-4122-b74c-96276ee16978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:30.998313 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047a59d-3f57-4122-b74c-96276ee16978 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:30.998589 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047a59d-3f57-4122-b74c-96276ee16978 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:30.998883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047a59d-3f57-4122-b74c-96276ee16978 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:30.999632 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047a59d-3f57-4122-b74c-96276ee16978 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:30.999960 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047a59d-3f57-4122-b74c-96276ee16978 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:31.002114 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047a59d-3f57-4122-b74c-96276ee16978 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:31.026454 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 318/623] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Oct 4 14:15:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:31.027785 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df64d11-6bd6-4ca0-bd86-807e6cc72aeb None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:31.028073 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df64d11-6bd6-4ca0-bd86-807e6cc72aeb None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:31.028344 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df64d11-6bd6-4ca0-bd86-807e6cc72aeb None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:31.035704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 319/624] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:31.037134 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1d3cb-4e85-43b6-8365-ae7ae6e060b6 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:31.037419 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1d3cb-4e85-43b6-8365-ae7ae6e060b6 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:31.037876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1d3cb-4e85-43b6-8365-ae7ae6e060b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:31.044312 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e035aeb-5ee0-427c-9443-6919830dcc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:31.045450 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e035aeb-5ee0-427c-9443-6919830dcc51 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:31.047495 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e035aeb-5ee0-427c-9443-6919830dcc51 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:31.048100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e035aeb-5ee0-427c-9443-6919830dcc51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:31.060776 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-7cd1d3cb-4e85-43b6-8365-ae7ae6e060b6 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:31.061953 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7cd1d3cb-4e85-43b6-8365-ae7ae6e060b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:31.135276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e035aeb-5ee0-427c-9443-6919830dcc51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:31.136803 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e035aeb-5ee0-427c-9443-6919830dcc51 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:31.150121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 320/625] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:31.151156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1d3cb-4e85-43b6-8365-ae7ae6e060b6 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:31.208934 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:31.256182 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 306/626] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:15:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 14:15:31.265590 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e035aeb-5ee0-427c-9443-6919830dcc51 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:31.275421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:31.284251 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1d3cb-4e85-43b6-8365-ae7ae6e060b6 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:31.329717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1361d-60a7-4f05-aa50-145f61147407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:31.330387 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1361d-60a7-4f05-aa50-145f61147407 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:31.330662 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1361d-60a7-4f05-aa50-145f61147407 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:31.330939 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1361d-60a7-4f05-aa50-145f61147407 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:31.344459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1361d-60a7-4f05-aa50-145f61147407 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:31.346389 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1361d-60a7-4f05-aa50-145f61147407 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:31.365210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-bec1361d-60a7-4f05-aa50-145f61147407 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:31.365210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:31.365210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:31.365210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:31.365210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:31.365210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:31.365210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:31.365210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:31.365210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:31.365210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:31.365210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:31.365210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:31.365210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:31.365210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:31.365210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:31.365210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:31.367041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:31.367041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:31.367041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:31.367041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:31.367041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:31.367041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:31.367041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:31.367041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:31.367041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:31.367041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:31.367041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:31.367041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:31.367041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:31.367041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:31.367041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:31.367041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:31.367041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:31.368818 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:31.368818 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:31.368818 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:31.368818 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 321/627] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:31.378962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1361d-60a7-4f05-aa50-145f61147407 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:31.515330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e035aeb-5ee0-427c-9443-6919830dcc51 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:31.557759 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1361d-60a7-4f05-aa50-145f61147407 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:31.572698 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2cd33-ab82-4a35-9ccf-a2b4f8208b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:31.573621 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2cd33-ab82-4a35-9ccf-a2b4f8208b59 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:31.573923 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2cd33-ab82-4a35-9ccf-a2b4f8208b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:31.574707 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2cd33-ab82-4a35-9ccf-a2b4f8208b59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:31.591427 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2cd33-ab82-4a35-9ccf-a2b4f8208b59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:31.594796 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2cd33-ab82-4a35-9ccf-a2b4f8208b59 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:31.598369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2a446-a7d0-4820-803d-91f1ed1ec8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:31.599001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2a446-a7d0-4820-803d-91f1ed1ec8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:31.599283 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2a446-a7d0-4820-803d-91f1ed1ec8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:31.599558 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2a446-a7d0-4820-803d-91f1ed1ec8c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:31.600252 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2a446-a7d0-4820-803d-91f1ed1ec8c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:31.600530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2a446-a7d0-4820-803d-91f1ed1ec8c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:31.602002 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2a446-a7d0-4820-803d-91f1ed1ec8c0 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:31.616677 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 322/628] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:15:31.617089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-6ae2cd33-ab82-4a35-9ccf-a2b4f8208b59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:31.617089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:31.617089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:31.617089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:31.617089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:31.617089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:31.617089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:31.617089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:31.617089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:31.617089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:31.617089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:31.617089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:31.617089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:31.617089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:31.617089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:31.617089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:31.619497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:31.619497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:31.619497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:31.619497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:31.619497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:31.619497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:31.619497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:31.619497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:31.619497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:31.619497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:31.619497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:31.619497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:31.619497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:31.619497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:31.619497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:31.619497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:31.619497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:31.621512 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:31.621512 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:31.621512 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:31.621902 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2a446-a7d0-4820-803d-91f1ed1ec8c0 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:31.622052 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 307/629] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:15:31.633396 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:31.634983 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2cd33-ab82-4a35-9ccf-a2b4f8208b59 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:31.657543 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:31.793619 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2a446-a7d0-4820-803d-91f1ed1ec8c0 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:31.820368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2cd33-ab82-4a35-9ccf-a2b4f8208b59 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:31.860112 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f40a2e-9d40-4f7b-b1be-27e6633e6081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:31.860552 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f40a2e-9d40-4f7b-b1be-27e6633e6081 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:31.860710 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f40a2e-9d40-4f7b-b1be-27e6633e6081 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:31.860978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f40a2e-9d40-4f7b-b1be-27e6633e6081 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:31.873654 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f40a2e-9d40-4f7b-b1be-27e6633e6081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:15:31.880101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-e4f40a2e-9d40-4f7b-b1be-27e6633e6081 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:31.880101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:31.880101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:31.880101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:31.880101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:31.880101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:31.880101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:31.880101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:31.880101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:31.880101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:31.880101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:31.880101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:31.880101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:15:31.880101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:15:31.880101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:15:31.880101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:15:31.881935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:15:31.881935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:15:31.881935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:15:31.881935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:15:31.881935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:31.881935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:31.881935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:31.881935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:31.881935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:31.881935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:31.881935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:31.881935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:31.881935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:31.881935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:31.881935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:31.881935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:31.883591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:31.883591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:31.883591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:31.883591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:31.883591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:15:31.883591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:15:31.883591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:15:31.883591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:15:31.883591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:15:31.883591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:15:31.883591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:31.883591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:31.883591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 323/630] 10.222.0.62 () {56 vars in 1102 bytes} [Tue Oct 4 14:15:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:31.883591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f40a2e-9d40-4f7b-b1be-27e6633e6081 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:31.906131 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d63ee-582d-4330-a109-a525e5b33ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:31.908274 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d63ee-582d-4330-a109-a525e5b33ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:31.909651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d63ee-582d-4330-a109-a525e5b33ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:31.910355 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d63ee-582d-4330-a109-a525e5b33ef8 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:31.911807 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d63ee-582d-4330-a109-a525e5b33ef8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:31.913533 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d63ee-582d-4330-a109-a525e5b33ef8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:31.917885 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d63ee-582d-4330-a109-a525e5b33ef8 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:31.964865 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 308/631] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:31.964865 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d63ee-582d-4330-a109-a525e5b33ef8 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:32.004006 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:32.069638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:32.110412 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f40a2e-9d40-4f7b-b1be-27e6633e6081 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:32.117538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d63ee-582d-4330-a109-a525e5b33ef8 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:32.178895 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a19d0-db76-4740-8984-862c1299fe32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:32.179942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a19d0-db76-4740-8984-862c1299fe32 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:32.180408 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a19d0-db76-4740-8984-862c1299fe32 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:32.180942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a19d0-db76-4740-8984-862c1299fe32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:32.194306 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a19d0-db76-4740-8984-862c1299fe32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:32.197160 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a19d0-db76-4740-8984-862c1299fe32 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:32.205805 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5dae9-ea54-48d0-a1aa-37429ea9f6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:32.207303 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5dae9-ea54-48d0-a1aa-37429ea9f6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:32.208123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5dae9-ea54-48d0-a1aa-37429ea9f6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:32.208866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5dae9-ea54-48d0-a1aa-37429ea9f6a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:32.210680 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5dae9-ea54-48d0-a1aa-37429ea9f6a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:32.212297 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5dae9-ea54-48d0-a1aa-37429ea9f6a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:32.215020 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5dae9-ea54-48d0-a1aa-37429ea9f6a9 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:32.220236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-f02a19d0-db76-4740-8984-862c1299fe32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:32.220236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:32.220236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:32.220236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:32.220236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:32.220236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:32.220236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:32.220236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:32.220236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:32.220236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:32.220236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:32.220236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:32.220236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:15:32.220236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:15:32.220236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:15:32.221979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:15:32.221979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:32.221979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:32.221979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:32.221979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:32.221979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:32.221979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:32.221979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:32.221979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:32.221979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:32.221979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:32.221979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:32.221979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:32.221979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:32.221979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:32.221979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:32.221979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:32.223743 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:15:32.223743 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:15:32.223743 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:15:32.223743 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:15:32.223743 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:15:32.223743 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:15:32.223743 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:32.223743 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:32.230041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 324/632] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:15:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:32.231628 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a19d0-db76-4740-8984-862c1299fe32 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:32.243121 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 309/633] 10.222.0.62 () {56 vars in 1103 bytes} [Tue Oct 4 14:15:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:32.245041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5dae9-ea54-48d0-a1aa-37429ea9f6a9 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:32.406123 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a19d0-db76-4740-8984-862c1299fe32 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:32.414287 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5dae9-ea54-48d0-a1aa-37429ea9f6a9 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:32.447088 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:32.457081 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062046b8-11ad-46dc-9f5f-d6d70da5f26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:32.457725 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062046b8-11ad-46dc-9f5f-d6d70da5f26d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:32.458002 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062046b8-11ad-46dc-9f5f-d6d70da5f26d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:32.458274 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062046b8-11ad-46dc-9f5f-d6d70da5f26d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:32.465600 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062046b8-11ad-46dc-9f5f-d6d70da5f26d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:32.467105 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062046b8-11ad-46dc-9f5f-d6d70da5f26d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:32.468585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ca634-28f1-4fd7-a584-02b7ea3401a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:32.469205 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ca634-28f1-4fd7-a584-02b7ea3401a5 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:32.469480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ca634-28f1-4fd7-a584-02b7ea3401a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:32.469770 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ca634-28f1-4fd7-a584-02b7ea3401a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:32.470465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ca634-28f1-4fd7-a584-02b7ea3401a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:32.470769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ca634-28f1-4fd7-a584-02b7ea3401a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:32.472308 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ca634-28f1-4fd7-a584-02b7ea3401a5 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:32.474154 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:32.479970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-062046b8-11ad-46dc-9f5f-d6d70da5f26d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:32.479970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:32.479970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:32.479970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:32.479970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:32.479970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:32.479970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:32.479970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:32.479970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:32.479970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:32.479970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:32.479970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:32.479970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:15:32.479970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:15:32.479970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:15:32.482680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:15:32.482680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:32.482680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:32.482680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:32.482680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:32.482680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:32.482680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:32.482680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:32.482680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:32.482680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:32.482680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:32.482680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:32.482680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:32.482680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:32.482680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:32.482680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:32.482680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:32.485036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:15:32.485036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:15:32.485036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:15:32.485036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:15:32.485036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:15:32.485036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:15:32.485036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:32.485036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:32.485036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 325/634] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:15:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:32.485036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acbf73-d0fb-4e61-921f-be5f6b202168 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:32.485036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acbf73-d0fb-4e61-921f-be5f6b202168 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:32.487482 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acbf73-d0fb-4e61-921f-be5f6b202168 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:32.487482 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 326/635] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:32.487482 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acbf73-d0fb-4e61-921f-be5f6b202168 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:32.493364 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 310/636] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:15:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:32.494828 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfec09-9d35-4f79-83f5-fd684e9b12d3 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:32.495127 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfec09-9d35-4f79-83f5-fd684e9b12d3 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:32.495377 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfec09-9d35-4f79-83f5-fd684e9b12d3 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:32.496850 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 311/637] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:32.497511 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfec09-9d35-4f79-83f5-fd684e9b12d3 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:32.622903 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acbf73-d0fb-4e61-921f-be5f6b202168 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:32.636362 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfec09-9d35-4f79-83f5-fd684e9b12d3 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:32.664554 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d234d6f-1160-4180-aedf-324a7fdd893a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:32.665200 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d234d6f-1160-4180-aedf-324a7fdd893a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:32.665533 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d234d6f-1160-4180-aedf-324a7fdd893a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:32.665858 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d234d6f-1160-4180-aedf-324a7fdd893a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:32.677404 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e178a-fc33-49cf-bcee-f37db76c3835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:32.678028 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e178a-fc33-49cf-bcee-f37db76c3835 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:32.678308 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e178a-fc33-49cf-bcee-f37db76c3835 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:32.678578 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e178a-fc33-49cf-bcee-f37db76c3835 None admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:32.679277 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e178a-fc33-49cf-bcee-f37db76c3835 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:32.679578 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e178a-fc33-49cf-bcee-f37db76c3835 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:32.680653 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d234d6f-1160-4180-aedf-324a7fdd893a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:32.681059 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e178a-fc33-49cf-bcee-f37db76c3835 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:32.682407 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d234d6f-1160-4180-aedf-324a7fdd893a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:32.694816 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 312/638] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:15:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:32.696214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae34721-2f4f-47f1-89f3-bf0b92b09b78 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:32.696575 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae34721-2f4f-47f1-89f3-bf0b92b09b78 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:32.696852 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae34721-2f4f-47f1-89f3-bf0b92b09b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:32.703808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-5d234d6f-1160-4180-aedf-324a7fdd893a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:32.703808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:32.703808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:32.703808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:32.703808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:32.703808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:32.703808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:32.703808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:32.703808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:32.703808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:32.703808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:32.703808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:32.703808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:32.703808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:32.703808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:32.703808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:32.705834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:32.705834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:32.705834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:32.705834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:32.705834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:32.705834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:32.705834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:32.705834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:32.705834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:32.705834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:32.705834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:32.705834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:32.705834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:32.705834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:32.705834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:32.705834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:32.705834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:32.715372 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:32.715372 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:32.715372 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:32.715372 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 327/639] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:32.715372 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d234d6f-1160-4180-aedf-324a7fdd893a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:32.724670 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-cae34721-2f4f-47f1-89f3-bf0b92b09b78 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:32.726446 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-cae34721-2f4f-47f1-89f3-bf0b92b09b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:32.762957 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:32.793378 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:32.815095 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 313/640] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:32.816985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fe5bf-2101-44d5-9eaf-98282ad923c8 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:32.817447 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fe5bf-2101-44d5-9eaf-98282ad923c8 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:32.817904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fe5bf-2101-44d5-9eaf-98282ad923c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:32.830701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d234d6f-1160-4180-aedf-324a7fdd893a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:32.840389 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-ae2fe5bf-2101-44d5-9eaf-98282ad923c8 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:32.841987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-ae2fe5bf-2101-44d5-9eaf-98282ad923c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:32.875431 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18607d-f09e-43ed-8403-a2d5d663efe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:32.876515 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18607d-f09e-43ed-8403-a2d5d663efe3 None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:32.876977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18607d-f09e-43ed-8403-a2d5d663efe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:32.877459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18607d-f09e-43ed-8403-a2d5d663efe3 None admin] PATH_INFO: `/v3/projects/fd73ece314ef4f2eabb34e2a88d610ba/users/4860d5958e724e568576a9067290a27e/roles/e5d031634de14f1e86b912ddddfe7f8c` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:32.899342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18607d-f09e-43ed-8403-a2d5d663efe3 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd73ece314ef4f2eabb34e2a88d610ba, user_id=4860d5958e724e568576a9067290a27e, role_id=e5d031634de14f1e86b912ddddfe7f8c)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:32.901328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18607d-f09e-43ed-8403-a2d5d663efe3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:32.919251 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 328/641] 10.222.0.62 () {58 vars in 1439 bytes} [Tue Oct 4 14:15:32 2022] PUT /identity/v3/projects/fd73ece314ef4f2eabb34e2a88d610ba/users/4860d5958e724e568576a9067290a27e/roles/e5d031634de14f1e86b912ddddfe7f8c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:15:32.921914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18607d-f09e-43ed-8403-a2d5d663efe3 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:32.947770 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 314/642] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:32.949032 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fe5bf-2101-44d5-9eaf-98282ad923c8 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:33.165422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fe5bf-2101-44d5-9eaf-98282ad923c8 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:33.174826 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:33.191408 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:33.203962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18607d-f09e-43ed-8403-a2d5d663efe3 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:33.228004 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fbb3e-f0d4-4bf7-8eae-824728c2a0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:33.228757 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fbb3e-f0d4-4bf7-8eae-824728c2a0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:33.228905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fbb3e-f0d4-4bf7-8eae-824728c2a0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:33.229165 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fbb3e-f0d4-4bf7-8eae-824728c2a0e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:33.229829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fbb3e-f0d4-4bf7-8eae-824728c2a0e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:33.230123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fbb3e-f0d4-4bf7-8eae-824728c2a0e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:33.232047 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fbb3e-f0d4-4bf7-8eae-824728c2a0e0 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:33.246346 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 315/643] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:33.247265 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fbb3e-f0d4-4bf7-8eae-824728c2a0e0 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:33.276476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb03fd1-625d-4121-b8d8-470b9c196636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:33.278178 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb03fd1-625d-4121-b8d8-470b9c196636 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:33.278969 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb03fd1-625d-4121-b8d8-470b9c196636 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:33.279455 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb03fd1-625d-4121-b8d8-470b9c196636 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:33.281844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb03fd1-625d-4121-b8d8-470b9c196636 None admin] RBAC: Adding query filter params (role.id=e5d031634de14f1e86b912ddddfe7f8c, scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba, user.id=289b020c9cd242dca9b512803199daae) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:33.282936 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb03fd1-625d-4121-b8d8-470b9c196636 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:33.285326 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb03fd1-625d-4121-b8d8-470b9c196636 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:33.295555 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 329/644] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:15:32 2022] GET /identity/v3/role_assignments?user.id=289b020c9cd242dca9b512803199daae&scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba&role.id=e5d031634de14f1e86b912ddddfe7f8c => generated 608 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:33.296877 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb03fd1-625d-4121-b8d8-470b9c196636 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:33.420393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fbb3e-f0d4-4bf7-8eae-824728c2a0e0 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:33.465018 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7772ac-72cb-44f3-bf02-1c9f373b5358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:33.465746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7772ac-72cb-44f3-bf02-1c9f373b5358 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:33.466185 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7772ac-72cb-44f3-bf02-1c9f373b5358 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:33.466744 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7772ac-72cb-44f3-bf02-1c9f373b5358 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:33.480216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7772ac-72cb-44f3-bf02-1c9f373b5358 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:15:33.485647 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb03fd1-625d-4121-b8d8-470b9c196636 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:33.486720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-0b7772ac-72cb-44f3-bf02-1c9f373b5358 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:33.486720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:33.486720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:33.486720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:33.486720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:33.486720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:33.486720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:33.486720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:33.486720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:33.486720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:33.486720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:33.486720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:33.486720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:15:33.486720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:15:33.486720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:15:33.486720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:15:33.487739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:15:33.487739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:15:33.487739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:15:33.487739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:15:33.487739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:33.487739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:33.487739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:33.487739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:33.487739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:33.487739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:33.487739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:33.487739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:33.487739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:33.487739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:33.487739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:33.487739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:33.488640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:33.488640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:33.488640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:33.488640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:33.488640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:15:33.488640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:15:33.488640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:15:33.488640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:15:33.488640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:15:33.488640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:15:33.488640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:33.488640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:33.493410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 316/645] 10.222.0.62 () {56 vars in 1102 bytes} [Tue Oct 4 14:15:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:33.494461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7772ac-72cb-44f3-bf02-1c9f373b5358 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:33.545060 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:33.545254 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4d010-caf1-429b-aa24-60940a6750a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:33.551618 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4d010-caf1-429b-aa24-60940a6750a5 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:33.552059 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4d010-caf1-429b-aa24-60940a6750a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:33.552342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4d010-caf1-429b-aa24-60940a6750a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:33.567445 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4d010-caf1-429b-aa24-60940a6750a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:33.569010 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4d010-caf1-429b-aa24-60940a6750a5 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:33.585145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-14c4d010-caf1-429b-aa24-60940a6750a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 14:15:33.585145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:33.585145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:33.585145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:33.585145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:33.585145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:33.585145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:33.585145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:33.585145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:33.585145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:33.585145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:33.585145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:33.585145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:15:33.585145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:15:33.585145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:15:33.585145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:15:33.586159 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:33.586159 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:33.586159 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:15:33.586159 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:33.586159 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:15:33.586159 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:33.586159 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:33.586159 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:33.586159 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:33.586159 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:33.586159 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:33.586159 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:33.586159 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:33.586159 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:33.586159 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:33.586159 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:33.586159 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:33.586159 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:33.587255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:33.587255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:33.587255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:15:33.587255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:15:33.587255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:15:33.587255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:15:33.587255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:15:33.587255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:15:33.587255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 14:15:33.587255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:33.587255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 330/646] 10.222.0.62 () {56 vars in 1093 bytes} [Tue Oct 4 14:15:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:33.589136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4d010-caf1-429b-aa24-60940a6750a5 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:33.611182 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:33.667051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7772ac-72cb-44f3-bf02-1c9f373b5358 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:33.734804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4d010-caf1-429b-aa24-60940a6750a5 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:33.747587 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d396d8-0cf4-4db0-9381-db513b120bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:33.751255 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d396d8-0cf4-4db0-9381-db513b120bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:33.752114 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d396d8-0cf4-4db0-9381-db513b120bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:33.752393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d396d8-0cf4-4db0-9381-db513b120bd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:33.768401 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d396d8-0cf4-4db0-9381-db513b120bd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:15:33.773598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-37d396d8-0cf4-4db0-9381-db513b120bd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:33.773598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:33.773598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:33.773598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:33.773598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:33.773598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:33.773598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:33.773598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:33.773598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:33.773598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:33.773598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:33.773598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:33.773598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:15:33.773598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:15:33.773598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:15:33.773598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:15:33.775459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:15:33.775459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:15:33.775459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:15:33.775459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:15:33.775459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:33.775459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:33.775459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:33.775459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:33.775459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:33.775459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:33.775459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:33.775459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:33.775459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:33.775459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:33.775459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:33.775459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:33.777104 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:33.777104 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:33.777104 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:33.777104 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:33.777104 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:15:33.777104 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:15:33.777104 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:15:33.777104 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:15:33.777104 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:15:33.777104 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:15:33.777104 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:33.777104 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:33.777104 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 317/647] 10.222.0.62 () {56 vars in 1102 bytes} [Tue Oct 4 14:15:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:33.777104 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d396d8-0cf4-4db0-9381-db513b120bd2 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:33.813309 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d74732-ede6-4397-b0e6-2f0d93ee88fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:33.813772 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d74732-ede6-4397-b0e6-2f0d93ee88fc None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:33.814055 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d74732-ede6-4397-b0e6-2f0d93ee88fc None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:33.814319 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d74732-ede6-4397-b0e6-2f0d93ee88fc None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:33.814993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d74732-ede6-4397-b0e6-2f0d93ee88fc None admin] RBAC: Adding query filter params (name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:33.815292 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d74732-ede6-4397-b0e6-2f0d93ee88fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:33.816740 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d74732-ede6-4397-b0e6-2f0d93ee88fc None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:33.826719 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 331/648] 10.222.0.62 () {56 vars in 1103 bytes} [Tue Oct 4 14:15:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:33.827693 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d74732-ede6-4397-b0e6-2f0d93ee88fc None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:33.950541 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:33.969671 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d396d8-0cf4-4db0-9381-db513b120bd2 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:33.992370 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:34.002452 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d74732-ede6-4397-b0e6-2f0d93ee88fc None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:34.032348 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b25a29-cce7-40b4-9aaf-8f7e070cbf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:34.032795 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b25a29-cce7-40b4-9aaf-8f7e070cbf51 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:34.033075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b25a29-cce7-40b4-9aaf-8f7e070cbf51 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:34.033352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b25a29-cce7-40b4-9aaf-8f7e070cbf51 None admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:34.034117 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b25a29-cce7-40b4-9aaf-8f7e070cbf51 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:34.034426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b25a29-cce7-40b4-9aaf-8f7e070cbf51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:34.035939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b25a29-cce7-40b4-9aaf-8f7e070cbf51 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:34.064004 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 318/649] 10.222.0.62 () {56 vars in 1133 bytes} [Tue Oct 4 14:15:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:34.064004 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b25a29-cce7-40b4-9aaf-8f7e070cbf51 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:34.107503 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b1f8c-75a9-43d0-aaa1-cdff9d77a084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:34.111821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b1f8c-75a9-43d0-aaa1-cdff9d77a084 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:34.112689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b1f8c-75a9-43d0-aaa1-cdff9d77a084 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:34.113847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b1f8c-75a9-43d0-aaa1-cdff9d77a084 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:34.116535 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b1f8c-75a9-43d0-aaa1-cdff9d77a084 None admin] RBAC: Adding query filter params (name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:34.117761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b1f8c-75a9-43d0-aaa1-cdff9d77a084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:34.122269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b1f8c-75a9-43d0-aaa1-cdff9d77a084 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:34.150741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 332/650] 10.222.0.62 () {56 vars in 1103 bytes} [Tue Oct 4 14:15:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:34.154034 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b1f8c-75a9-43d0-aaa1-cdff9d77a084 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:34.223556 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b25a29-cce7-40b4-9aaf-8f7e070cbf51 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:34.266726 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d764f28-4da3-487f-ab45-dbf4bde76220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:34.267728 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d764f28-4da3-487f-ab45-dbf4bde76220 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:34.267728 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d764f28-4da3-487f-ab45-dbf4bde76220 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:34.267728 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d764f28-4da3-487f-ab45-dbf4bde76220 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:34.279567 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d764f28-4da3-487f-ab45-dbf4bde76220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:34.282435 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d764f28-4da3-487f-ab45-dbf4bde76220 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:34.300762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-1d764f28-4da3-487f-ab45-dbf4bde76220 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:34.300762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:34.300762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:34.300762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:34.300762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:34.300762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:34.300762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:34.300762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:34.300762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:34.300762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:34.300762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:34.300762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:34.300762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:34.300762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:34.300762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:34.300762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:34.302662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:34.302662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:34.302662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:34.302662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:34.302662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:34.302662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:34.302662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:34.302662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:34.302662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:34.302662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:34.302662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:34.302662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:34.302662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:34.302662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:34.302662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:34.302662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:34.302662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:34.304451 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:34.304451 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:34.304451 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:34.306828 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 319/651] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:34.307938 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d764f28-4da3-487f-ab45-dbf4bde76220 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:34.313611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:34.397527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b1f8c-75a9-43d0-aaa1-cdff9d77a084 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:34.440249 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d764f28-4da3-487f-ab45-dbf4bde76220 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:34.485316 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08308434-c5d5-4e72-bdfa-c0b299203898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:34.486003 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08308434-c5d5-4e72-bdfa-c0b299203898 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:34.486288 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08308434-c5d5-4e72-bdfa-c0b299203898 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:34.486567 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08308434-c5d5-4e72-bdfa-c0b299203898 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:34.489465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e7b14-c4cb-4290-a06a-f0df91370ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:34.491403 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e7b14-c4cb-4290-a06a-f0df91370ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:34.492240 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e7b14-c4cb-4290-a06a-f0df91370ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:34.493067 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e7b14-c4cb-4290-a06a-f0df91370ac6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:34.499455 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08308434-c5d5-4e72-bdfa-c0b299203898 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:34.501297 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08308434-c5d5-4e72-bdfa-c0b299203898 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:34.519194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-08308434-c5d5-4e72-bdfa-c0b299203898 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:34.519194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:34.519194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:34.519194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:34.519194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:34.519194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:34.519194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:34.519194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:34.519194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:34.519194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:34.519194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:34.519194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:34.519194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:34.519194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:34.519194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:34.519194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:34.521047 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:34.521047 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:34.521047 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:34.521047 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:34.521047 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:34.521047 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:34.521047 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:34.521047 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:34.521047 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:34.521047 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:34.521047 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:34.521047 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:34.521047 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:34.521047 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:34.521047 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:34.521047 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:34.521047 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:34.522841 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:34.522841 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:34.522841 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:34.523186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:34.524571 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 320/652] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:34.525814 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08308434-c5d5-4e72-bdfa-c0b299203898 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:34.604259 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:34.657915 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e7b14-c4cb-4290-a06a-f0df91370ac6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:34.661972 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08308434-c5d5-4e72-bdfa-c0b299203898 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:34.662464 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e7b14-c4cb-4290-a06a-f0df91370ac6 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:34.710492 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f20f4d-b9bd-4572-b44e-ae68a1ce53d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:34.711168 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f20f4d-b9bd-4572-b44e-ae68a1ce53d7 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:34.711596 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f20f4d-b9bd-4572-b44e-ae68a1ce53d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:34.711920 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f20f4d-b9bd-4572-b44e-ae68a1ce53d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:34.712638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f20f4d-b9bd-4572-b44e-ae68a1ce53d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:34.714596 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f20f4d-b9bd-4572-b44e-ae68a1ce53d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:34.716116 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f20f4d-b9bd-4572-b44e-ae68a1ce53d7 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:34.736112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 321/653] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:34.737155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f20f4d-b9bd-4572-b44e-ae68a1ce53d7 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:34.913827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 333/654] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:15:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 760 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:15:34.913827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e7b14-c4cb-4290-a06a-f0df91370ac6 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:34.920887 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f20f4d-b9bd-4572-b44e-ae68a1ce53d7 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:34.960651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:34.983591 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c468e47-e7ae-492f-9255-5885b6eacd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:34.984704 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c468e47-e7ae-492f-9255-5885b6eacd3a None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:34.984704 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c468e47-e7ae-492f-9255-5885b6eacd3a None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:34.984962 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c468e47-e7ae-492f-9255-5885b6eacd3a None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:34.985628 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c468e47-e7ae-492f-9255-5885b6eacd3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:34.985933 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c468e47-e7ae-492f-9255-5885b6eacd3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:34.988561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c468e47-e7ae-492f-9255-5885b6eacd3a None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:34.998610 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:35.008033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 322/655] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:35.009454 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c468e47-e7ae-492f-9255-5885b6eacd3a None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:35.142991 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c468e47-e7ae-492f-9255-5885b6eacd3a None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:35.149101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e7b14-c4cb-4290-a06a-f0df91370ac6 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:35.188674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55c03c-406f-4141-bea8-c8d9fecc35a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:35.189224 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55c03c-406f-4141-bea8-c8d9fecc35a3 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:35.189506 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55c03c-406f-4141-bea8-c8d9fecc35a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:35.189781 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55c03c-406f-4141-bea8-c8d9fecc35a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:35.204494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55c03c-406f-4141-bea8-c8d9fecc35a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:35.206018 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55c03c-406f-4141-bea8-c8d9fecc35a3 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:35.223845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-ca55c03c-406f-4141-bea8-c8d9fecc35a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:35.223845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:35.223845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:35.223845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:35.223845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:35.223845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:35.223845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:35.223845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:35.223845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:35.223845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:35.223845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:35.223845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:35.223845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:35.223845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:35.223845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:35.223845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:35.225769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:35.225769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:35.225769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:35.225769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:35.225769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:35.225769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:35.225769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:35.225769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:35.225769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:35.225769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:35.225769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:35.225769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:35.225769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:35.225769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:35.225769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:35.225769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:35.225769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:35.227554 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:35.227554 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:35.227554 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:35.229990 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 323/656] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:35.230990 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55c03c-406f-4141-bea8-c8d9fecc35a3 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:35.240727 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f287f-dfc1-4eda-b471-30fb84ed5963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:35.242307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f287f-dfc1-4eda-b471-30fb84ed5963 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:35.243075 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f287f-dfc1-4eda-b471-30fb84ed5963 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:35.243917 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f287f-dfc1-4eda-b471-30fb84ed5963 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:35.260081 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f287f-dfc1-4eda-b471-30fb84ed5963 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:35.264296 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f287f-dfc1-4eda-b471-30fb84ed5963 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:35.267576 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:35.295190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-a01f287f-dfc1-4eda-b471-30fb84ed5963 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 14:15:35.295190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:35.295190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:35.295190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:35.295190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:35.295190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:35.295190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:35.295190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:35.295190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:35.295190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:35.295190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:35.295190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:35.295190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:15:35.295190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:15:35.295190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:15:35.295190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:15:35.298530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:35.298530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:35.298530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:15:35.298530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:35.298530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:15:35.298530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:35.298530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:35.298530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:35.298530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:35.298530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:35.298530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:35.298530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:35.298530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:35.298530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:35.298530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:35.298530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:35.298530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:35.298530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:35.300527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:35.300527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:35.300527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:15:35.300527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:15:35.300527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:15:35.300527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:15:35.300527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:15:35.300527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:15:35.300527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 14:15:35.300527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:35.306638 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 334/657] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:15:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:35.308625 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f287f-dfc1-4eda-b471-30fb84ed5963 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:35.365927 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55c03c-406f-4141-bea8-c8d9fecc35a3 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:35.446690 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb85870-d48c-4652-99cf-8f124b3685a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:35.449646 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb85870-d48c-4652-99cf-8f124b3685a8 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:35.450817 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb85870-d48c-4652-99cf-8f124b3685a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:35.451570 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb85870-d48c-4652-99cf-8f124b3685a8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:35.473269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb85870-d48c-4652-99cf-8f124b3685a8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:35.473269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb85870-d48c-4652-99cf-8f124b3685a8 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:35.489536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-1fb85870-d48c-4652-99cf-8f124b3685a8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 14:15:35.489536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:35.489536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:35.489536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:35.489536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:35.489536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:35.489536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:35.489536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:35.489536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:35.489536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:35.489536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:35.489536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:35.489536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:15:35.489536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:15:35.489536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:15:35.489536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:15:35.491370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:35.491370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:35.491370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:15:35.491370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:35.491370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:15:35.491370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:35.491370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:35.491370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:35.491370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:35.491370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:35.491370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:35.491370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:35.491370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:35.491370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:35.491370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:35.491370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:35.491370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:35.491370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:35.493619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:35.493619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:35.493619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:15:35.493619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:15:35.493619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:15:35.493619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:15:35.493619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:15:35.493619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:15:35.493619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 14:15:35.493619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:35.494639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:35.498543 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 324/658] 10.222.0.62 () {56 vars in 1102 bytes} [Tue Oct 4 14:15:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:35.500115 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f287f-dfc1-4eda-b471-30fb84ed5963 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:35.501154 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb85870-d48c-4652-99cf-8f124b3685a8 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:35.544605 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec3dbc-640f-4257-a9ca-94473ef87487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:35.545236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec3dbc-640f-4257-a9ca-94473ef87487 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:35.545516 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec3dbc-640f-4257-a9ca-94473ef87487 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:35.546305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec3dbc-640f-4257-a9ca-94473ef87487 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:35.547731 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec3dbc-640f-4257-a9ca-94473ef87487 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:35.548059 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec3dbc-640f-4257-a9ca-94473ef87487 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:35.550026 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec3dbc-640f-4257-a9ca-94473ef87487 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:35.567549 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 335/659] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:35.573103 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec3dbc-640f-4257-a9ca-94473ef87487 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:35.608779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:35.623554 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb85870-d48c-4652-99cf-8f124b3685a8 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:35.673707 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d241e-9a83-492f-9e60-7412207c913d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:35.674613 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d241e-9a83-492f-9e60-7412207c913d None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:35.675042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d241e-9a83-492f-9e60-7412207c913d None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:35.675453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d241e-9a83-492f-9e60-7412207c913d None admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:35.676643 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d241e-9a83-492f-9e60-7412207c913d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:35.677120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d241e-9a83-492f-9e60-7412207c913d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:35.679842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d241e-9a83-492f-9e60-7412207c913d None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:35.702918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec3dbc-640f-4257-a9ca-94473ef87487 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:35.719354 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 325/660] 10.222.0.62 () {56 vars in 1137 bytes} [Tue Oct 4 14:15:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:35.719354 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5fd8d-00d0-4f6c-8898-20831efb9119 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:35.719354 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5fd8d-00d0-4f6c-8898-20831efb9119 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:35.719354 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5fd8d-00d0-4f6c-8898-20831efb9119 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:35.720347 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 326/661] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:35.721712 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5fd8d-00d0-4f6c-8898-20831efb9119 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:35.752867 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98de2d7-bf15-47c3-812c-b836451f7c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:35.753501 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98de2d7-bf15-47c3-812c-b836451f7c10 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:35.753779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98de2d7-bf15-47c3-812c-b836451f7c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:35.754056 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98de2d7-bf15-47c3-812c-b836451f7c10 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:35.754803 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98de2d7-bf15-47c3-812c-b836451f7c10 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:35.755106 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98de2d7-bf15-47c3-812c-b836451f7c10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:35.756632 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98de2d7-bf15-47c3-812c-b836451f7c10 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:35.777406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 336/662] 10.222.0.62 () {56 vars in 1139 bytes} [Tue Oct 4 14:15:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:35.783498 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98de2d7-bf15-47c3-812c-b836451f7c10 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:35.803613 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:35.879236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5fd8d-00d0-4f6c-8898-20831efb9119 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:35.924556 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464e670-3f4f-434c-98e4-5a39ae792514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:35.925253 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464e670-3f4f-434c-98e4-5a39ae792514 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:35.925531 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464e670-3f4f-434c-98e4-5a39ae792514 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:35.925803 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464e670-3f4f-434c-98e4-5a39ae792514 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:35.931691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98de2d7-bf15-47c3-812c-b836451f7c10 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:35.935858 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1464e670-3f4f-434c-98e4-5a39ae792514 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:35.938192 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1464e670-3f4f-434c-98e4-5a39ae792514 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:35.953956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-1464e670-3f4f-434c-98e4-5a39ae792514 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:35.953956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:35.953956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:35.953956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:35.953956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:35.953956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:35.953956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:35.953956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:35.953956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:35.953956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:35.953956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:35.953956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:35.953956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:15:35.953956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:15:35.953956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:15:35.954949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:15:35.954949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:35.954949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:35.954949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:35.954949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:35.954949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:35.954949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:35.954949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:35.954949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:35.954949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:35.954949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:35.954949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:35.954949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:35.954949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:35.954949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:35.954949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:35.954949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:35.957294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:15:35.957294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:15:35.957294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:15:35.957294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:15:35.957294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:15:35.957294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:15:35.957294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:35.957294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:35.957294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 327/663] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:15:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:35.957294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305ade6-174b-421d-9cf5-3183078ba15b None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:35.957294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305ade6-174b-421d-9cf5-3183078ba15b None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:35.958451 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305ade6-174b-421d-9cf5-3183078ba15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:35.973308 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:35.981267 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-c305ade6-174b-421d-9cf5-3183078ba15b None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:35.982502 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-c305ade6-174b-421d-9cf5-3183078ba15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:35.994186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d2c8e-e6e7-4b0e-9b1a-4b7ef3ac67c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:35.995167 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d2c8e-e6e7-4b0e-9b1a-4b7ef3ac67c2 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:35.995799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d2c8e-e6e7-4b0e-9b1a-4b7ef3ac67c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:35.996143 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d2c8e-e6e7-4b0e-9b1a-4b7ef3ac67c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:36.085327 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 328/664] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:36.087322 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305ade6-174b-421d-9cf5-3183078ba15b None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:36.124820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d2c8e-e6e7-4b0e-9b1a-4b7ef3ac67c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:36.126420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d2c8e-e6e7-4b0e-9b1a-4b7ef3ac67c2 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:36.158552 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:36.266819 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 337/665] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:15:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:15:36.267943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d2c8e-e6e7-4b0e-9b1a-4b7ef3ac67c2 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:36.297611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305ade6-174b-421d-9cf5-3183078ba15b None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:36.370875 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7762d7-2a92-4c3e-abe4-a4b4dd096a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:36.371768 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7762d7-2a92-4c3e-abe4-a4b4dd096a2e None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:36.372247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7762d7-2a92-4c3e-abe4-a4b4dd096a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:36.372760 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7762d7-2a92-4c3e-abe4-a4b4dd096a2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:36.379768 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:36.428406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d2c8e-e6e7-4b0e-9b1a-4b7ef3ac67c2 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:36.459002 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:36.486509 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f27aa-da5f-4b38-8e64-d4659d62d579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:36.487695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f27aa-da5f-4b38-8e64-d4659d62d579 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:36.488162 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f27aa-da5f-4b38-8e64-d4659d62d579 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:36.488593 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f27aa-da5f-4b38-8e64-d4659d62d579 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:36.489778 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f27aa-da5f-4b38-8e64-d4659d62d579 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:36.490264 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f27aa-da5f-4b38-8e64-d4659d62d579 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:36.490867 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7762d7-2a92-4c3e-abe4-a4b4dd096a2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:36.492745 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f27aa-da5f-4b38-8e64-d4659d62d579 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:36.493270 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7762d7-2a92-4c3e-abe4-a4b4dd096a2e None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:36.521038 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 338/666] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:15:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:36.521038 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7aa6e-7818-40ff-b306-5ebbe51a2664 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:36.521038 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7aa6e-7818-40ff-b306-5ebbe51a2664 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:36.521038 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7aa6e-7818-40ff-b306-5ebbe51a2664 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:36.521038 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 339/667] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:36.521038 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7aa6e-7818-40ff-b306-5ebbe51a2664 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:36.651546 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 329/668] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:15:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:15:36.652591 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7762d7-2a92-4c3e-abe4-a4b4dd096a2e None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:36.684643 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7aa6e-7818-40ff-b306-5ebbe51a2664 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:36.696949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:36.728255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e45da4-f976-4d17-9de7-8734b8f792db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:36.729240 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e45da4-f976-4d17-9de7-8734b8f792db None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:36.729681 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e45da4-f976-4d17-9de7-8734b8f792db None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:36.730031 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e45da4-f976-4d17-9de7-8734b8f792db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:36.743888 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e45da4-f976-4d17-9de7-8734b8f792db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:36.746082 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e45da4-f976-4d17-9de7-8734b8f792db None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:36.763896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-f9e45da4-f976-4d17-9de7-8734b8f792db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:36.763896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:36.763896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:36.763896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:36.763896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:36.763896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:36.763896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:36.763896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:36.763896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:36.763896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:36.763896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:36.763896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:36.763896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:36.763896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:36.763896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:36.763896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:36.766379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:36.766379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:36.766379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:36.766379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:36.766379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:36.766379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:36.766379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:36.766379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:36.766379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:36.766379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:36.766379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:36.766379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:36.766379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:36.766379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:36.766379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:36.766379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:36.766379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:36.768144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:36.768144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:36.768144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:36.768144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 340/669] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:36.768144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e45da4-f976-4d17-9de7-8734b8f792db None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:36.785182 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7762d7-2a92-4c3e-abe4-a4b4dd096a2e None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:36.806567 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:36.828969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a173011-6dcc-4314-a4e9-c49f73ebfa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:36.829729 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a173011-6dcc-4314-a4e9-c49f73ebfa19 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:36.830089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a173011-6dcc-4314-a4e9-c49f73ebfa19 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:36.830460 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a173011-6dcc-4314-a4e9-c49f73ebfa19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:36.844384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a173011-6dcc-4314-a4e9-c49f73ebfa19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:15:36.850453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-2a173011-6dcc-4314-a4e9-c49f73ebfa19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:36.850453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:36.850453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:36.850453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:36.850453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:36.850453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:36.850453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:36.850453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:36.850453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:36.850453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:36.850453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:36.850453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:36.850453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:15:36.850453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:15:36.850453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:15:36.850453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:15:36.856483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:15:36.856483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:15:36.856483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:15:36.856483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:15:36.856483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:36.856483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:36.856483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:36.856483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:36.856483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:36.856483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:36.856483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:36.856483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:36.856483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:36.856483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:36.856483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:36.856483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:36.858103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:36.858103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:36.858103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:36.858103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:36.858103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:15:36.858103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:15:36.858103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:15:36.858103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:15:36.858103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:15:36.858103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:15:36.858103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:36.858103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:36.858103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 330/670] 10.222.0.62 () {56 vars in 1102 bytes} [Tue Oct 4 14:15:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:36.858103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11759bb-4750-4b53-943e-ff6a0f99f332 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:36.860032 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11759bb-4750-4b53-943e-ff6a0f99f332 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:36.860032 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11759bb-4750-4b53-943e-ff6a0f99f332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:36.876167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-e11759bb-4750-4b53-943e-ff6a0f99f332 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:36.877465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e11759bb-4750-4b53-943e-ff6a0f99f332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:36.908099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e45da4-f976-4d17-9de7-8734b8f792db None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:36.957843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0506d-7611-4509-aa63-cb24a3f6e8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:36.958971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0506d-7611-4509-aa63-cb24a3f6e8e0 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:36.959330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0506d-7611-4509-aa63-cb24a3f6e8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:36.959797 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0506d-7611-4509-aa63-cb24a3f6e8e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:36.960624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0506d-7611-4509-aa63-cb24a3f6e8e0 None admin] RBAC: Adding query filter params (role.id=e5d031634de14f1e86b912ddddfe7f8c, scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba, user.id=151e7b9c7a7b46d58dc2f563d05775e2) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:36.961020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0506d-7611-4509-aa63-cb24a3f6e8e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:36.962961 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0506d-7611-4509-aa63-cb24a3f6e8e0 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:36.971094 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 341/671] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:15:36 2022] GET /identity/v3/role_assignments?user.id=151e7b9c7a7b46d58dc2f563d05775e2&scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba&role.id=e5d031634de14f1e86b912ddddfe7f8c => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:36.972401 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0506d-7611-4509-aa63-cb24a3f6e8e0 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:36.977440 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 331/672] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:36.979924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11759bb-4750-4b53-943e-ff6a0f99f332 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:37.056511 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:37.159765 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:37.166465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0506d-7611-4509-aa63-cb24a3f6e8e0 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:37.222983 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11759bb-4750-4b53-943e-ff6a0f99f332 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:37.223295 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf8063-104e-4fcc-b735-2ce0290f08e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:37.224621 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf8063-104e-4fcc-b735-2ce0290f08e3 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:37.225361 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf8063-104e-4fcc-b735-2ce0290f08e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:37.226095 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf8063-104e-4fcc-b735-2ce0290f08e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:37.246510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf8063-104e-4fcc-b735-2ce0290f08e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:37.250660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf8063-104e-4fcc-b735-2ce0290f08e3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:37.270069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-bddf8063-104e-4fcc-b735-2ce0290f08e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:37.270069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:37.270069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:37.270069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:37.270069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:37.270069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:37.270069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:37.270069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:37.270069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:37.270069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:37.270069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:37.270069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:37.270069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:37.270069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:37.270069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:37.270069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:37.272328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:37.272328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:37.272328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:37.272328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:37.272328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:37.272328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:37.272328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:37.272328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:37.272328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:37.272328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:37.272328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:37.272328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:37.272328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:37.272328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:37.272328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:37.272328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:37.272328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:37.274116 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:37.274116 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:37.274116 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:37.274116 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 342/673] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:37.276796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf8063-104e-4fcc-b735-2ce0290f08e3 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:37.291994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3fed7-2a45-462b-94ef-50ac3aa09ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:37.292967 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3fed7-2a45-462b-94ef-50ac3aa09ccc None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:37.293436 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3fed7-2a45-462b-94ef-50ac3aa09ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:37.293901 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3fed7-2a45-462b-94ef-50ac3aa09ccc None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:37.295058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3fed7-2a45-462b-94ef-50ac3aa09ccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:37.295566 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3fed7-2a45-462b-94ef-50ac3aa09ccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:37.298014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3fed7-2a45-462b-94ef-50ac3aa09ccc None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:37.318241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 332/674] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:37.318657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3fed7-2a45-462b-94ef-50ac3aa09ccc None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:37.472552 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf8063-104e-4fcc-b735-2ce0290f08e3 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:37.493686 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:37.517070 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea23d79-2852-4f90-8e68-0869bab33636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:37.517706 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea23d79-2852-4f90-8e68-0869bab33636 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:37.517985 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea23d79-2852-4f90-8e68-0869bab33636 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:37.518297 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea23d79-2852-4f90-8e68-0869bab33636 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:37.518950 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea23d79-2852-4f90-8e68-0869bab33636 None admin] RBAC: Adding query filter params (name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:37.519251 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea23d79-2852-4f90-8e68-0869bab33636 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:37.520724 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea23d79-2852-4f90-8e68-0869bab33636 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:37.522873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3fed7-2a45-462b-94ef-50ac3aa09ccc None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:37.551230 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 343/675] 10.222.0.62 () {56 vars in 1103 bytes} [Tue Oct 4 14:15:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:37.551230 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea23d79-2852-4f90-8e68-0869bab33636 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:37.576758 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:37.598046 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cef5c-a4cf-453f-acb4-5ef1380cbd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:37.598819 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cef5c-a4cf-453f-acb4-5ef1380cbd3f None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:37.599258 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cef5c-a4cf-453f-acb4-5ef1380cbd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:37.599643 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cef5c-a4cf-453f-acb4-5ef1380cbd3f None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:37.600438 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cef5c-a4cf-453f-acb4-5ef1380cbd3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:37.600836 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cef5c-a4cf-453f-acb4-5ef1380cbd3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:37.602405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cef5c-a4cf-453f-acb4-5ef1380cbd3f None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:37.618763 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 333/676] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:37.625340 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cef5c-a4cf-453f-acb4-5ef1380cbd3f None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:37.735784 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea23d79-2852-4f90-8e68-0869bab33636 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:37.767854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cef5c-a4cf-453f-acb4-5ef1380cbd3f None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:37.787261 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad7320-718f-41ea-bbd0-fc66d2686c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:37.788298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad7320-718f-41ea-bbd0-fc66d2686c41 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:37.788737 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad7320-718f-41ea-bbd0-fc66d2686c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:37.789236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad7320-718f-41ea-bbd0-fc66d2686c41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:37.800601 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad7320-718f-41ea-bbd0-fc66d2686c41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:37.802905 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad7320-718f-41ea-bbd0-fc66d2686c41 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:37.821298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-05ad7320-718f-41ea-bbd0-fc66d2686c41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:37.821298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:37.821298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:37.821298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:37.821298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:37.821298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:37.821298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:37.821298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:37.821298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:37.821298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:37.821298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:37.821298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:37.821298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:15:37.821298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:15:37.821298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:15:37.822940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:15:37.822940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:37.822940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:37.822940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:37.822940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:37.822940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:37.822940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:37.822940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:37.822940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:37.822940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:37.822940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:37.822940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:37.822940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:37.822940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:37.822940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:37.822940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:37.822940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:37.824749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:15:37.824749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:15:37.824749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:15:37.824749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:15:37.824749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:15:37.824749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:15:37.824749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:37.824749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:37.831544 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 344/677] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:15:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:37.831544 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad7320-718f-41ea-bbd0-fc66d2686c41 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:37.846127 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cdf93-c911-42e8-a800-da11fac9a567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:37.847110 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cdf93-c911-42e8-a800-da11fac9a567 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:37.847548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cdf93-c911-42e8-a800-da11fac9a567 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:37.848010 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cdf93-c911-42e8-a800-da11fac9a567 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:37.865741 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179cdf93-c911-42e8-a800-da11fac9a567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:37.868071 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179cdf93-c911-42e8-a800-da11fac9a567 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:37.880507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:37.896209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-179cdf93-c911-42e8-a800-da11fac9a567 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:37.896209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:37.896209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:37.896209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:37.896209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:37.896209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:37.896209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:37.896209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:37.896209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:37.896209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:37.896209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:37.896209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:37.896209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:37.896209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:37.896209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:37.896209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:37.897866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:37.897866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:37.897866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:37.897866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:37.897866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:37.897866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:37.897866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:37.897866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:37.897866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:37.897866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:37.897866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:37.897866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:37.897866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:37.897866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:37.897866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:37.897866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:37.897866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:37.900521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:37.900521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:37.900521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:37.900521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 334/678] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:37.900521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cdf93-c911-42e8-a800-da11fac9a567 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:37.955313 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:38.018328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad7320-718f-41ea-bbd0-fc66d2686c41 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:38.069450 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cdf93-c911-42e8-a800-da11fac9a567 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:38.071835 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8095f-7103-4df1-9e3f-efc640aad68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:38.072568 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8095f-7103-4df1-9e3f-efc640aad68a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:38.072847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8095f-7103-4df1-9e3f-efc640aad68a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:38.073129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8095f-7103-4df1-9e3f-efc640aad68a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:38.086658 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8095f-7103-4df1-9e3f-efc640aad68a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:38.088062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8095f-7103-4df1-9e3f-efc640aad68a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:38.109876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-b6f8095f-7103-4df1-9e3f-efc640aad68a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:38.109876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:38.109876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:38.109876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:38.109876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:38.109876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:38.109876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:38.109876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:38.109876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:38.109876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:38.109876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:38.109876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:38.109876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:38.109876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:38.109876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:38.109876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:38.110918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:38.110918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:38.110918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:38.110918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:38.110918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:38.110918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:38.110918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:38.110918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:38.110918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:38.110918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:38.110918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:38.110918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:38.110918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:38.110918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:38.110918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:38.110918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:38.110918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:38.111850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:38.111850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:38.111850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:38.112458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 345/679] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:38.113857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8095f-7103-4df1-9e3f-efc640aad68a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:38.141816 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb64773-d133-4d6e-8e85-67918c27f29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:38.143063 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb64773-d133-4d6e-8e85-67918c27f29f None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:38.143601 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb64773-d133-4d6e-8e85-67918c27f29f None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:38.144227 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb64773-d133-4d6e-8e85-67918c27f29f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:38.156008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb64773-d133-4d6e-8e85-67918c27f29f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:38.158173 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb64773-d133-4d6e-8e85-67918c27f29f None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:38.179574 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-2fb64773-d133-4d6e-8e85-67918c27f29f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:38.179574 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:38.179574 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:38.179574 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:38.179574 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:38.179574 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:38.179574 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:38.179574 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:38.179574 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:38.179574 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:38.179574 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:38.179574 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:38.179574 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:15:38.179574 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:15:38.179574 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:15:38.181115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:15:38.181115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:38.181115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:38.181115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:38.181115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:38.181115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:38.181115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:38.181115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:38.181115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:38.181115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:38.181115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:38.181115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:38.181115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:38.181115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:38.181115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:38.181115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:38.181115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:38.182207 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:15:38.182207 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:15:38.182207 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:15:38.182207 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:15:38.182207 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:15:38.182207 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:15:38.182207 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:38.182207 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:38.182207 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 335/680] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:15:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:38.182916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb64773-d133-4d6e-8e85-67918c27f29f None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:38.251451 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8095f-7103-4df1-9e3f-efc640aad68a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:38.278758 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:38.280894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:38.303867 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a049d4-7b9b-4227-8154-fc98a1dfb120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:38.305523 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a049d4-7b9b-4227-8154-fc98a1dfb120 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:38.305805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a049d4-7b9b-4227-8154-fc98a1dfb120 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:38.306076 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a049d4-7b9b-4227-8154-fc98a1dfb120 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:38.306781 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a049d4-7b9b-4227-8154-fc98a1dfb120 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:38.307082 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a049d4-7b9b-4227-8154-fc98a1dfb120 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:38.308560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a049d4-7b9b-4227-8154-fc98a1dfb120 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:38.330447 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 346/681] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:15:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:38.330447 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a049d4-7b9b-4227-8154-fc98a1dfb120 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:38.357932 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb64773-d133-4d6e-8e85-67918c27f29f None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:38.411987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f79deb-ceed-4fb3-bd57-b45c3c3acab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:38.413516 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f79deb-ceed-4fb3-bd57-b45c3c3acab3 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:38.413859 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f79deb-ceed-4fb3-bd57-b45c3c3acab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:38.414267 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f79deb-ceed-4fb3-bd57-b45c3c3acab3 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:38.414952 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f79deb-ceed-4fb3-bd57-b45c3c3acab3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:38.415253 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f79deb-ceed-4fb3-bd57-b45c3c3acab3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:38.417292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f79deb-ceed-4fb3-bd57-b45c3c3acab3 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:38.444165 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 336/682] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:38.444165 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f79deb-ceed-4fb3-bd57-b45c3c3acab3 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:38.537624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a049d4-7b9b-4227-8154-fc98a1dfb120 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:38.593810 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8681b-7d9f-4cf4-9001-c50ba2f3750f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:38.594878 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8681b-7d9f-4cf4-9001-c50ba2f3750f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:38.595276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8681b-7d9f-4cf4-9001-c50ba2f3750f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:38.595654 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8681b-7d9f-4cf4-9001-c50ba2f3750f None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:38.596408 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8681b-7d9f-4cf4-9001-c50ba2f3750f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:38.596748 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8681b-7d9f-4cf4-9001-c50ba2f3750f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:38.598385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8681b-7d9f-4cf4-9001-c50ba2f3750f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:38.610636 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f79deb-ceed-4fb3-bd57-b45c3c3acab3 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:38.615470 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 347/683] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:38.616941 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8681b-7d9f-4cf4-9001-c50ba2f3750f None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:38.635799 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:38.661690 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17d583-75e8-4c6d-abad-4e5ced994b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:38.662865 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17d583-75e8-4c6d-abad-4e5ced994b03 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:38.663336 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17d583-75e8-4c6d-abad-4e5ced994b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:38.663817 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17d583-75e8-4c6d-abad-4e5ced994b03 None admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:38.665140 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17d583-75e8-4c6d-abad-4e5ced994b03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:38.665674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17d583-75e8-4c6d-abad-4e5ced994b03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:38.668446 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17d583-75e8-4c6d-abad-4e5ced994b03 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:38.680812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:38.701082 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 337/684] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:15:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:38.701082 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17d583-75e8-4c6d-abad-4e5ced994b03 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:38.810563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8681b-7d9f-4cf4-9001-c50ba2f3750f None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:38.862211 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17d583-75e8-4c6d-abad-4e5ced994b03 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:38.870916 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af8d5d-66f7-40ab-bbd8-fcfa6d2b5d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:38.872288 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af8d5d-66f7-40ab-bbd8-fcfa6d2b5d38 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:38.872922 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af8d5d-66f7-40ab-bbd8-fcfa6d2b5d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:38.873539 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af8d5d-66f7-40ab-bbd8-fcfa6d2b5d38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:38.875478 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af8d5d-66f7-40ab-bbd8-fcfa6d2b5d38 None admin] RBAC: Adding query filter params (role.id=e5d031634de14f1e86b912ddddfe7f8c, scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba, user.id=c5d3bf1c2d944d51a0fd0ff84be1c7e0) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:38.875967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af8d5d-66f7-40ab-bbd8-fcfa6d2b5d38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:38.878552 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af8d5d-66f7-40ab-bbd8-fcfa6d2b5d38 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:38.895759 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 348/685] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:15:38 2022] GET /identity/v3/role_assignments?user.id=c5d3bf1c2d944d51a0fd0ff84be1c7e0&scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba&role.id=e5d031634de14f1e86b912ddddfe7f8c => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:38.895759 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af8d5d-66f7-40ab-bbd8-fcfa6d2b5d38 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:38.937157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa0c45-c906-4868-a57b-427a5cc3f6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:38.938624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa0c45-c906-4868-a57b-427a5cc3f6ed None admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:38.939141 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa0c45-c906-4868-a57b-427a5cc3f6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:38.939652 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa0c45-c906-4868-a57b-427a5cc3f6ed None admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:38.940874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa0c45-c906-4868-a57b-427a5cc3f6ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:38.943624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa0c45-c906-4868-a57b-427a5cc3f6ed None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:38.982425 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 338/686] 10.222.0.62 () {60 vars in 1132 bytes} [Tue Oct 4 14:15:38 2022] POST /identity/v3/users => generated 254 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:15:38.985226 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa0c45-c906-4868-a57b-427a5cc3f6ed None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:39.080623 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:39.134275 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af8d5d-66f7-40ab-bbd8-fcfa6d2b5d38 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:39.134275 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:39.181836 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d50c0-a8f6-411b-9840-f6d573d7f40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:39.184160 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d50c0-a8f6-411b-9840-f6d573d7f40c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:39.184765 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d50c0-a8f6-411b-9840-f6d573d7f40c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:39.185247 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d50c0-a8f6-411b-9840-f6d573d7f40c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:39.202537 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d50c0-a8f6-411b-9840-f6d573d7f40c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:39.204592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d50c0-a8f6-411b-9840-f6d573d7f40c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:39.229883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-a44d50c0-a8f6-411b-9840-f6d573d7f40c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 14:15:39.229883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:39.229883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:39.229883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:39.229883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:39.229883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:39.229883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:39.229883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:39.229883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:39.229883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:39.229883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:39.229883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:39.229883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:15:39.229883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:15:39.229883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:15:39.229883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:15:39.231831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:39.231831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:39.231831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:15:39.231831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:39.231831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:15:39.231831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:39.231831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:39.231831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:39.231831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:39.231831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:39.231831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:39.231831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:39.231831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:39.231831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:39.231831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:39.231831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:39.231831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:39.231831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:39.234258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:39.234258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:39.234258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:15:39.234258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:15:39.234258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:15:39.234258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:15:39.234258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:15:39.234258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:15:39.234258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 14:15:39.234258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:39.234258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 349/687] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:15:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:39.238917 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d50c0-a8f6-411b-9840-f6d573d7f40c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:39.276722 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa0c45-c906-4868-a57b-427a5cc3f6ed None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:39.361361 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83479d0a-c352-465e-849b-cc112fbf4579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:39.364611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83479d0a-c352-465e-849b-cc112fbf4579 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:39.365463 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83479d0a-c352-465e-849b-cc112fbf4579 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:39.366267 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83479d0a-c352-465e-849b-cc112fbf4579 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:39.369140 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83479d0a-c352-465e-849b-cc112fbf4579 None admin] RBAC: Adding query filter params (role.id=e5d031634de14f1e86b912ddddfe7f8c, scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba, user.id=624487005e4f4180a9d56a29a7daad1e) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:39.370400 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83479d0a-c352-465e-849b-cc112fbf4579 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:39.375272 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83479d0a-c352-465e-849b-cc112fbf4579 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:39.392491 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 339/688] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:15:38 2022] GET /identity/v3/role_assignments?user.id=624487005e4f4180a9d56a29a7daad1e&scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba&role.id=e5d031634de14f1e86b912ddddfe7f8c => generated 608 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:39.409751 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d50c0-a8f6-411b-9840-f6d573d7f40c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:39.491761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33253ab0-cb20-4478-8293-11bf235743ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:39.491761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33253ab0-cb20-4478-8293-11bf235743ed None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:39.491761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33253ab0-cb20-4478-8293-11bf235743ed None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:39.491761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33253ab0-cb20-4478-8293-11bf235743ed None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:39.492455 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33253ab0-cb20-4478-8293-11bf235743ed None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:39.492455 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33253ab0-cb20-4478-8293-11bf235743ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:39.492455 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33253ab0-cb20-4478-8293-11bf235743ed None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:39.527077 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 350/689] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Oct 4 14:15:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:15:39.537915 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83479d0a-c352-465e-849b-cc112fbf4579 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:39.756611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:39.766224 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83479d0a-c352-465e-849b-cc112fbf4579 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:39.830608 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc324d8f-72d3-4791-8b00-e8e2e762700c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:39.831648 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc324d8f-72d3-4791-8b00-e8e2e762700c None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:39.832113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc324d8f-72d3-4791-8b00-e8e2e762700c None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:39.832537 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc324d8f-72d3-4791-8b00-e8e2e762700c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:39.921681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc324d8f-72d3-4791-8b00-e8e2e762700c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:39.923440 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc324d8f-72d3-4791-8b00-e8e2e762700c None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:40.055636 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:40.062364 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 340/690] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:15:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:15:40.068870 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33253ab0-cb20-4478-8293-11bf235743ed None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:40.081919 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f96ea1-39bb-472c-8af3-5014d91280c5 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:40.082193 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f96ea1-39bb-472c-8af3-5014d91280c5 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:40.082477 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f96ea1-39bb-472c-8af3-5014d91280c5 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:40.084161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 341/691] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:15:40.089943 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff443ef-f4c4-43c7-8076-28bf4b689c8d None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:40.090320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff443ef-f4c4-43c7-8076-28bf4b689c8d None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:40.090501 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff443ef-f4c4-43c7-8076-28bf4b689c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:40.130727 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-0ff443ef-f4c4-43c7-8076-28bf4b689c8d None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:40.132525 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-0ff443ef-f4c4-43c7-8076-28bf4b689c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:40.144810 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:40.273123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 342/692] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:40.319982 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33253ab0-cb20-4478-8293-11bf235743ed None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:40.369711 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595e85f-9316-4c06-8b32-cf3546fd3d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:40.370464 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595e85f-9316-4c06-8b32-cf3546fd3d4a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:40.370754 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595e85f-9316-4c06-8b32-cf3546fd3d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:40.371027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595e85f-9316-4c06-8b32-cf3546fd3d4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:40.386164 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595e85f-9316-4c06-8b32-cf3546fd3d4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:40.387660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595e85f-9316-4c06-8b32-cf3546fd3d4a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:40.415168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-c595e85f-9316-4c06-8b32-cf3546fd3d4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:40.415168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:40.415168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:40.415168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:40.415168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:40.415168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:40.415168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:40.415168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:40.415168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:40.415168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:40.415168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:40.415168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:40.415168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:40.415168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:40.415168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:40.415168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:40.416205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:40.416205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:40.416205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:40.416205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:40.416205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:40.416205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:40.416205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:40.416205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:40.416205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:40.416205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:40.416205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:40.416205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:40.416205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:40.416205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:40.416205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:40.416205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:40.416205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:40.417185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:40.417185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:40.417185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:40.417185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 351/693] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:40.423978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff443ef-f4c4-43c7-8076-28bf4b689c8d None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:40.616719 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff443ef-f4c4-43c7-8076-28bf4b689c8d None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:40.684881 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:40.709651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e1042-3554-4888-af10-4c8f3d328ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:40.709651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e1042-3554-4888-af10-4c8f3d328ddd None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:40.709651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e1042-3554-4888-af10-4c8f3d328ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:40.709651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e1042-3554-4888-af10-4c8f3d328ddd None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:40.710088 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e1042-3554-4888-af10-4c8f3d328ddd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:40.710088 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e1042-3554-4888-af10-4c8f3d328ddd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:40.710088 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e1042-3554-4888-af10-4c8f3d328ddd None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:40.746394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 343/694] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:40.753288 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595e85f-9316-4c06-8b32-cf3546fd3d4a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:40.803987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e1042-3554-4888-af10-4c8f3d328ddd None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:41.020006 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e1042-3554-4888-af10-4c8f3d328ddd None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:41.087367 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fb0ac-f5a6-43e3-821d-8b6805e6df11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:41.088522 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fb0ac-f5a6-43e3-821d-8b6805e6df11 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:41.089459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fb0ac-f5a6-43e3-821d-8b6805e6df11 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:41.089949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fb0ac-f5a6-43e3-821d-8b6805e6df11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:41.093975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:41.158469 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09fb0ac-f5a6-43e3-821d-8b6805e6df11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:15:41.178981 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-e09fb0ac-f5a6-43e3-821d-8b6805e6df11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:15:41.178981 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:41.178981 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:41.178981 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:41.178981 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:41.178981 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:41.178981 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:41.178981 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:41.178981 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:41.178981 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:41.178981 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:41.178981 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:41.178981 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:15:41.178981 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:15:41.178981 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:15:41.178981 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:15:41.180968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:15:41.180968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:15:41.180968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:15:41.180968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:15:41.180968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:41.180968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:41.180968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:41.180968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:41.180968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:41.180968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:41.180968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:41.180968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:41.180968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:41.180968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:41.180968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:41.180968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:41.182594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:41.182594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:41.182594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:41.182594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:41.182594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:15:41.182594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:15:41.182594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:15:41.182594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:15:41.182594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:15:41.182594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:15:41.182594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:15:41.182594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:41.187744 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 344/695] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:15:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:15:41.202409 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fb0ac-f5a6-43e3-821d-8b6805e6df11 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:41.206285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595e85f-9316-4c06-8b32-cf3546fd3d4a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:41.371959 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6442a-72fe-4e1a-92e9-2271f5c63217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:41.371959 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6442a-72fe-4e1a-92e9-2271f5c63217 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:41.371959 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6442a-72fe-4e1a-92e9-2271f5c63217 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:41.371959 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6442a-72fe-4e1a-92e9-2271f5c63217 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:41.409410 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6442a-72fe-4e1a-92e9-2271f5c63217 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:41.412852 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6442a-72fe-4e1a-92e9-2271f5c63217 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:41.422942 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:41.449942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-36e6442a-72fe-4e1a-92e9-2271f5c63217 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:41.449942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:41.449942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:41.449942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:41.449942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:41.449942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:41.449942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:41.449942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:41.449942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:41.449942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:41.449942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:41.449942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:41.449942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:15:41.449942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:15:41.449942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:15:41.450946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:15:41.450946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:41.450946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:41.450946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:41.450946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:41.450946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:41.450946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:41.450946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:41.450946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:41.450946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:41.450946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:41.450946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:41.450946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:41.450946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:41.450946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:41.450946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:41.450946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:41.452421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:15:41.452421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:15:41.452421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:15:41.452421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:15:41.452421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:15:41.452421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:15:41.452421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:41.452421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:41.465797 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 352/696] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:15:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 713 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:41.476529 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6442a-72fe-4e1a-92e9-2271f5c63217 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:41.656220 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fb0ac-f5a6-43e3-821d-8b6805e6df11 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:41.699268 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6442a-72fe-4e1a-92e9-2271f5c63217 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:41.744926 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a114a24-0480-4181-8edf-cd8931831886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:41.746033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a114a24-0480-4181-8edf-cd8931831886 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:41.746470 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a114a24-0480-4181-8edf-cd8931831886 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:41.746909 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a114a24-0480-4181-8edf-cd8931831886 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:41.748060 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a114a24-0480-4181-8edf-cd8931831886 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:41.748545 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a114a24-0480-4181-8edf-cd8931831886 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:41.752251 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a114a24-0480-4181-8edf-cd8931831886 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:41.770414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:41.770913 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 345/697] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:15:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 570 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:41.779628 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a114a24-0480-4181-8edf-cd8931831886 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:41.780021 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf6205-2b04-4a30-85c9-ec2397f8f72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:41.780981 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf6205-2b04-4a30-85c9-ec2397f8f72e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:41.781348 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf6205-2b04-4a30-85c9-ec2397f8f72e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:41.781628 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf6205-2b04-4a30-85c9-ec2397f8f72e None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:41.782363 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf6205-2b04-4a30-85c9-ec2397f8f72e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:41.782672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf6205-2b04-4a30-85c9-ec2397f8f72e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:41.784204 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf6205-2b04-4a30-85c9-ec2397f8f72e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:41.834508 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 353/698] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:15:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:41.849146 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf6205-2b04-4a30-85c9-ec2397f8f72e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:42.000172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a114a24-0480-4181-8edf-cd8931831886 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:42.020689 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:42.067758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41941ff7-6c59-4153-ab66-c7aa11111ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:42.069064 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41941ff7-6c59-4153-ab66-c7aa11111ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:42.069736 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41941ff7-6c59-4153-ab66-c7aa11111ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:42.070607 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41941ff7-6c59-4153-ab66-c7aa11111ff1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:42.095962 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41941ff7-6c59-4153-ab66-c7aa11111ff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:42.098737 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41941ff7-6c59-4153-ab66-c7aa11111ff1 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:42.123750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-41941ff7-6c59-4153-ab66-c7aa11111ff1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:42.123750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:42.123750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:42.123750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:42.123750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:42.123750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:42.123750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:42.123750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:42.123750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:42.123750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:42.123750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:42.123750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:42.123750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:42.123750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:42.123750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:42.123750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:42.125824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:42.125824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:42.125824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:42.125824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:42.125824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:42.125824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:42.125824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:42.125824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:42.125824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:42.125824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:42.125824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:42.125824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:42.125824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:42.125824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:42.125824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:42.125824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:42.125824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:42.126777 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:42.126777 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:42.126777 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:42.128987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 346/699] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:15:42.136098 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf6205-2b04-4a30-85c9-ec2397f8f72e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:42.138033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41941ff7-6c59-4153-ab66-c7aa11111ff1 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:42.222104 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f7547-5758-4ff7-b788-1e925d95801e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:42.223813 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f7547-5758-4ff7-b788-1e925d95801e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:42.224302 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f7547-5758-4ff7-b788-1e925d95801e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:42.225249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f7547-5758-4ff7-b788-1e925d95801e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:42.226536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f7547-5758-4ff7-b788-1e925d95801e None admin] RBAC: Adding query filter params (role.id=e5d031634de14f1e86b912ddddfe7f8c, scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba, user.id=4860d5958e724e568576a9067290a27e) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:42.227047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f7547-5758-4ff7-b788-1e925d95801e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:42.229133 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f7547-5758-4ff7-b788-1e925d95801e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:42.239285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 354/700] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:15:41 2022] GET /identity/v3/role_assignments?user.id=4860d5958e724e568576a9067290a27e&scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba&role.id=e5d031634de14f1e86b912ddddfe7f8c => generated 608 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:42.250737 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe81bf-8001-4844-8f64-8fff5caa72b9 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:42.251594 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe81bf-8001-4844-8f64-8fff5caa72b9 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:42.252080 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe81bf-8001-4844-8f64-8fff5caa72b9 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:42.254305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 355/701] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:42 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:42.260224 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b986b-f13d-4c5d-8738-f2f052e68486 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:42.260790 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b986b-f13d-4c5d-8738-f2f052e68486 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:42.261244 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b986b-f13d-4c5d-8738-f2f052e68486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:42.298248 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ee2b986b-f13d-4c5d-8738-f2f052e68486 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:42.302627 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ee2b986b-f13d-4c5d-8738-f2f052e68486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:42.346241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41941ff7-6c59-4153-ab66-c7aa11111ff1 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:42.428132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:42.428354 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a8c5a-2bb4-4cb5-8232-23f381680d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:42.429123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a8c5a-2bb4-4cb5-8232-23f381680d05 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:42.429282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a8c5a-2bb4-4cb5-8232-23f381680d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:42.429516 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a8c5a-2bb4-4cb5-8232-23f381680d05 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:42.430251 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a8c5a-2bb4-4cb5-8232-23f381680d05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:42.430487 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a8c5a-2bb4-4cb5-8232-23f381680d05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:42.434134 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a8c5a-2bb4-4cb5-8232-23f381680d05 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:42.461774 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 356/702] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:42.463437 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 347/703] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:15:42.472784 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b986b-f13d-4c5d-8738-f2f052e68486 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:42.627809 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b986b-f13d-4c5d-8738-f2f052e68486 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:42.672708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b432a8-73e2-43f4-9eed-8f27c9e3f8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:42.673841 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b432a8-73e2-43f4-9eed-8f27c9e3f8ee None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:42.674327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b432a8-73e2-43f4-9eed-8f27c9e3f8ee None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:42.674830 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b432a8-73e2-43f4-9eed-8f27c9e3f8ee None admin] PATH_INFO: `/v3/users/nova` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:42.684367 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b432a8-73e2-43f4-9eed-8f27c9e3f8ee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:42.686496 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b432a8-73e2-43f4-9eed-8f27c9e3f8ee None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:42.701551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-e8b432a8-73e2-43f4-9eed-8f27c9e3f8ee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 14:15:42.701551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:42.701551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:42.701551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:42.701551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:42.701551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:42.701551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:42.701551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:42.701551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:42.701551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:42.701551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:42.701551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:42.701551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:15:42.701551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:15:42.701551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:15:42.701551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:15:42.702642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:42.702642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:42.702642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:15:42.702642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:42.702642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:15:42.702642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:42.702642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:42.702642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:42.702642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:42.702642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:42.702642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:42.702642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:42.702642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:42.702642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:42.702642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:42.702642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:42.702642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:42.702642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:42.703661 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:42.703661 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:42.703661 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:15:42.703661 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:15:42.703661 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:15:42.703661 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:15:42.703661 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:15:42.703661 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:15:42.703661 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 14:15:42.703661 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:42.706758 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 357/704] 10.222.0.62 () {56 vars in 1093 bytes} [Tue Oct 4 14:15:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:42.715685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a8c5a-2bb4-4cb5-8232-23f381680d05 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:42.760799 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:42.781008 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b432a8-73e2-43f4-9eed-8f27c9e3f8ee None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:42.852650 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:42.881005 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a8c5a-2bb4-4cb5-8232-23f381680d05 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:42.921165 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cbdfc5-7680-46ea-b1a4-f0bd2373bb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:42.922296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbdfc5-7680-46ea-b1a4-f0bd2373bb83 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:42.922791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbdfc5-7680-46ea-b1a4-f0bd2373bb83 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:42.923281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbdfc5-7680-46ea-b1a4-f0bd2373bb83 None admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:42.924309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cbdfc5-7680-46ea-b1a4-f0bd2373bb83 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:42.924837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cbdfc5-7680-46ea-b1a4-f0bd2373bb83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:42.926505 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cbdfc5-7680-46ea-b1a4-f0bd2373bb83 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:42.930204 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b432a8-73e2-43f4-9eed-8f27c9e3f8ee None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:42.947949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 348/705] 10.222.0.62 () {56 vars in 1133 bytes} [Tue Oct 4 14:15:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:42.949624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b5b60-c8f9-4980-ba2b-87de9947bd97 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:42.950133 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b5b60-c8f9-4980-ba2b-87de9947bd97 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:42.950620 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b5b60-c8f9-4980-ba2b-87de9947bd97 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:42.952639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 349/706] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:42.956948 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b5b60-c8f9-4980-ba2b-87de9947bd97 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:42.973181 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a06bc-b1c3-45e1-b2d8-f0d4014ff490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:42.973853 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a06bc-b1c3-45e1-b2d8-f0d4014ff490 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:42.974132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a06bc-b1c3-45e1-b2d8-f0d4014ff490 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:42.974404 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a06bc-b1c3-45e1-b2d8-f0d4014ff490 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:42.975016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a06bc-b1c3-45e1-b2d8-f0d4014ff490 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:42.976474 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a06bc-b1c3-45e1-b2d8-f0d4014ff490 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:42.990046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-649a06bc-b1c3-45e1-b2d8-f0d4014ff490 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 14:15:42.990046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:42.990046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:15:42.990046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:15:42.990046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:15:42.990046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:15:42.990046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:15:42.990046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:15:42.990046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 14:15:42.990046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:42.990046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:15:42.990046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:42.990046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:42.990046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:42.990046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:42.990046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:42.990046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:42.991151 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:42.991151 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:42.991151 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:42.991151 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:42.991151 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:42.991151 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:42.991151 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:15:42.991151 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:15:42.991151 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:15:42.991151 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:15:42.991151 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:42.991151 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:42.991151 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:42.991151 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:42.991151 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:42.991151 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:42.992040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:42.992040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:42.992040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:42.992040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:42.992040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:42.992040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:42.992040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:42.992040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:42.992040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:42.992040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:42.992040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:15:42.992040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:15:42.992040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 14:15:42.992040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:42.992040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 358/707] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Oct 4 14:15:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:15:42.992819 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481099d-44c5-46e7-8b4f-93b16dfd64fc None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:42.998516 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481099d-44c5-46e7-8b4f-93b16dfd64fc None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:42.998516 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481099d-44c5-46e7-8b4f-93b16dfd64fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:43.016549 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-4481099d-44c5-46e7-8b4f-93b16dfd64fc None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:43.017790 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4481099d-44c5-46e7-8b4f-93b16dfd64fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:43.072251 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:43.107839 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 359/708] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:43.107839 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481099d-44c5-46e7-8b4f-93b16dfd64fc None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:43.116517 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b5b60-c8f9-4980-ba2b-87de9947bd97 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:43.196673 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a131da3-9215-4f1d-be62-25770c86617b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:43.196902 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:43.198133 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a131da3-9215-4f1d-be62-25770c86617b None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:43.198564 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a131da3-9215-4f1d-be62-25770c86617b None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:43.198979 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a131da3-9215-4f1d-be62-25770c86617b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:43.287630 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a131da3-9215-4f1d-be62-25770c86617b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:43.289698 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a131da3-9215-4f1d-be62-25770c86617b None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:43.389950 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481099d-44c5-46e7-8b4f-93b16dfd64fc None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:43.428408 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:43.480532 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 350/709] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:15:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 14:15:43.481823 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a131da3-9215-4f1d-be62-25770c86617b None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:43.510716 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31b78e-8dea-48fa-881d-de906908074a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:43.512266 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31b78e-8dea-48fa-881d-de906908074a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:43.512755 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31b78e-8dea-48fa-881d-de906908074a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:43.513840 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31b78e-8dea-48fa-881d-de906908074a None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:43.516356 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31b78e-8dea-48fa-881d-de906908074a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:43.517173 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31b78e-8dea-48fa-881d-de906908074a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:43.521490 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31b78e-8dea-48fa-881d-de906908074a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:43.533095 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 360/710] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Oct 4 14:15:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:43.533974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31b78e-8dea-48fa-881d-de906908074a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:43.620637 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a131da3-9215-4f1d-be62-25770c86617b None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:43.664927 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba167c-dea5-45dd-9c16-e0d0d09cf88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:43.665614 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba167c-dea5-45dd-9c16-e0d0d09cf88d None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:43.665896 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba167c-dea5-45dd-9c16-e0d0d09cf88d None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:43.666196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba167c-dea5-45dd-9c16-e0d0d09cf88d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:43.679426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba167c-dea5-45dd-9c16-e0d0d09cf88d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:15:43.684325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-e9ba167c-dea5-45dd-9c16-e0d0d09cf88d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:43.684325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:43.684325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:43.684325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:43.684325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:43.684325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:43.684325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:43.684325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:43.684325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:43.684325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:43.684325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:43.684325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:43.684325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:15:43.684325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:15:43.684325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:15:43.684325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:15:43.686247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:15:43.686247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:15:43.686247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:15:43.686247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:15:43.686247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:43.686247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:43.686247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:43.686247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:43.686247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:43.686247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:43.686247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:43.686247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:43.686247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:43.686247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:43.686247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:43.686247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:43.690534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:43.690534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:43.690534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:43.690534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:43.690534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:15:43.690534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:15:43.690534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:15:43.690534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:15:43.690534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:15:43.690534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:15:43.690534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:43.690534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:43.702372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 351/711] 10.222.0.62 () {56 vars in 1102 bytes} [Tue Oct 4 14:15:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:43.702372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba167c-dea5-45dd-9c16-e0d0d09cf88d None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:43.714284 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31b78e-8dea-48fa-881d-de906908074a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:43.718073 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:43.745118 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:43.770483 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7380c-f574-47ea-ab3e-c8c18cd20b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:43.771140 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7380c-f574-47ea-ab3e-c8c18cd20b05 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:43.771422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7380c-f574-47ea-ab3e-c8c18cd20b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:43.771694 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7380c-f574-47ea-ab3e-c8c18cd20b05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:43.790683 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7380c-f574-47ea-ab3e-c8c18cd20b05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:43.792213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7380c-f574-47ea-ab3e-c8c18cd20b05 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:43.815121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-21c7380c-f574-47ea-ab3e-c8c18cd20b05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:43.815121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:43.815121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:43.815121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:43.815121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:43.815121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:43.815121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:43.815121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:43.815121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:43.815121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:43.815121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:43.815121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:43.815121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:43.815121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:43.815121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:43.815121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:43.816184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:43.816184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:43.816184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:43.816184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:43.816184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:43.816184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:43.816184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:43.816184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:43.816184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:43.816184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:43.816184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:43.816184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:43.816184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:43.816184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:43.816184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:43.816184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:43.816184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:43.817148 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:43.817148 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:43.817148 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:43.817148 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 361/712] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:43.817820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7380c-f574-47ea-ab3e-c8c18cd20b05 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:43.823267 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba167c-dea5-45dd-9c16-e0d0d09cf88d None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:43.868937 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a8a6c-083b-4ce1-b8df-25ad158c9ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:43.869977 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a8a6c-083b-4ce1-b8df-25ad158c9ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:43.870471 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a8a6c-083b-4ce1-b8df-25ad158c9ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:43.870945 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a8a6c-083b-4ce1-b8df-25ad158c9ec8 None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:43.872289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a8a6c-083b-4ce1-b8df-25ad158c9ec8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:43.872994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a8a6c-083b-4ce1-b8df-25ad158c9ec8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:43.876317 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a8a6c-083b-4ce1-b8df-25ad158c9ec8 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:43.893483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 352/713] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Oct 4 14:15:43 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:43.893483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a8a6c-083b-4ce1-b8df-25ad158c9ec8 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:43.976453 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7380c-f574-47ea-ab3e-c8c18cd20b05 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:44.035642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc7638-6b99-4fde-8bf6-fdde9c26992b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:44.036990 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc7638-6b99-4fde-8bf6-fdde9c26992b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:44.037531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc7638-6b99-4fde-8bf6-fdde9c26992b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:44.038023 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc7638-6b99-4fde-8bf6-fdde9c26992b None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:44.039145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc7638-6b99-4fde-8bf6-fdde9c26992b None admin] RBAC: Adding query filter params (name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:44.039835 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc7638-6b99-4fde-8bf6-fdde9c26992b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:44.041897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc7638-6b99-4fde-8bf6-fdde9c26992b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:44.055066 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 362/714] 10.222.0.62 () {56 vars in 1103 bytes} [Tue Oct 4 14:15:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:44.056934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aee04c-eec9-4488-861b-4e175c435cfc None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:44.057709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aee04c-eec9-4488-861b-4e175c435cfc None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:44.058234 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aee04c-eec9-4488-861b-4e175c435cfc None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:44.060573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 363/715] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:44.061970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aee04c-eec9-4488-861b-4e175c435cfc None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:44.104256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:44.106240 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a8a6c-083b-4ce1-b8df-25ad158c9ec8 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:44.113262 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:44.178166 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e98b0c-a4f1-4ce7-87bd-63bea698ddff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:44.179219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e98b0c-a4f1-4ce7-87bd-63bea698ddff None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:44.179701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e98b0c-a4f1-4ce7-87bd-63bea698ddff None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:44.180392 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e98b0c-a4f1-4ce7-87bd-63bea698ddff None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:44.181754 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e98b0c-a4f1-4ce7-87bd-63bea698ddff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:44.182292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e98b0c-a4f1-4ce7-87bd-63bea698ddff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:44.185002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e98b0c-a4f1-4ce7-87bd-63bea698ddff None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:44.215932 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 353/716] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:44.219354 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562c12e-7877-40bc-bec8-260e8ee405e3 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:44.221172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562c12e-7877-40bc-bec8-260e8ee405e3 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:44.221172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562c12e-7877-40bc-bec8-260e8ee405e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:44.224142 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aee04c-eec9-4488-861b-4e175c435cfc None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:44.253485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-a562c12e-7877-40bc-bec8-260e8ee405e3 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:44.255286 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a562c12e-7877-40bc-bec8-260e8ee405e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:44.287431 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8f320-1505-4792-85dd-2d5c2cfa50a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:44.289018 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8f320-1505-4792-85dd-2d5c2cfa50a4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:44.289737 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8f320-1505-4792-85dd-2d5c2cfa50a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:44.290469 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8f320-1505-4792-85dd-2d5c2cfa50a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:44.309168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8f320-1505-4792-85dd-2d5c2cfa50a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:44.310934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8f320-1505-4792-85dd-2d5c2cfa50a4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:44.332436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-f4a8f320-1505-4792-85dd-2d5c2cfa50a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:44.332436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:44.332436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:44.332436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:44.332436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:44.332436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:44.332436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:44.332436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:44.332436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:44.332436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:44.332436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:44.332436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:44.332436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:44.332436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:44.332436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:44.332436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:44.334229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:44.334229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:44.334229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:44.334229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:44.334229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:44.334229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:44.334229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:44.334229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:44.334229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:44.334229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:44.334229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:44.334229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:44.334229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:44.334229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:44.334229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:44.334229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:44.334229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:44.337603 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:44.337603 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:44.337603 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:44.343751 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 364/717] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:44.343751 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8f320-1505-4792-85dd-2d5c2cfa50a4 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:44.395906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 354/718] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:44.397749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562c12e-7877-40bc-bec8-260e8ee405e3 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:44.437387 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:44.479675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8f320-1505-4792-85dd-2d5c2cfa50a4 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:44.525991 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e834ce-683c-4492-ba32-e82d3f18a848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:44.526895 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e834ce-683c-4492-ba32-e82d3f18a848 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:44.527317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e834ce-683c-4492-ba32-e82d3f18a848 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:44.527754 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e834ce-683c-4492-ba32-e82d3f18a848 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:44.540801 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e834ce-683c-4492-ba32-e82d3f18a848 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:44.542596 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e834ce-683c-4492-ba32-e82d3f18a848 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:44.556692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-39e834ce-683c-4492-ba32-e82d3f18a848 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:44.556692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:44.556692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:44.556692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:44.556692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:44.556692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:44.556692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:44.556692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:44.556692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:44.556692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:44.556692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:44.556692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:44.556692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:15:44.556692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:15:44.556692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:15:44.557649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:15:44.557649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:44.557649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:44.557649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:44.557649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:44.557649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:44.557649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:44.557649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:44.557649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:44.557649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:44.557649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:44.557649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:44.557649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:44.557649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:44.557649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:44.557649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:44.557649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:44.558516 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:15:44.558516 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:15:44.558516 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:15:44.558516 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:15:44.558516 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:15:44.558516 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:15:44.558516 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:44.558516 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:44.564194 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 365/719] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:15:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:44.573764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e834ce-683c-4492-ba32-e82d3f18a848 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:44.757911 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:44.773934 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562c12e-7877-40bc-bec8-260e8ee405e3 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:44.838504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e834ce-683c-4492-ba32-e82d3f18a848 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:44.852076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e43f45-c8e2-4600-8765-7c7db4d36445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:44.853399 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e43f45-c8e2-4600-8765-7c7db4d36445 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:44.854068 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e43f45-c8e2-4600-8765-7c7db4d36445 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:44.854694 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e43f45-c8e2-4600-8765-7c7db4d36445 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:44.856130 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e43f45-c8e2-4600-8765-7c7db4d36445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:44.856858 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e43f45-c8e2-4600-8765-7c7db4d36445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:44.859961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e43f45-c8e2-4600-8765-7c7db4d36445 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:44.884766 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 355/720] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 488 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:44.886967 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e43f45-c8e2-4600-8765-7c7db4d36445 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:44.897830 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:44.906774 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5be62-a03c-46a2-af5d-25b7b1c5d730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:44.907777 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5be62-a03c-46a2-af5d-25b7b1c5d730 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:44.908250 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5be62-a03c-46a2-af5d-25b7b1c5d730 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:44.908799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5be62-a03c-46a2-af5d-25b7b1c5d730 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:44.910019 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5be62-a03c-46a2-af5d-25b7b1c5d730 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:44.910525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5be62-a03c-46a2-af5d-25b7b1c5d730 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:44.913845 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5be62-a03c-46a2-af5d-25b7b1c5d730 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:44.944921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 366/721] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:15:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:44.944921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5be62-a03c-46a2-af5d-25b7b1c5d730 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:45.117535 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e43f45-c8e2-4600-8765-7c7db4d36445 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:45.147029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5be62-a03c-46a2-af5d-25b7b1c5d730 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:45.195064 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27a1ec-003e-4c92-a489-4ab6b921920f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:45.195989 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27a1ec-003e-4c92-a489-4ab6b921920f None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:45.196370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27a1ec-003e-4c92-a489-4ab6b921920f None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:45.196745 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27a1ec-003e-4c92-a489-4ab6b921920f None admin] PATH_INFO: `/v3/services/network` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:45.197563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27a1ec-003e-4c92-a489-4ab6b921920f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:45.199265 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27a1ec-003e-4c92-a489-4ab6b921920f None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:45.213520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-fa27a1ec-003e-4c92-a489-4ab6b921920f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 14:15:45.213520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:45.213520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:15:45.213520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:15:45.213520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:15:45.213520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:15:45.213520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:15:45.213520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:15:45.213520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 14:15:45.213520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:45.213520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:15:45.213520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:45.213520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:45.213520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:45.213520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:45.213520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:45.213520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:45.229241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:45.229241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:45.229241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:45.229241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:45.229241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:45.229241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:45.229241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:15:45.229241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:15:45.229241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:15:45.229241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:15:45.229241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:45.229241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:45.229241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:45.229241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:45.229241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:45.229241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:45.240156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:45.240156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:45.240156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:45.240156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:45.240156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:45.240156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:45.240156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:45.240156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:45.240156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:45.240156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:45.240156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:15:45.240156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:15:45.240156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 14:15:45.240156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:45.240156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 356/722] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:15:44 2022] GET /identity/v3/services/network => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:45.242141 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27a1ec-003e-4c92-a489-4ab6b921920f None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:45.242301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb68e9-dd7a-48dc-a9b4-560802597c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:45.242301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb68e9-dd7a-48dc-a9b4-560802597c37 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:45.242301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb68e9-dd7a-48dc-a9b4-560802597c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:45.242301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb68e9-dd7a-48dc-a9b4-560802597c37 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:45.243245 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb68e9-dd7a-48dc-a9b4-560802597c37 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:45.247751 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb68e9-dd7a-48dc-a9b4-560802597c37 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:45.248089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:45.260827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-1ffb68e9-dd7a-48dc-a9b4-560802597c37 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 14:15:45.260827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:45.260827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:45.260827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:45.260827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:45.260827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:45.260827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:45.260827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:45.260827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:45.260827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:45.260827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:45.260827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:45.260827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:15:45.260827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:15:45.260827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:15:45.260827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:15:45.263429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:45.263429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:45.263429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:15:45.263429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:45.263429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:15:45.263429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:45.263429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:45.263429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:45.263429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:45.263429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:45.263429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:45.263429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:45.263429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:45.263429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:45.263429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:45.263429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:45.263429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:45.263429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:45.276187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:45.276187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:45.276187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:15:45.276187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:15:45.276187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:15:45.276187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:15:45.276187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:15:45.276187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:15:45.276187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 14:15:45.276187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:45.276187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 367/723] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Oct 4 14:15:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:45.276187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb68e9-dd7a-48dc-a9b4-560802597c37 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:45.331453 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:45.389531 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27a1ec-003e-4c92-a489-4ab6b921920f None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:45.397389 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb68e9-dd7a-48dc-a9b4-560802597c37 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:45.436724 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387446e1-1ba5-495a-9f8a-86849772066e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:45.437404 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387446e1-1ba5-495a-9f8a-86849772066e None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:45.437723 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387446e1-1ba5-495a-9f8a-86849772066e None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:45.438249 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387446e1-1ba5-495a-9f8a-86849772066e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:45.438987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387446e1-1ba5-495a-9f8a-86849772066e None admin] RBAC: Adding query filter params (role.id=a16b6daeda5b4a67992f3c12514ca90e, scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba, user.id=151e7b9c7a7b46d58dc2f563d05775e2) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:45.439299 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387446e1-1ba5-495a-9f8a-86849772066e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:45.440849 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387446e1-1ba5-495a-9f8a-86849772066e None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:45.447377 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 357/724] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:15:45 2022] GET /identity/v3/role_assignments?user.id=151e7b9c7a7b46d58dc2f563d05775e2&scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba&role.id=a16b6daeda5b4a67992f3c12514ca90e => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:45.448362 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387446e1-1ba5-495a-9f8a-86849772066e None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:45.459113 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376551bb-1362-40a2-80ac-75d28a6949f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:45.460547 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376551bb-1362-40a2-80ac-75d28a6949f5 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:45.460914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376551bb-1362-40a2-80ac-75d28a6949f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:45.461161 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376551bb-1362-40a2-80ac-75d28a6949f5 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:45.461783 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376551bb-1362-40a2-80ac-75d28a6949f5 None admin] RBAC: Adding query filter params (name=network) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:45.462086 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376551bb-1362-40a2-80ac-75d28a6949f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:45.468665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376551bb-1362-40a2-80ac-75d28a6949f5 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:45.482717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 368/725] 10.222.0.62 () {56 vars in 1112 bytes} [Tue Oct 4 14:15:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:45.485808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb470e5-85b6-4a4f-9c38-c61ee473f043 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:45.486884 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb470e5-85b6-4a4f-9c38-c61ee473f043 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:45.487684 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb470e5-85b6-4a4f-9c38-c61ee473f043 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:45.492360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 369/726] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:45.492992 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb470e5-85b6-4a4f-9c38-c61ee473f043 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:45.658086 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:45.668332 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb470e5-85b6-4a4f-9c38-c61ee473f043 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:45.692158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:45.698011 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387446e1-1ba5-495a-9f8a-86849772066e None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:45.734423 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f70709-d5d5-43b4-b785-d2d4025340df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:45.736096 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f70709-d5d5-43b4-b785-d2d4025340df None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:45.736096 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f70709-d5d5-43b4-b785-d2d4025340df None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:45.736734 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f70709-d5d5-43b4-b785-d2d4025340df None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:45.737943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f70709-d5d5-43b4-b785-d2d4025340df None admin] RBAC: Adding query filter params (type=network) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:45.738645 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f70709-d5d5-43b4-b785-d2d4025340df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:45.741166 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f70709-d5d5-43b4-b785-d2d4025340df None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:45.752815 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 370/727] 10.222.0.62 () {56 vars in 1112 bytes} [Tue Oct 4 14:15:45 2022] GET /identity/v3/services?type=network => generated 124 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:45.755307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90831a-bdf6-4aa1-a8a3-cfd590aa0729 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:45.756031 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90831a-bdf6-4aa1-a8a3-cfd590aa0729 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:45.756600 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90831a-bdf6-4aa1-a8a3-cfd590aa0729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:45.789034 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-0c90831a-bdf6-4aa1-a8a3-cfd590aa0729 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:45.790700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685345e7-269d-4e71-85a9-68a4a870a58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:45.791489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0c90831a-bdf6-4aa1-a8a3-cfd590aa0729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:45.792763 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685345e7-269d-4e71-85a9-68a4a870a58f None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:45.793430 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685345e7-269d-4e71-85a9-68a4a870a58f None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:45.794066 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685345e7-269d-4e71-85a9-68a4a870a58f None admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:45.796523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685345e7-269d-4e71-85a9-68a4a870a58f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:45.797264 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685345e7-269d-4e71-85a9-68a4a870a58f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:45.808911 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685345e7-269d-4e71-85a9-68a4a870a58f None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:45.846355 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 358/728] 10.222.0.62 () {56 vars in 1149 bytes} [Tue Oct 4 14:15:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:45.851784 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685345e7-269d-4e71-85a9-68a4a870a58f None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:46.019751 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 371/729] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:46.133951 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685345e7-269d-4e71-85a9-68a4a870a58f None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:46.209969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccbb3d7-c673-488e-9567-32f6d99aadba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:46.211329 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccbb3d7-c673-488e-9567-32f6d99aadba None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:46.212054 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccbb3d7-c673-488e-9567-32f6d99aadba None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:46.212739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccbb3d7-c673-488e-9567-32f6d99aadba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:46.237345 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:46.362572 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccbb3d7-c673-488e-9567-32f6d99aadba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:46.365610 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccbb3d7-c673-488e-9567-32f6d99aadba None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:46.439208 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90831a-bdf6-4aa1-a8a3-cfd590aa0729 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:46.583821 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 359/730] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:15:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 14:15:46.593680 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccbb3d7-c673-488e-9567-32f6d99aadba None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:46.688208 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:46.734200 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90831a-bdf6-4aa1-a8a3-cfd590aa0729 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:46.759082 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:46.814587 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccbb3d7-c673-488e-9567-32f6d99aadba None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:46.822148 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaff979-2c97-46cc-91c5-587de9843216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:46.822872 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaff979-2c97-46cc-91c5-587de9843216 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:46.823153 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaff979-2c97-46cc-91c5-587de9843216 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:46.829934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaff979-2c97-46cc-91c5-587de9843216 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:46.842665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaff979-2c97-46cc-91c5-587de9843216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:15:46.847657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-efaff979-2c97-46cc-91c5-587de9843216 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:15:46.847657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:46.847657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:46.847657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:46.847657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:46.847657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:46.847657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:46.847657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:46.847657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:46.847657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:46.847657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:46.847657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:46.847657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:15:46.847657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:15:46.847657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:15:46.847657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:15:46.848719 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:15:46.848719 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:15:46.848719 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:15:46.848719 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:15:46.848719 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:46.848719 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:46.848719 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:46.848719 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:46.848719 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:46.848719 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:46.848719 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:46.848719 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:46.848719 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:46.848719 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:46.848719 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:46.848719 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:46.849557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:46.849557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:46.849557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:46.849557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:46.849557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:15:46.849557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:15:46.849557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:15:46.849557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:15:46.849557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:15:46.849557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:15:46.849557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:15:46.849557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:46.849557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 372/731] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:15:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:15:46.855352 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86de04-523e-4b75-b3ee-8b03733456dd None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:46.855866 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86de04-523e-4b75-b3ee-8b03733456dd None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:46.856250 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86de04-523e-4b75-b3ee-8b03733456dd None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:46.862960 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 373/732] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:46.862960 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86de04-523e-4b75-b3ee-8b03733456dd None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:46.877162 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e5091-303e-40a2-b743-b6a1425abcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:46.878351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e5091-303e-40a2-b743-b6a1425abcc1 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:46.879343 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e5091-303e-40a2-b743-b6a1425abcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:46.880049 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e5091-303e-40a2-b743-b6a1425abcc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:46.896717 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e5091-303e-40a2-b743-b6a1425abcc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:46.898218 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e5091-303e-40a2-b743-b6a1425abcc1 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:46.923413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-5d0e5091-303e-40a2-b743-b6a1425abcc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:46.923413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:46.923413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:46.923413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:46.923413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:46.923413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:46.923413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:46.923413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:46.923413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:46.923413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:46.923413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:46.923413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:46.923413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:46.923413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:46.923413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:46.923413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:46.924473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:46.924473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:46.924473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:46.924473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:46.924473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:46.924473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:46.924473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:46.924473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:46.924473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:46.924473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:46.924473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:46.924473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:46.924473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:46.924473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:46.924473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:46.924473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:46.924473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:46.925357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:46.925357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:46.925357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:46.932965 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 360/733] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:46.933274 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068c853-52a0-4b9b-9b9d-7977345f2b43 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:46.933767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068c853-52a0-4b9b-9b9d-7977345f2b43 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:46.933767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068c853-52a0-4b9b-9b9d-7977345f2b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:46.955256 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-3068c853-52a0-4b9b-9b9d-7977345f2b43 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:46.956491 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-3068c853-52a0-4b9b-9b9d-7977345f2b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:47.010497 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86de04-523e-4b75-b3ee-8b03733456dd None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:47.040021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 361/734] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:47.041104 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068c853-52a0-4b9b-9b9d-7977345f2b43 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:47.064777 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209b05e-572c-46ff-bff5-03dd69e362fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:47.066250 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209b05e-572c-46ff-bff5-03dd69e362fd None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:47.066996 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209b05e-572c-46ff-bff5-03dd69e362fd None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:47.067684 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209b05e-572c-46ff-bff5-03dd69e362fd None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:47.068662 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6209b05e-572c-46ff-bff5-03dd69e362fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:47.069202 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6209b05e-572c-46ff-bff5-03dd69e362fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:47.071414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6209b05e-572c-46ff-bff5-03dd69e362fd None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:47.084296 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 374/735] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:15:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:47.095025 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209b05e-572c-46ff-bff5-03dd69e362fd None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:47.111684 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:47.193818 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:47.280353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068c853-52a0-4b9b-9b9d-7977345f2b43 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:47.391876 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdb72c-afb1-4792-83a8-94d90a276816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:47.394431 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdb72c-afb1-4792-83a8-94d90a276816 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:47.395424 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdb72c-afb1-4792-83a8-94d90a276816 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:47.396273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdb72c-afb1-4792-83a8-94d90a276816 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:47.397875 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdb72c-afb1-4792-83a8-94d90a276816 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:47.398754 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdb72c-afb1-4792-83a8-94d90a276816 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:47.401766 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdb72c-afb1-4792-83a8-94d90a276816 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:47.432683 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 362/736] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:47.434764 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdb72c-afb1-4792-83a8-94d90a276816 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:47.441161 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209b05e-572c-46ff-bff5-03dd69e362fd None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:47.486318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f9209-de74-46d7-808a-6be3a5e9d5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:47.486984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f9209-de74-46d7-808a-6be3a5e9d5d0 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:47.487450 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f9209-de74-46d7-808a-6be3a5e9d5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:47.487606 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f9209-de74-46d7-808a-6be3a5e9d5d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:47.502876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f9209-de74-46d7-808a-6be3a5e9d5d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:47.504632 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f9209-de74-46d7-808a-6be3a5e9d5d0 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:47.530584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-337f9209-de74-46d7-808a-6be3a5e9d5d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:47.530584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:47.530584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:47.530584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:47.530584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:47.530584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:47.530584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:47.530584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:47.530584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:47.530584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:47.530584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:47.530584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:47.530584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:47.530584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:47.530584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:47.530584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:47.532422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:47.532422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:47.532422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:47.532422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:47.532422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:47.532422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:47.532422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:47.532422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:47.532422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:47.532422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:47.532422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:47.532422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:47.532422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:47.532422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:47.532422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:47.532422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:47.532422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:47.534186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:47.534186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:47.534186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:47.536727 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 375/737] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 438 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:15:47.537771 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f9209-de74-46d7-808a-6be3a5e9d5d0 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:47.636295 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:47.686540 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:47.694552 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdb72c-afb1-4792-83a8-94d90a276816 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:47.734276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f9209-de74-46d7-808a-6be3a5e9d5d0 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:47.737501 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59048a99-df8d-4842-bbac-81ce489a716c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:47.738209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59048a99-df8d-4842-bbac-81ce489a716c None admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:47.738571 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59048a99-df8d-4842-bbac-81ce489a716c None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:47.738918 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59048a99-df8d-4842-bbac-81ce489a716c None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:47.739659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59048a99-df8d-4842-bbac-81ce489a716c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:47.741232 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59048a99-df8d-4842-bbac-81ce489a716c None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:47.772519 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 363/738] 10.222.0.62 () {60 vars in 1141 bytes} [Tue Oct 4 14:15:47 2022] POST /identity/v3/services => generated 251 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:15:47.774450 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59048a99-df8d-4842-bbac-81ce489a716c None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:47.843873 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a85a1-b29f-4cec-8318-00ebee588d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:47.845417 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a85a1-b29f-4cec-8318-00ebee588d5e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:47.846218 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a85a1-b29f-4cec-8318-00ebee588d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:47.846968 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a85a1-b29f-4cec-8318-00ebee588d5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:47.863193 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a85a1-b29f-4cec-8318-00ebee588d5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:47.867952 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a85a1-b29f-4cec-8318-00ebee588d5e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:47.893978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-8e3a85a1-b29f-4cec-8318-00ebee588d5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:47.893978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:47.893978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:47.893978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:47.893978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:47.893978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:47.893978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:47.893978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:47.893978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:47.893978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:47.893978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:47.893978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:47.893978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:15:47.893978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:15:47.893978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:15:47.895699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:15:47.895699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:47.895699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:47.895699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:47.895699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:47.895699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:47.895699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:47.895699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:47.895699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:47.895699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:47.895699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:47.895699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:47.895699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:47.895699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:47.895699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:47.895699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:47.895699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:47.897386 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:15:47.897386 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:15:47.897386 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:15:47.897386 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:15:47.897386 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:15:47.897386 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:15:47.897386 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:47.897386 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:47.901896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 376/739] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:15:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:47.931016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a85a1-b29f-4cec-8318-00ebee588d5e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:48.150684 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59048a99-df8d-4842-bbac-81ce489a716c None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:48.242030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e51182-60b3-4bca-bb5a-06c1c88fb2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:48.243091 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e51182-60b3-4bca-bb5a-06c1c88fb2bc None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:48.243588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e51182-60b3-4bca-bb5a-06c1c88fb2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:48.244108 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e51182-60b3-4bca-bb5a-06c1c88fb2bc None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:48.245276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e51182-60b3-4bca-bb5a-06c1c88fb2bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:48.245800 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e51182-60b3-4bca-bb5a-06c1c88fb2bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:48.251095 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e51182-60b3-4bca-bb5a-06c1c88fb2bc None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:48.282842 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a85a1-b29f-4cec-8318-00ebee588d5e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:48.290200 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 364/740] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 517 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:48.300576 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e51182-60b3-4bca-bb5a-06c1c88fb2bc None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:48.308550 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:48.379578 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53b57a-5e87-4ec7-8dd0-bb87ae358efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:48.380762 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53b57a-5e87-4ec7-8dd0-bb87ae358efb None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:48.381616 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53b57a-5e87-4ec7-8dd0-bb87ae358efb None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:48.381812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53b57a-5e87-4ec7-8dd0-bb87ae358efb None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:48.383059 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53b57a-5e87-4ec7-8dd0-bb87ae358efb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:48.383765 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53b57a-5e87-4ec7-8dd0-bb87ae358efb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:48.386408 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53b57a-5e87-4ec7-8dd0-bb87ae358efb None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:48.404358 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:48.419965 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 377/741] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:15:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 490 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:48.431856 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53b57a-5e87-4ec7-8dd0-bb87ae358efb None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:48.546394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e51182-60b3-4bca-bb5a-06c1c88fb2bc None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:48.619424 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e61b4-5251-455b-80b5-c6f598755c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:48.620630 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e61b4-5251-455b-80b5-c6f598755c6a None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:48.621109 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e61b4-5251-455b-80b5-c6f598755c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:48.621664 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e61b4-5251-455b-80b5-c6f598755c6a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:48.636348 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e61b4-5251-455b-80b5-c6f598755c6a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:48.639326 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e61b4-5251-455b-80b5-c6f598755c6a None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:48.666676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-923e61b4-5251-455b-80b5-c6f598755c6a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 14:15:48.666676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:48.666676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:48.666676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:48.666676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:48.666676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:48.666676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:48.666676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:48.666676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:48.666676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:48.666676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:48.666676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:48.666676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:15:48.666676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:15:48.666676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:15:48.666676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:15:48.670325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:48.670325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:48.670325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:15:48.670325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:48.670325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:15:48.670325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:48.670325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:48.670325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:48.670325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:48.670325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:48.670325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:48.670325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:48.670325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:48.670325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:48.670325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:48.670325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:48.670325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:48.670325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:48.677050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:48.677050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:48.677050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:15:48.677050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:15:48.677050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:15:48.677050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:15:48.677050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:15:48.677050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:15:48.677050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 14:15:48.677050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:48.677050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 365/742] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:15:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:48.677050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a9732-8d3c-4651-89b2-8262b7df4796 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:48.677050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a9732-8d3c-4651-89b2-8262b7df4796 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:48.678632 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a9732-8d3c-4651-89b2-8262b7df4796 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:48.678632 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 366/743] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:48.685057 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a9732-8d3c-4651-89b2-8262b7df4796 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:48.701113 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53b57a-5e87-4ec7-8dd0-bb87ae358efb None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:48.779730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58224788-f50a-4a94-8f42-0a2573818593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:48.781777 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58224788-f50a-4a94-8f42-0a2573818593 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:48.782259 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58224788-f50a-4a94-8f42-0a2573818593 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:48.782747 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58224788-f50a-4a94-8f42-0a2573818593 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:48.784492 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58224788-f50a-4a94-8f42-0a2573818593 None admin] RBAC: Adding query filter params (role.id=e5d031634de14f1e86b912ddddfe7f8c, scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba, user.id=c5dc12a8bc2b406b8a148bf609d5d2ba) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:48.785032 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58224788-f50a-4a94-8f42-0a2573818593 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:48.789036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58224788-f50a-4a94-8f42-0a2573818593 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:48.807902 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 378/744] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:15:48 2022] GET /identity/v3/role_assignments?user.id=c5dc12a8bc2b406b8a148bf609d5d2ba&scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba&role.id=e5d031634de14f1e86b912ddddfe7f8c => generated 259 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:48.813921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfb8fc-7eeb-45fe-984d-f79c4e93ea53 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:48.819748 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfb8fc-7eeb-45fe-984d-f79c4e93ea53 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:48.819748 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfb8fc-7eeb-45fe-984d-f79c4e93ea53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:48.836089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:48.896753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-d6bfb8fc-7eeb-45fe-984d-f79c4e93ea53 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:48.898941 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d6bfb8fc-7eeb-45fe-984d-f79c4e93ea53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:48.978174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a9732-8d3c-4651-89b2-8262b7df4796 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:49.081998 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199b021-8aca-40ba-a5b9-dcc64ccfa4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:49.082635 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199b021-8aca-40ba-a5b9-dcc64ccfa4fa None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:49.082899 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199b021-8aca-40ba-a5b9-dcc64ccfa4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:49.083163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199b021-8aca-40ba-a5b9-dcc64ccfa4fa None admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:49.083965 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199b021-8aca-40ba-a5b9-dcc64ccfa4fa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:49.084270 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199b021-8aca-40ba-a5b9-dcc64ccfa4fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:49.087167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199b021-8aca-40ba-a5b9-dcc64ccfa4fa None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:49.093428 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:49.119698 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 379/745] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:49.125530 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 367/746] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Oct 4 14:15:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:49.134625 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfb8fc-7eeb-45fe-984d-f79c4e93ea53 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:49.375332 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfb8fc-7eeb-45fe-984d-f79c4e93ea53 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:49.463218 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e218672-9d52-4033-a034-c5dcc6e38afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:49.464301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e218672-9d52-4033-a034-c5dcc6e38afe None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:49.464751 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e218672-9d52-4033-a034-c5dcc6e38afe None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:49.465215 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e218672-9d52-4033-a034-c5dcc6e38afe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:49.581603 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199b021-8aca-40ba-a5b9-dcc64ccfa4fa None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:49.631921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:49.653810 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e218672-9d52-4033-a034-c5dcc6e38afe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:49.656655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e218672-9d52-4033-a034-c5dcc6e38afe None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:49.794656 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199b021-8aca-40ba-a5b9-dcc64ccfa4fa None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:49.824207 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:49.847055 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f04234-c7af-43f6-be2e-3d46305a232f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:49.848518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f04234-c7af-43f6-be2e-3d46305a232f None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:49.849036 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f04234-c7af-43f6-be2e-3d46305a232f None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:49.849521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f04234-c7af-43f6-be2e-3d46305a232f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:49.865521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f04234-c7af-43f6-be2e-3d46305a232f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:15:49.871746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-61f04234-c7af-43f6-be2e-3d46305a232f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:15:49.871746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:49.871746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:49.871746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:49.871746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:49.871746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:49.871746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:49.871746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:49.871746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:49.871746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:49.871746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:49.871746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:49.871746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:15:49.871746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:15:49.871746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:15:49.871746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:15:49.873105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:15:49.873105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:15:49.873105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:15:49.873105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:15:49.873105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:49.873105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:49.873105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:49.873105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:49.873105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:49.873105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:49.873105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:49.873105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:49.873105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:49.873105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:49.873105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:49.873105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:49.874914 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:49.874914 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:49.874914 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:49.874914 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:49.874914 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:15:49.874914 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:15:49.874914 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:15:49.874914 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:15:49.874914 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:15:49.874914 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:15:49.874914 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:15:49.874914 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:49.875571 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 380/747] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:15:49 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 740 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 14:15:49.878056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 368/748] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:15:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:15:49.886384 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f007fd-00ee-4dbc-a634-87e8cf9c5c4f None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:49.886384 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f007fd-00ee-4dbc-a634-87e8cf9c5c4f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:49.886384 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f007fd-00ee-4dbc-a634-87e8cf9c5c4f None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:49.886699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f04234-c7af-43f6-be2e-3d46305a232f None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:49.886776 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 381/749] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:49 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:49.891117 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f007fd-00ee-4dbc-a634-87e8cf9c5c4f None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:50.030456 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:50.049670 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f007fd-00ee-4dbc-a634-87e8cf9c5c4f None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:50.083200 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f04234-c7af-43f6-be2e-3d46305a232f None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:50.110081 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5d817-332a-44e2-9469-cf2e0bcd50b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:50.111133 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5d817-332a-44e2-9469-cf2e0bcd50b6 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:50.111612 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5d817-332a-44e2-9469-cf2e0bcd50b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:50.112120 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5d817-332a-44e2-9469-cf2e0bcd50b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:50.137429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5d817-332a-44e2-9469-cf2e0bcd50b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:50.141503 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5d817-332a-44e2-9469-cf2e0bcd50b6 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:50.144568 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f38d8-e405-4525-b7ac-00f4bc0d3e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:50.145491 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f38d8-e405-4525-b7ac-00f4bc0d3e3f None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:50.146005 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f38d8-e405-4525-b7ac-00f4bc0d3e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:50.146662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f38d8-e405-4525-b7ac-00f4bc0d3e3f None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:50.147841 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f38d8-e405-4525-b7ac-00f4bc0d3e3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:50.148344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f38d8-e405-4525-b7ac-00f4bc0d3e3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:50.149979 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f38d8-e405-4525-b7ac-00f4bc0d3e3f None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:50.167810 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 369/750] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:15:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:15:50.167810 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc792b-7ed0-41b9-b1ee-dcf6eeaa6593 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:50.167810 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc792b-7ed0-41b9-b1ee-dcf6eeaa6593 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:50.167810 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc792b-7ed0-41b9-b1ee-dcf6eeaa6593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:50.172696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-16a5d817-332a-44e2-9469-cf2e0bcd50b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:50.172696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:50.172696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:50.172696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:50.172696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:50.172696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:50.172696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:50.172696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:50.172696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:50.172696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:50.172696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:50.172696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:50.172696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:50.172696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:50.172696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:50.172696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:50.173930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:50.173930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:50.173930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:50.173930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:50.173930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:50.173930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:50.173930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:50.173930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:50.173930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:50.173930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:50.173930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:50.173930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:50.173930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:50.173930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:50.173930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:50.173930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:50.173930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:50.175067 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:50.175067 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:50.175067 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:50.177924 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 382/751] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:50.177924 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5d817-332a-44e2-9469-cf2e0bcd50b6 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:50.377070 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5d817-332a-44e2-9469-cf2e0bcd50b6 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:50.378308 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-1bbc792b-7ed0-41b9-b1ee-dcf6eeaa6593 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:50.380445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-1bbc792b-7ed0-41b9-b1ee-dcf6eeaa6593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:50.446200 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:50.447986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35211096-8969-4a56-83fa-ad162824b1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:50.449287 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35211096-8969-4a56-83fa-ad162824b1fb None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:50.450402 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35211096-8969-4a56-83fa-ad162824b1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:50.450838 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35211096-8969-4a56-83fa-ad162824b1fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:50.467762 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35211096-8969-4a56-83fa-ad162824b1fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:50.470560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35211096-8969-4a56-83fa-ad162824b1fb None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:50.475963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:50.496812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-35211096-8969-4a56-83fa-ad162824b1fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:50.496812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:50.496812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:50.496812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:50.496812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:50.496812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:50.496812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:50.496812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:50.496812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:50.496812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:50.496812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:50.496812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:50.496812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:50.496812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:50.496812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:50.496812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:50.497847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:50.497847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:50.497847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:50.497847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:50.497847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:50.497847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:50.497847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:50.497847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:50.497847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:50.497847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:50.497847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:50.497847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:50.497847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:50.497847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:50.497847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:50.497847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:50.497847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:50.499796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:50.499796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:50.499796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:50.501995 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 383/752] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:50.503482 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35211096-8969-4a56-83fa-ad162824b1fb None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:50.535085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 370/753] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 14:15:50.536947 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc792b-7ed0-41b9-b1ee-dcf6eeaa6593 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:50.750264 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35211096-8969-4a56-83fa-ad162824b1fb None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:50.794052 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942afb86-19aa-4765-b6f5-a8dac6902320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:50.794691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942afb86-19aa-4765-b6f5-a8dac6902320 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:50.795165 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942afb86-19aa-4765-b6f5-a8dac6902320 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:50.795481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942afb86-19aa-4765-b6f5-a8dac6902320 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:50.796203 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942afb86-19aa-4765-b6f5-a8dac6902320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:50.796504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942afb86-19aa-4765-b6f5-a8dac6902320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:50.797948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942afb86-19aa-4765-b6f5-a8dac6902320 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:50.814599 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 384/754] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:50.822492 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942afb86-19aa-4765-b6f5-a8dac6902320 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:50.898962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:50.957599 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942afb86-19aa-4765-b6f5-a8dac6902320 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:50.975431 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc792b-7ed0-41b9-b1ee-dcf6eeaa6593 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:51.001804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd88fd-a2b0-41fe-85ae-2e537e501fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:51.002381 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd88fd-a2b0-41fe-85ae-2e537e501fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:51.002661 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd88fd-a2b0-41fe-85ae-2e537e501fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:51.002930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd88fd-a2b0-41fe-85ae-2e537e501fd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:51.010966 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd88fd-a2b0-41fe-85ae-2e537e501fd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:51.013232 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd88fd-a2b0-41fe-85ae-2e537e501fd8 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:51.027728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-47dd88fd-a2b0-41fe-85ae-2e537e501fd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:51.027728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:51.027728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:51.027728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:51.027728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:51.027728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:51.027728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:51.027728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:51.027728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:51.027728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:51.027728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:51.027728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:51.027728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:15:51.027728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:15:51.027728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:15:51.028769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:15:51.028769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:51.028769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:51.028769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:51.028769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:51.028769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:51.028769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:51.028769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:51.028769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:51.028769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:51.028769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:51.028769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:51.028769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:51.028769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:51.028769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:51.028769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:51.028769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:51.031549 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:15:51.031549 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:15:51.031549 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:15:51.031549 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:15:51.031549 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:15:51.031549 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:15:51.031549 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:51.031549 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:51.031549 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 385/755] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:15:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:51.040474 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd88fd-a2b0-41fe-85ae-2e537e501fd8 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:51.127732 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d804191-21cc-471f-8371-a198fee6e448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:51.128766 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d804191-21cc-471f-8371-a198fee6e448 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:51.129231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d804191-21cc-471f-8371-a198fee6e448 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:51.129677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d804191-21cc-471f-8371-a198fee6e448 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:51.130759 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d804191-21cc-471f-8371-a198fee6e448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:51.131202 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d804191-21cc-471f-8371-a198fee6e448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:51.145873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d804191-21cc-471f-8371-a198fee6e448 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:51.190778 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 371/756] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 655 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:51.192156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d804191-21cc-471f-8371-a198fee6e448 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:51.241125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd88fd-a2b0-41fe-85ae-2e537e501fd8 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:51.270724 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:51.280596 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:51.326008 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b1164-d2db-4a46-866a-9e70c177a634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:51.328408 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b1164-d2db-4a46-866a-9e70c177a634 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:51.329248 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b1164-d2db-4a46-866a-9e70c177a634 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:51.330394 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b1164-d2db-4a46-866a-9e70c177a634 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:51.332784 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b1164-d2db-4a46-866a-9e70c177a634 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:51.333287 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b1164-d2db-4a46-866a-9e70c177a634 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:51.337521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b1164-d2db-4a46-866a-9e70c177a634 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:51.368296 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 386/757] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:15:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:51.370602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b1164-d2db-4a46-866a-9e70c177a634 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:51.430014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d804191-21cc-471f-8371-a198fee6e448 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:51.503309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a964c-ee7a-4d8e-8136-29ce61e5cb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:51.504317 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a964c-ee7a-4d8e-8136-29ce61e5cb77 None admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:51.504782 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a964c-ee7a-4d8e-8136-29ce61e5cb77 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:51.505244 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a964c-ee7a-4d8e-8136-29ce61e5cb77 None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:51.506440 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a964c-ee7a-4d8e-8136-29ce61e5cb77 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:51.508992 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a964c-ee7a-4d8e-8136-29ce61e5cb77 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:51.550349 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 372/758] 10.222.0.62 () {60 vars in 1141 bytes} [Tue Oct 4 14:15:51 2022] POST /identity/v3/services => generated 240 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:15:51.550349 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a964c-ee7a-4d8e-8136-29ce61e5cb77 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:51.619993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b1164-d2db-4a46-866a-9e70c177a634 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:51.700232 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d49ae7-6487-461d-91e0-c6686567e25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:51.701232 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d49ae7-6487-461d-91e0-c6686567e25f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:51.702321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d49ae7-6487-461d-91e0-c6686567e25f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:51.702770 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d49ae7-6487-461d-91e0-c6686567e25f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:51.716249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d49ae7-6487-461d-91e0-c6686567e25f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:51.719053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d49ae7-6487-461d-91e0-c6686567e25f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:51.730887 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:51.744468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-92d49ae7-6487-461d-91e0-c6686567e25f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 14:15:51.744468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:51.744468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:51.744468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:51.744468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:51.744468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:51.744468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:51.744468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:51.744468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:51.744468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:51.744468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:51.744468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:51.744468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:15:51.744468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:15:51.744468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:15:51.744468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:15:51.746256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:51.746256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:51.746256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:15:51.746256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:51.746256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:15:51.746256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:51.746256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:51.746256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:51.746256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:51.746256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:51.746256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:51.746256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:51.746256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:51.746256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:51.746256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:51.746256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:51.746256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:51.746256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:51.750007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:51.750007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:51.750007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:15:51.750007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:15:51.750007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:15:51.750007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:15:51.750007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:15:51.750007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:15:51.750007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 14:15:51.750007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:51.751096 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a964c-ee7a-4d8e-8136-29ce61e5cb77 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:51.751240 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 387/759] 10.222.0.62 () {56 vars in 1093 bytes} [Tue Oct 4 14:15:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:51.751240 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403b66d-7d5a-409c-8aa4-64d0ed3d7269 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:51.751240 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403b66d-7d5a-409c-8aa4-64d0ed3d7269 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:51.751240 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403b66d-7d5a-409c-8aa4-64d0ed3d7269 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:51.760189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 388/760] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:51.760189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112d008-0c4f-4559-82e5-62eeec62158a None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:51.760189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112d008-0c4f-4559-82e5-62eeec62158a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:51.760189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112d008-0c4f-4559-82e5-62eeec62158a None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:51.760189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 389/761] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:51.761559 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112d008-0c4f-4559-82e5-62eeec62158a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:51.797556 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3b295-4727-4a4a-8b06-2ebf57bf1ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:51.798184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3b295-4727-4a4a-8b06-2ebf57bf1ebd None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:51.798478 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3b295-4727-4a4a-8b06-2ebf57bf1ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:51.798723 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3b295-4727-4a4a-8b06-2ebf57bf1ebd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:51.799477 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3b295-4727-4a4a-8b06-2ebf57bf1ebd None admin] RBAC: Adding query filter params (role.id=a16b6daeda5b4a67992f3c12514ca90e, scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba, user.id=4860d5958e724e568576a9067290a27e) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:51.799820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3b295-4727-4a4a-8b06-2ebf57bf1ebd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:51.801493 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3b295-4727-4a4a-8b06-2ebf57bf1ebd None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:51.809594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 373/762] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:15:51 2022] GET /identity/v3/role_assignments?user.id=4860d5958e724e568576a9067290a27e&scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba&role.id=a16b6daeda5b4a67992f3c12514ca90e => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:51.820171 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8fb7a-4600-4655-bb3f-ced255135e2b None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:51.820171 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8fb7a-4600-4655-bb3f-ced255135e2b None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:51.820171 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8fb7a-4600-4655-bb3f-ced255135e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:51.840316 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-3db8fb7a-4600-4655-bb3f-ced255135e2b None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:51.841569 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-3db8fb7a-4600-4655-bb3f-ced255135e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:51.848449 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:51.955759 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 374/763] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:15:51.958393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcbd8f-9184-42d9-b502-ebf04e719f85 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:51.958804 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcbd8f-9184-42d9-b502-ebf04e719f85 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:51.958958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcbd8f-9184-42d9-b502-ebf04e719f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:51.985086 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-31fcbd8f-9184-42d9-b502-ebf04e719f85 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:51.986709 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-31fcbd8f-9184-42d9-b502-ebf04e719f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:52.018901 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112d008-0c4f-4559-82e5-62eeec62158a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:52.063771 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3ebb2-4ba3-4cd6-a16a-07d4247615c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:52.064356 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3ebb2-4ba3-4cd6-a16a-07d4247615c6 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:52.064647 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3ebb2-4ba3-4cd6-a16a-07d4247615c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:52.064914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3ebb2-4ba3-4cd6-a16a-07d4247615c6 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:52.065753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3ebb2-4ba3-4cd6-a16a-07d4247615c6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:52.066061 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3ebb2-4ba3-4cd6-a16a-07d4247615c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:52.067597 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3ebb2-4ba3-4cd6-a16a-07d4247615c6 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:52.096401 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 390/764] 10.222.0.62 () {56 vars in 1133 bytes} [Tue Oct 4 14:15:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:52.097666 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3ebb2-4ba3-4cd6-a16a-07d4247615c6 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:52.174959 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 375/765] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:15:52.252986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3ebb2-4ba3-4cd6-a16a-07d4247615c6 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:52.256235 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:52.293431 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e164e-91ef-40bf-82a9-a8eb88158ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:52.294085 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e164e-91ef-40bf-82a9-a8eb88158ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:52.294339 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e164e-91ef-40bf-82a9-a8eb88158ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:52.294598 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e164e-91ef-40bf-82a9-a8eb88158ce6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:52.307320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e164e-91ef-40bf-82a9-a8eb88158ce6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:52.308881 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e164e-91ef-40bf-82a9-a8eb88158ce6 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:52.326132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-bd9e164e-91ef-40bf-82a9-a8eb88158ce6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:52.326132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:52.326132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:52.326132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:52.326132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:52.326132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:52.326132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:52.326132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:52.326132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:52.326132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:52.326132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:52.326132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:52.326132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:52.326132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:52.326132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:52.326132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:52.329688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:52.329688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:52.329688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:52.329688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:52.329688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:52.329688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:52.329688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:52.329688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:52.329688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:52.329688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:52.329688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:52.329688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:52.329688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:52.329688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:52.329688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:52.329688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:52.329688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:52.337111 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:52.337111 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:52.337111 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:52.337111 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 391/766] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:52.337972 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcbd8f-9184-42d9-b502-ebf04e719f85 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:52.356635 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:52.452498 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcbd8f-9184-42d9-b502-ebf04e719f85 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:52.491876 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399f278-cfab-48f8-a886-93ffbab0eb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:52.492516 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399f278-cfab-48f8-a886-93ffbab0eb48 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:52.492771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399f278-cfab-48f8-a886-93ffbab0eb48 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:52.493063 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399f278-cfab-48f8-a886-93ffbab0eb48 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:52.493773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399f278-cfab-48f8-a886-93ffbab0eb48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:52.494073 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399f278-cfab-48f8-a886-93ffbab0eb48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:52.495488 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399f278-cfab-48f8-a886-93ffbab0eb48 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:52.509589 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 376/767] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:52.520907 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e164e-91ef-40bf-82a9-a8eb88158ce6 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:52.538542 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399f278-cfab-48f8-a886-93ffbab0eb48 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:52.640411 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:52.666509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399f278-cfab-48f8-a886-93ffbab0eb48 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:52.712549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a78279-302d-49e8-a13d-f2a7df2713ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:52.713196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a78279-302d-49e8-a13d-f2a7df2713ed None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:52.713471 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a78279-302d-49e8-a13d-f2a7df2713ed None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:52.713738 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a78279-302d-49e8-a13d-f2a7df2713ed None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:52.714321 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a78279-302d-49e8-a13d-f2a7df2713ed None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:52.715754 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a78279-302d-49e8-a13d-f2a7df2713ed None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:52.726779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-68a78279-302d-49e8-a13d-f2a7df2713ed None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 14:15:52.726779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:52.726779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:15:52.726779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:15:52.726779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:15:52.726779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:15:52.726779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:15:52.726779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:15:52.726779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 14:15:52.726779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:52.726779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:15:52.726779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:52.726779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:52.726779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:52.726779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:52.726779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:52.726779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:52.728584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:52.728584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:52.728584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:52.728584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:52.728584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:52.728584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:52.728584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:15:52.728584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:15:52.728584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:15:52.728584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:15:52.728584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:52.728584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:52.728584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:52.728584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:52.728584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:52.728584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:52.730079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:52.730079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:52.730079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:52.730079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:52.730079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:52.730079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:52.730079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:52.730079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:52.730079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:52.730079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:52.730079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:15:52.730079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:15:52.730079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 14:15:52.730079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:52.730079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 377/768] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Oct 4 14:15:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:15:52.735447 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a78279-302d-49e8-a13d-f2a7df2713ed None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:52.833215 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e164e-91ef-40bf-82a9-a8eb88158ce6 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:52.910702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3072f7-20af-4167-9ea2-b81ae1343550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:52.912398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3072f7-20af-4167-9ea2-b81ae1343550 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:52.913222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3072f7-20af-4167-9ea2-b81ae1343550 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:52.914048 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3072f7-20af-4167-9ea2-b81ae1343550 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:52.929774 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3072f7-20af-4167-9ea2-b81ae1343550 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:52.933353 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3072f7-20af-4167-9ea2-b81ae1343550 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:52.960499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-ba3072f7-20af-4167-9ea2-b81ae1343550 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:52.960499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:52.960499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:52.960499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:52.960499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:52.960499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:52.960499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:52.960499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:52.960499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:52.960499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:52.960499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:52.960499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:52.960499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:15:52.960499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:15:52.960499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:15:52.962205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:15:52.962205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:52.962205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:52.962205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:52.962205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:52.962205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:52.962205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:52.962205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:52.962205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:52.962205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:52.962205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:52.962205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:52.962205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:52.962205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:52.962205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:52.962205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:52.962205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:52.963942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:15:52.963942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:15:52.963942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:15:52.963942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:15:52.963942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:15:52.963942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:15:52.963942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:52.963942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:52.968851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a78279-302d-49e8-a13d-f2a7df2713ed None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:52.969598 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 392/769] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:15:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 452 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:15:52.971592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3072f7-20af-4167-9ea2-b81ae1343550 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:52.979836 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:53.051115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7593886-a9c9-492f-960d-f6bef6bb419e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:53.052210 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7593886-a9c9-492f-960d-f6bef6bb419e None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:53.052704 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7593886-a9c9-492f-960d-f6bef6bb419e None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:53.053188 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7593886-a9c9-492f-960d-f6bef6bb419e None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:53.054377 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7593886-a9c9-492f-960d-f6bef6bb419e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:53.054914 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7593886-a9c9-492f-960d-f6bef6bb419e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:53.057621 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7593886-a9c9-492f-960d-f6bef6bb419e None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:53.067573 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 378/770] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Oct 4 14:15:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:53.069302 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7593886-a9c9-492f-960d-f6bef6bb419e None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:53.075923 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:53.122780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3072f7-20af-4167-9ea2-b81ae1343550 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:53.197021 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb7c69-5f4c-4826-9553-fb44a97fb826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:53.197951 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb7c69-5f4c-4826-9553-fb44a97fb826 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:53.198420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb7c69-5f4c-4826-9553-fb44a97fb826 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:53.198880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb7c69-5f4c-4826-9553-fb44a97fb826 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:53.221700 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb7c69-5f4c-4826-9553-fb44a97fb826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:15:53.234688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-44cb7c69-5f4c-4826-9553-fb44a97fb826 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:53.234688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:53.234688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:53.234688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:53.234688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:53.234688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:53.234688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:53.234688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:53.234688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:53.234688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:53.234688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:53.234688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:53.234688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:15:53.234688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:15:53.234688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:15:53.234688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:15:53.236877 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:15:53.236877 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:15:53.236877 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:15:53.236877 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:15:53.236877 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:53.236877 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:53.236877 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:53.236877 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:53.236877 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:53.236877 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:53.236877 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:53.236877 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:53.236877 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:53.236877 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:53.236877 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:53.236877 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:53.238799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:53.238799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:53.238799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:53.238799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:53.238799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:15:53.238799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:15:53.238799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:15:53.238799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:15:53.238799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:15:53.238799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:15:53.238799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:15:53.238799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:53.238799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 393/771] 10.222.0.62 () {56 vars in 1102 bytes} [Tue Oct 4 14:15:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:53.238799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb7c69-5f4c-4826-9553-fb44a97fb826 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:53.300599 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7593886-a9c9-492f-960d-f6bef6bb419e None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:53.372122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:53.387256 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b493bf2-4c63-40b1-b002-e6bae926dbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:53.388671 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b493bf2-4c63-40b1-b002-e6bae926dbcf None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:53.389733 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b493bf2-4c63-40b1-b002-e6bae926dbcf None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:53.390139 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b493bf2-4c63-40b1-b002-e6bae926dbcf None admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:53.391412 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b493bf2-4c63-40b1-b002-e6bae926dbcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:53.391974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b493bf2-4c63-40b1-b002-e6bae926dbcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:53.396466 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b493bf2-4c63-40b1-b002-e6bae926dbcf None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:53.430689 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 379/772] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:15:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:53.433308 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b493bf2-4c63-40b1-b002-e6bae926dbcf None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:53.464133 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb7c69-5f4c-4826-9553-fb44a97fb826 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:53.540772 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec6566-b7d1-4abc-840e-fa361ee52bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:53.541820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec6566-b7d1-4abc-840e-fa361ee52bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:53.542487 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec6566-b7d1-4abc-840e-fa361ee52bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:53.542800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec6566-b7d1-4abc-840e-fa361ee52bf3 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:53.544066 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec6566-b7d1-4abc-840e-fa361ee52bf3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:53.544596 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec6566-b7d1-4abc-840e-fa361ee52bf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:53.547373 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec6566-b7d1-4abc-840e-fa361ee52bf3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:53.562796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 394/773] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Oct 4 14:15:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:53.564827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec6566-b7d1-4abc-840e-fa361ee52bf3 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:53.582915 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:53.660498 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b493bf2-4c63-40b1-b002-e6bae926dbcf None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:53.727309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea111d7d-95b2-4202-8a14-c3b0579baab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:53.728448 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea111d7d-95b2-4202-8a14-c3b0579baab6 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:53.728936 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea111d7d-95b2-4202-8a14-c3b0579baab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:53.729421 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea111d7d-95b2-4202-8a14-c3b0579baab6 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:53.730699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea111d7d-95b2-4202-8a14-c3b0579baab6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:53.731239 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea111d7d-95b2-4202-8a14-c3b0579baab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:53.734912 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea111d7d-95b2-4202-8a14-c3b0579baab6 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:53.758968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 380/774] 10.222.0.62 () {56 vars in 1103 bytes} [Tue Oct 4 14:15:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:53.758968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea111d7d-95b2-4202-8a14-c3b0579baab6 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:53.763068 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec6566-b7d1-4abc-840e-fa361ee52bf3 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:53.800805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:53.818263 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448df658-dbcb-404c-919b-d689ed62270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:53.819471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448df658-dbcb-404c-919b-d689ed62270d None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:53.819995 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448df658-dbcb-404c-919b-d689ed62270d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:53.820855 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448df658-dbcb-404c-919b-d689ed62270d None admin] PATH_INFO: `/v3/projects/fd73ece314ef4f2eabb34e2a88d610ba/users/151e7b9c7a7b46d58dc2f563d05775e2/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:53.823690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448df658-dbcb-404c-919b-d689ed62270d None admin] RBAC: Authorizing `identity:create_grant(project_id=fd73ece314ef4f2eabb34e2a88d610ba, user_id=151e7b9c7a7b46d58dc2f563d05775e2, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:53.826210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448df658-dbcb-404c-919b-d689ed62270d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:53.855991 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 395/775] 10.222.0.62 () {58 vars in 1439 bytes} [Tue Oct 4 14:15:53 2022] PUT /identity/v3/projects/fd73ece314ef4f2eabb34e2a88d610ba/users/151e7b9c7a7b46d58dc2f563d05775e2/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:15:53.855991 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448df658-dbcb-404c-919b-d689ed62270d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:53.985423 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea111d7d-95b2-4202-8a14-c3b0579baab6 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:54.064137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:54.079695 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16098ff-709f-44c2-881f-4ce7bc417111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:54.080363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16098ff-709f-44c2-881f-4ce7bc417111 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:54.080643 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16098ff-709f-44c2-881f-4ce7bc417111 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:54.080915 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16098ff-709f-44c2-881f-4ce7bc417111 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:54.081633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16098ff-709f-44c2-881f-4ce7bc417111 None admin] RBAC: Adding query filter params (interface=public, service_id=88d4f367f0ab4370b01fac045eba03bb, region_id=RegionOne) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:54.081938 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16098ff-709f-44c2-881f-4ce7bc417111 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:54.083339 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16098ff-709f-44c2-881f-4ce7bc417111 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:54.096395 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 381/776] 10.222.0.62 () {56 vars in 1251 bytes} [Tue Oct 4 14:15:53 2022] GET /identity/v3/endpoints?service_id=88d4f367f0ab4370b01fac045eba03bb&interface=public®ion_id=RegionOne => generated 194 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:54.102918 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16098ff-709f-44c2-881f-4ce7bc417111 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:54.132854 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448df658-dbcb-404c-919b-d689ed62270d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:54.220187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec40ab-6441-45b0-a59c-31824614ef39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:54.221608 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec40ab-6441-45b0-a59c-31824614ef39 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:54.227752 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec40ab-6441-45b0-a59c-31824614ef39 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:54.227752 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec40ab-6441-45b0-a59c-31824614ef39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:54.255873 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec40ab-6441-45b0-a59c-31824614ef39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:54.255873 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec40ab-6441-45b0-a59c-31824614ef39 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:54.287227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-c4ec40ab-6441-45b0-a59c-31824614ef39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:54.287227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:54.287227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:54.287227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:54.287227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:54.287227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:54.287227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:54.287227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:54.287227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:54.287227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:54.287227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:54.287227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:54.287227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:54.287227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:54.287227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:54.287227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:54.289489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:54.289489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:54.289489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:54.289489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:54.289489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:54.289489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:54.289489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:54.289489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:54.289489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:54.289489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:54.289489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:54.289489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:54.289489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:54.289489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:54.289489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:54.289489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:54.289489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:54.291689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:54.291689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:54.291689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:54.293474 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 396/777] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 441 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:54.306768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec40ab-6441-45b0-a59c-31824614ef39 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:54.362072 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16098ff-709f-44c2-881f-4ce7bc417111 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:54.411248 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:54.466582 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4182d0-2067-4d18-b321-2cd26df4d3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:54.469789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4182d0-2067-4d18-b321-2cd26df4d3c6 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:54.470706 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4182d0-2067-4d18-b321-2cd26df4d3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:54.471526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4182d0-2067-4d18-b321-2cd26df4d3c6 None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:54.473012 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4182d0-2067-4d18-b321-2cd26df4d3c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:54.476219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4182d0-2067-4d18-b321-2cd26df4d3c6 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:54.488493 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 382/778] 10.222.0.62 () {56 vars in 1087 bytes} [Tue Oct 4 14:15:54 2022] GET /identity/v3/services => generated 772 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:54.554912 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec40ab-6441-45b0-a59c-31824614ef39 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:54.625095 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676739b8-cfd9-44b3-9792-f2bd9f750c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:54.626685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676739b8-cfd9-44b3-9792-f2bd9f750c8a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:54.627554 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676739b8-cfd9-44b3-9792-f2bd9f750c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:54.628414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676739b8-cfd9-44b3-9792-f2bd9f750c8a None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:54.630018 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676739b8-cfd9-44b3-9792-f2bd9f750c8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:54.630919 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676739b8-cfd9-44b3-9792-f2bd9f750c8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:54.634090 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676739b8-cfd9-44b3-9792-f2bd9f750c8a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:54.671018 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 397/779] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:54.680699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4182d0-2067-4d18-b321-2cd26df4d3c6 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:54.816143 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:54.912591 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4182d0-2067-4d18-b321-2cd26df4d3c6 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:54.980734 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f915ce3-5b7e-471d-abb6-fbb45f67c049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:54.982179 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f915ce3-5b7e-471d-abb6-fbb45f67c049 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:54.982715 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f915ce3-5b7e-471d-abb6-fbb45f67c049 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:54.983204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f915ce3-5b7e-471d-abb6-fbb45f67c049 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:54.999328 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f915ce3-5b7e-471d-abb6-fbb45f67c049 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:55.002118 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f915ce3-5b7e-471d-abb6-fbb45f67c049 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:55.032330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-7f915ce3-5b7e-471d-abb6-fbb45f67c049 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 14:15:55.032330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:55.032330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:55.032330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:55.032330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:55.032330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:55.032330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:55.032330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:55.032330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:55.032330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:55.032330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:55.032330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:55.032330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:15:55.032330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:15:55.032330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:15:55.032330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:15:55.034184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:55.034184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:55.034184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:15:55.034184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:55.034184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:15:55.034184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:55.034184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:55.034184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:55.034184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:55.034184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:55.034184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:55.034184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:55.034184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:55.034184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:55.034184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:55.034184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:55.034184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:55.034184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:55.036070 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:55.036070 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:55.036070 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:15:55.036070 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:15:55.036070 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:15:55.036070 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:15:55.036070 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:15:55.036070 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:15:55.036070 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 14:15:55.036070 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:55.037970 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 383/780] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Oct 4 14:15:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:55.048450 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676739b8-cfd9-44b3-9792-f2bd9f750c8a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:55.075120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f807349-273a-4d62-8111-eb2436582d4a None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:55.076153 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f807349-273a-4d62-8111-eb2436582d4a None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:55.076153 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f807349-273a-4d62-8111-eb2436582d4a None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:55.079263 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 384/781] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:15:55.088532 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8c303-4f5a-4bdb-baf2-18abad8baea1 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:55.088966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8c303-4f5a-4bdb-baf2-18abad8baea1 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:55.089428 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8c303-4f5a-4bdb-baf2-18abad8baea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:55.137581 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-34a8c303-4f5a-4bdb-baf2-18abad8baea1 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:55.140263 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-34a8c303-4f5a-4bdb-baf2-18abad8baea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:55.273730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676739b8-cfd9-44b3-9792-f2bd9f750c8a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:55.275833 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 385/782] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:15:55.278126 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08308a-9a68-4cee-94a3-33651ed70803 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:55.278559 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08308a-9a68-4cee-94a3-33651ed70803 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:55.278991 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08308a-9a68-4cee-94a3-33651ed70803 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:55.280174 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:55.292360 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 386/783] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:55 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:55.300749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf926b-7497-4a3b-a4f2-0e75e07c7c90 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:55.301197 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf926b-7497-4a3b-a4f2-0e75e07c7c90 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:55.301640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf926b-7497-4a3b-a4f2-0e75e07c7c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:55.344862 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c332205-ba22-4387-b7c7-c02882b2f9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:55.345953 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c332205-ba22-4387-b7c7-c02882b2f9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:55.346472 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c332205-ba22-4387-b7c7-c02882b2f9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:55.347030 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c332205-ba22-4387-b7c7-c02882b2f9f0 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:55.348438 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c332205-ba22-4387-b7c7-c02882b2f9f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:55.349010 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c332205-ba22-4387-b7c7-c02882b2f9f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:55.351571 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c332205-ba22-4387-b7c7-c02882b2f9f0 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:55.361534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-fbcf926b-7497-4a3b-a4f2-0e75e07c7c90 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:55.363524 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-fbcf926b-7497-4a3b-a4f2-0e75e07c7c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:55.389448 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 398/784] 10.222.0.62 () {56 vars in 1149 bytes} [Tue Oct 4 14:15:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:55.400076 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c332205-ba22-4387-b7c7-c02882b2f9f0 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:55.519086 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:55.622494 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c332205-ba22-4387-b7c7-c02882b2f9f0 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:55.633606 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 387/785] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:15:55.694841 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308e669-6353-42b0-b0a7-3490d4995c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:55.695941 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308e669-6353-42b0-b0a7-3490d4995c87 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:55.696408 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308e669-6353-42b0-b0a7-3490d4995c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:55.696854 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308e669-6353-42b0-b0a7-3490d4995c87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:55.719162 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308e669-6353-42b0-b0a7-3490d4995c87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:55.722020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308e669-6353-42b0-b0a7-3490d4995c87 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:55.750800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-b308e669-6353-42b0-b0a7-3490d4995c87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:55.750800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:55.750800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:55.750800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:55.750800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:55.750800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:55.750800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:55.750800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:55.750800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:55.750800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:55.750800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:55.750800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:55.750800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:55.750800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:55.750800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:55.750800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:55.752704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:55.752704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:55.752704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:55.752704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:55.752704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:55.752704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:55.752704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:55.752704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:55.752704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:55.752704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:55.752704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:55.752704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:55.752704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:55.752704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:55.752704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:55.752704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:55.752704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:55.754455 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:55.754455 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:55.754455 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:55.754455 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 399/786] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:55.761736 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf926b-7497-4a3b-a4f2-0e75e07c7c90 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:55.932783 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308e669-6353-42b0-b0a7-3490d4995c87 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:55.950625 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:55.999964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf926b-7497-4a3b-a4f2-0e75e07c7c90 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:56.069524 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129fe5b-5774-4348-a890-edf1853cd58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:56.070502 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129fe5b-5774-4348-a890-edf1853cd58f None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:56.070957 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129fe5b-5774-4348-a890-edf1853cd58f None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:56.071410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129fe5b-5774-4348-a890-edf1853cd58f None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:56.072578 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129fe5b-5774-4348-a890-edf1853cd58f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:56.073082 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129fe5b-5774-4348-a890-edf1853cd58f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:56.076416 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129fe5b-5774-4348-a890-edf1853cd58f None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:56.108254 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 388/787] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:56.108254 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129fe5b-5774-4348-a890-edf1853cd58f None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:56.136583 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308e669-6353-42b0-b0a7-3490d4995c87 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:56.181701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:56.212806 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c39b73-bbf3-4343-b38e-a9b772d80e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:56.214607 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c39b73-bbf3-4343-b38e-a9b772d80e00 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:56.215455 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c39b73-bbf3-4343-b38e-a9b772d80e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:56.216178 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c39b73-bbf3-4343-b38e-a9b772d80e00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:56.240096 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c39b73-bbf3-4343-b38e-a9b772d80e00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:15:56.252382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-07c39b73-bbf3-4343-b38e-a9b772d80e00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:15:56.252382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:56.252382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:56.252382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:56.252382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:56.252382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:56.252382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:56.252382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:56.252382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:56.252382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:56.252382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:56.252382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:56.252382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:15:56.252382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:15:56.252382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:15:56.252382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:15:56.253946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:15:56.253946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:15:56.253946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:15:56.253946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:15:56.253946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:56.253946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:56.253946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:56.253946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:56.253946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:56.253946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:56.253946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:56.253946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:56.253946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:56.253946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:56.253946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:56.253946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:56.254974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:56.254974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:56.254974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:56.254974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:56.254974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:15:56.254974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:15:56.254974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:15:56.254974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:15:56.254974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:15:56.254974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:15:56.254974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:15:56.254974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:56.257829 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 400/788] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:15:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:56.258920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c39b73-bbf3-4343-b38e-a9b772d80e00 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:56.344682 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129fe5b-5774-4348-a890-edf1853cd58f None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:56.410500 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479f469-847c-4d1c-97bd-240c26d04ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:56.411535 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:56.413234 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479f469-847c-4d1c-97bd-240c26d04ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:56.413970 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479f469-847c-4d1c-97bd-240c26d04ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:56.414712 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479f469-847c-4d1c-97bd-240c26d04ec2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:56.416094 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479f469-847c-4d1c-97bd-240c26d04ec2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:56.418924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479f469-847c-4d1c-97bd-240c26d04ec2 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:56.437931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-5479f469-847c-4d1c-97bd-240c26d04ec2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 14:15:56.437931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:56.437931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:15:56.437931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:15:56.437931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:15:56.437931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:15:56.437931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:15:56.437931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:15:56.437931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 14:15:56.437931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:56.437931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:15:56.437931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:56.437931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:56.437931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:56.437931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:56.437931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:56.437931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:56.440074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:56.440074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:56.440074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:56.440074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:56.440074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:56.440074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:56.440074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:15:56.440074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:15:56.440074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:15:56.440074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:15:56.440074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:56.440074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:56.440074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:56.440074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:56.440074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:56.440074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:56.441740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:56.441740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:56.441740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:56.441740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:56.441740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:56.441740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:56.441740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:56.441740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:56.441740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:56.441740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:56.441740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:15:56.441740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:15:56.441740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 14:15:56.441740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:56.446002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 389/789] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:15:56 2022] GET /identity/v3/services/network => generated 88 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:56.448084 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479f469-847c-4d1c-97bd-240c26d04ec2 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:56.485962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c39b73-bbf3-4343-b38e-a9b772d80e00 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:56.574302 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804eb60c-5ce9-4bac-b4c3-4ddf96494a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:56.575373 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804eb60c-5ce9-4bac-b4c3-4ddf96494a39 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:56.575926 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804eb60c-5ce9-4bac-b4c3-4ddf96494a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:56.576471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804eb60c-5ce9-4bac-b4c3-4ddf96494a39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:56.590903 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804eb60c-5ce9-4bac-b4c3-4ddf96494a39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:56.594059 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804eb60c-5ce9-4bac-b4c3-4ddf96494a39 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:56.605024 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:56.609804 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479f469-847c-4d1c-97bd-240c26d04ec2 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:56.622825 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-804eb60c-5ce9-4bac-b4c3-4ddf96494a39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:56.622825 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:56.622825 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:56.622825 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:56.622825 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:56.622825 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:56.622825 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:56.622825 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:56.622825 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:56.622825 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:56.622825 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:56.622825 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:56.622825 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:15:56.622825 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:15:56.622825 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:15:56.625236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:15:56.625236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:56.625236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:56.625236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:56.625236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:56.625236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:56.625236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:56.625236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:56.625236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:56.625236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:56.625236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:56.625236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:56.625236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:56.625236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:56.625236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:56.625236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:56.625236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:56.627240 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:15:56.627240 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:15:56.627240 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:15:56.627240 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:15:56.627240 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:15:56.627240 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:15:56.627240 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:56.627240 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:56.631833 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 401/790] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:15:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:56.633796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804eb60c-5ce9-4bac-b4c3-4ddf96494a39 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:56.652655 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e217a50-2385-469b-aa46-3377b065eea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:56.653292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e217a50-2385-469b-aa46-3377b065eea2 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:56.653563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e217a50-2385-469b-aa46-3377b065eea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:56.653841 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e217a50-2385-469b-aa46-3377b065eea2 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:56.655183 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e217a50-2385-469b-aa46-3377b065eea2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:56.655564 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e217a50-2385-469b-aa46-3377b065eea2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:56.657260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e217a50-2385-469b-aa46-3377b065eea2 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:56.668167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 390/791] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:15:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:56.669070 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e217a50-2385-469b-aa46-3377b065eea2 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:56.797493 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e217a50-2385-469b-aa46-3377b065eea2 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:56.840497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfe4de-032a-41e4-acb9-044b01ddf4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:56.841139 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfe4de-032a-41e4-acb9-044b01ddf4e6 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:56.841417 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfe4de-032a-41e4-acb9-044b01ddf4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:56.841689 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfe4de-032a-41e4-acb9-044b01ddf4e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:56.843652 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfe4de-032a-41e4-acb9-044b01ddf4e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:56.843995 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfe4de-032a-41e4-acb9-044b01ddf4e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:56.845802 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfe4de-032a-41e4-acb9-044b01ddf4e6 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:56.861767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 391/792] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:15:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:56.862537 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfe4de-032a-41e4-acb9-044b01ddf4e6 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:56.867782 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804eb60c-5ce9-4bac-b4c3-4ddf96494a39 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:56.890826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:56.935001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:56.954986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18187279-3c3b-4a49-80ea-e2957492e4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:56.956423 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18187279-3c3b-4a49-80ea-e2957492e4dd None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:56.956705 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18187279-3c3b-4a49-80ea-e2957492e4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:56.957255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18187279-3c3b-4a49-80ea-e2957492e4dd None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:56.958450 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18187279-3c3b-4a49-80ea-e2957492e4dd None admin] RBAC: Adding query filter params (name=network) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:56.958969 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18187279-3c3b-4a49-80ea-e2957492e4dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:56.961616 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18187279-3c3b-4a49-80ea-e2957492e4dd None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:56.972495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 402/793] 10.222.0.62 () {56 vars in 1112 bytes} [Tue Oct 4 14:15:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:56.974153 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18187279-3c3b-4a49-80ea-e2957492e4dd None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:56.993509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfe4de-032a-41e4-acb9-044b01ddf4e6 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:57.036785 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8729458-8ff6-4762-9f75-16b958ddc25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:57.037889 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8729458-8ff6-4762-9f75-16b958ddc25f None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:57.038364 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8729458-8ff6-4762-9f75-16b958ddc25f None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:57.038835 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8729458-8ff6-4762-9f75-16b958ddc25f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:57.052719 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8729458-8ff6-4762-9f75-16b958ddc25f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:57.054836 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8729458-8ff6-4762-9f75-16b958ddc25f None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:57.073374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-f8729458-8ff6-4762-9f75-16b958ddc25f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:57.073374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:57.073374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:57.073374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:57.073374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:57.073374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:57.073374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:57.073374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:57.073374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:57.073374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:57.073374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:57.073374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:57.073374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:57.073374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:57.073374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:57.073374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:57.074395 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:57.074395 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:57.074395 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:57.074395 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:57.074395 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:57.074395 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:57.074395 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:57.074395 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:57.074395 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:57.074395 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:57.074395 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:57.074395 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:57.074395 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:57.074395 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:57.074395 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:57.074395 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:57.074395 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:57.075305 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:57.075305 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:57.075305 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:57.078064 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 392/794] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:57.080507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8729458-8ff6-4762-9f75-16b958ddc25f None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:57.180497 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18187279-3c3b-4a49-80ea-e2957492e4dd None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:57.182973 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:57.226065 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8729458-8ff6-4762-9f75-16b958ddc25f None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:57.235775 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc364dc-7eb9-49c9-94e0-2c3b7bc701c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:57.236748 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc364dc-7eb9-49c9-94e0-2c3b7bc701c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:57.237268 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc364dc-7eb9-49c9-94e0-2c3b7bc701c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:57.237687 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc364dc-7eb9-49c9-94e0-2c3b7bc701c3 None admin] PATH_INFO: `/v3/projects/fd73ece314ef4f2eabb34e2a88d610ba/users/c5dc12a8bc2b406b8a148bf609d5d2ba/roles/e5d031634de14f1e86b912ddddfe7f8c` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:57.264831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc364dc-7eb9-49c9-94e0-2c3b7bc701c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd73ece314ef4f2eabb34e2a88d610ba, user_id=c5dc12a8bc2b406b8a148bf609d5d2ba, role_id=e5d031634de14f1e86b912ddddfe7f8c)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:57.267029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc364dc-7eb9-49c9-94e0-2c3b7bc701c3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:57.270231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77139298-92d5-4d49-a4e1-ea0cdda7d9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:57.271068 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77139298-92d5-4d49-a4e1-ea0cdda7d9dc None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:57.271842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77139298-92d5-4d49-a4e1-ea0cdda7d9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:57.271842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77139298-92d5-4d49-a4e1-ea0cdda7d9dc None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:57.272742 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77139298-92d5-4d49-a4e1-ea0cdda7d9dc None admin] RBAC: Adding query filter params (type=network) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:57.273148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77139298-92d5-4d49-a4e1-ea0cdda7d9dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:57.274747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77139298-92d5-4d49-a4e1-ea0cdda7d9dc None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:57.284079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 393/795] 10.222.0.62 () {56 vars in 1112 bytes} [Tue Oct 4 14:15:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:57.285151 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77139298-92d5-4d49-a4e1-ea0cdda7d9dc None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:57.287943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 403/796] 10.222.0.62 () {58 vars in 1439 bytes} [Tue Oct 4 14:15:56 2022] PUT /identity/v3/projects/fd73ece314ef4f2eabb34e2a88d610ba/users/c5dc12a8bc2b406b8a148bf609d5d2ba/roles/e5d031634de14f1e86b912ddddfe7f8c => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:15:57.293439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc364dc-7eb9-49c9-94e0-2c3b7bc701c3 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:57.514563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77139298-92d5-4d49-a4e1-ea0cdda7d9dc None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:57.526667 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:57.605811 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480a110-2166-4590-8674-ea74906f1f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:57.607515 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480a110-2166-4590-8674-ea74906f1f70 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:57.611287 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480a110-2166-4590-8674-ea74906f1f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:57.611287 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480a110-2166-4590-8674-ea74906f1f70 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:57.611287 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480a110-2166-4590-8674-ea74906f1f70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:57.611287 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480a110-2166-4590-8674-ea74906f1f70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:57.611975 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480a110-2166-4590-8674-ea74906f1f70 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:57.618042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:57.621692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc364dc-7eb9-49c9-94e0-2c3b7bc701c3 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:57.634580 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 394/797] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:57.636305 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b518c-1931-4da7-bedc-419c1af468ac None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:57.637269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b518c-1931-4da7-bedc-419c1af468ac None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:57.637707 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b518c-1931-4da7-bedc-419c1af468ac None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:57.640250 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 395/798] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:57.641864 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b518c-1931-4da7-bedc-419c1af468ac None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:57.691751 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a9664-cb17-4d23-b1ba-3f7dbc97ce75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:57.694089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a9664-cb17-4d23-b1ba-3f7dbc97ce75 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:57.694777 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a9664-cb17-4d23-b1ba-3f7dbc97ce75 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:57.695326 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a9664-cb17-4d23-b1ba-3f7dbc97ce75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:57.696838 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a9664-cb17-4d23-b1ba-3f7dbc97ce75 None admin] RBAC: Adding query filter params (interface=public, service_id=fc3f884ecb284e759d61f0e65fcc0ebb, region_id=RegionOne) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:57.697459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a9664-cb17-4d23-b1ba-3f7dbc97ce75 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:57.700558 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a9664-cb17-4d23-b1ba-3f7dbc97ce75 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:57.723849 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 404/799] 10.222.0.62 () {56 vars in 1251 bytes} [Tue Oct 4 14:15:57 2022] GET /identity/v3/endpoints?service_id=fc3f884ecb284e759d61f0e65fcc0ebb&interface=public®ion_id=RegionOne => generated 194 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:57.726558 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9421b-cb3d-43ea-85d2-cb55a5f4b7aa None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:57.728328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9421b-cb3d-43ea-85d2-cb55a5f4b7aa None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:57.728903 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9421b-cb3d-43ea-85d2-cb55a5f4b7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:57.771168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-76b9421b-cb3d-43ea-85d2-cb55a5f4b7aa None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:57.774198 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-76b9421b-cb3d-43ea-85d2-cb55a5f4b7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:57.841882 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b518c-1931-4da7-bedc-419c1af468ac None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:57.921693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed7922-ccdf-475d-acd8-dd6c781475f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:57.923039 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed7922-ccdf-475d-acd8-dd6c781475f5 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:57.923826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed7922-ccdf-475d-acd8-dd6c781475f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:57.924523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed7922-ccdf-475d-acd8-dd6c781475f5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:57.940240 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed7922-ccdf-475d-acd8-dd6c781475f5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:57.943703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed7922-ccdf-475d-acd8-dd6c781475f5 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:57.945074 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 405/800] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:15:57.946801 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9421b-cb3d-43ea-85d2-cb55a5f4b7aa None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:57.985159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-e6ed7922-ccdf-475d-acd8-dd6c781475f5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 14:15:57.985159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:57.985159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:57.985159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:57.985159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:57.985159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:57.985159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:57.985159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:57.985159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:57.985159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:57.985159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:57.985159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:57.985159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:15:57.985159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:15:57.985159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:15:57.985159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:15:57.986960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:57.986960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:57.986960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:15:57.986960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:57.986960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:15:57.986960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:15:57.986960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:57.986960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:57.986960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:57.986960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:57.986960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:57.986960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:57.986960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:57.986960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:57.986960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:57.986960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:57.986960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:57.986960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:57.988716 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:57.988716 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:57.988716 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:15:57.988716 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:15:57.988716 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:15:57.988716 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:15:57.988716 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:15:57.988716 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:15:57.988716 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 14:15:57.988716 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:57.996481 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 396/801] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:15:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:15:58.006159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed7922-ccdf-475d-acd8-dd6c781475f5 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:58.071288 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:58.211551 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:58.215679 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9421b-cb3d-43ea-85d2-cb55a5f4b7aa None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:58.279897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d4175-af7d-45a3-ba65-c8282dbf712b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:58.286359 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d4175-af7d-45a3-ba65-c8282dbf712b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:58.286796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d4175-af7d-45a3-ba65-c8282dbf712b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:58.287235 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d4175-af7d-45a3-ba65-c8282dbf712b None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:58.290969 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d4175-af7d-45a3-ba65-c8282dbf712b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:58.293832 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d4175-af7d-45a3-ba65-c8282dbf712b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:58.307113 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 406/802] 10.222.0.62 () {56 vars in 1087 bytes} [Tue Oct 4 14:15:57 2022] GET /identity/v3/services => generated 772 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:58.307419 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed7922-ccdf-475d-acd8-dd6c781475f5 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:58.309202 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49b778-d49d-4700-be62-9e54441f40d4 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:58.309644 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49b778-d49d-4700-be62-9e54441f40d4 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:58.310108 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49b778-d49d-4700-be62-9e54441f40d4 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:58.314815 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 407/803] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:15:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:15:58.323650 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf01f1-57ab-4b69-ae9f-aa5b26a63569 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:58.324060 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf01f1-57ab-4b69-ae9f-aa5b26a63569 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:58.324545 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf01f1-57ab-4b69-ae9f-aa5b26a63569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:58.372742 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-6aaf01f1-57ab-4b69-ae9f-aa5b26a63569 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:15:58.374948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6aaf01f1-57ab-4b69-ae9f-aa5b26a63569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:15:58.426941 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d228b57-69f7-4f1b-851c-3e3539e9e96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:58.428067 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d228b57-69f7-4f1b-851c-3e3539e9e96e None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:58.428555 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d228b57-69f7-4f1b-851c-3e3539e9e96e None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:58.429035 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d228b57-69f7-4f1b-851c-3e3539e9e96e None admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:58.430444 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d228b57-69f7-4f1b-851c-3e3539e9e96e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:58.430975 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d228b57-69f7-4f1b-851c-3e3539e9e96e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:58.433539 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d228b57-69f7-4f1b-851c-3e3539e9e96e None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:58.511911 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 397/804] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Oct 4 14:15:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 507 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:15:58.518136 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d228b57-69f7-4f1b-851c-3e3539e9e96e None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:58.566248 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 408/805] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:15:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 14:15:58.568817 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf01f1-57ab-4b69-ae9f-aa5b26a63569 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:58.646115 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:58.740905 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf01f1-57ab-4b69-ae9f-aa5b26a63569 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:58.792498 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4fc90-9389-4e33-b4ab-24228966e2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:58.793521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4fc90-9389-4e33-b4ab-24228966e2bd None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:58.794040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4fc90-9389-4e33-b4ab-24228966e2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:58.794498 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4fc90-9389-4e33-b4ab-24228966e2bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:58.797727 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d228b57-69f7-4f1b-851c-3e3539e9e96e None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:58.811696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4fc90-9389-4e33-b4ab-24228966e2bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:58.813864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4fc90-9389-4e33-b4ab-24228966e2bd None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:58.833458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-c8f4fc90-9389-4e33-b4ab-24228966e2bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:58.833458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:58.833458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:58.833458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:58.833458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:58.833458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:58.833458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:58.833458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:58.833458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:58.833458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:58.833458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:58.833458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:58.833458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:58.833458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:58.833458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:58.833458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:58.834481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:58.834481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:58.834481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:58.834481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:58.834481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:58.834481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:58.834481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:58.834481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:58.834481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:58.834481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:58.834481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:58.834481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:58.834481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:58.834481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:58.834481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:58.834481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:58.834481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:58.835383 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:58.835383 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:58.835383 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:58.837681 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 409/806] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:58.845140 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4fc90-9389-4e33-b4ab-24228966e2bd None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:58.860828 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:58.947622 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc71be7-3a42-460b-9099-f1aead5d19a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:58.948306 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc71be7-3a42-460b-9099-f1aead5d19a5 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:58.948762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc71be7-3a42-460b-9099-f1aead5d19a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:58.949235 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc71be7-3a42-460b-9099-f1aead5d19a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:58.955006 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:58.979443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4fc90-9389-4e33-b4ab-24228966e2bd None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:58.997663 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc71be7-3a42-460b-9099-f1aead5d19a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:15:59.016633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-acc71be7-3a42-460b-9099-f1aead5d19a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:15:59.016633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:59.016633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:59.016633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:59.016633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:59.016633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:59.016633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:59.016633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:59.016633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:59.016633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:59.016633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:59.016633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:59.016633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:15:59.016633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:15:59.016633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:15:59.016633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:15:59.017662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:15:59.017662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:15:59.017662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:15:59.017662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:15:59.017662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:59.017662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:59.017662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:59.017662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:59.017662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:59.017662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:59.017662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:59.017662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:59.017662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:59.017662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:59.017662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:59.017662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:59.018507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:59.018507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:59.018507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:59.018507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:59.018507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:15:59.018507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:15:59.018507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:15:59.018507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:15:59.018507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:15:59.018507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:15:59.018507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:15:59.018507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:59.031771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 398/807] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:15:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 507 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:59.031771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc71be7-3a42-460b-9099-f1aead5d19a5 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:59.040216 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e9564-6fbb-4ef0-8ca6-2734ea64dbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:59.041277 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e9564-6fbb-4ef0-8ca6-2734ea64dbd8 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:59.041754 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e9564-6fbb-4ef0-8ca6-2734ea64dbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:59.042224 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e9564-6fbb-4ef0-8ca6-2734ea64dbd8 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:59.043400 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e9564-6fbb-4ef0-8ca6-2734ea64dbd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:59.043962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e9564-6fbb-4ef0-8ca6-2734ea64dbd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:59.047432 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e9564-6fbb-4ef0-8ca6-2734ea64dbd8 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:59.070353 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 410/808] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:15:59.072048 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e9564-6fbb-4ef0-8ca6-2734ea64dbd8 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:59.201233 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc71be7-3a42-460b-9099-f1aead5d19a5 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:59.258218 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ae92f-0a51-4565-9306-b3490f592002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:59.259070 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ae92f-0a51-4565-9306-b3490f592002 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:59.259450 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ae92f-0a51-4565-9306-b3490f592002 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:59.264722 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ae92f-0a51-4565-9306-b3490f592002 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:59.265966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ae92f-0a51-4565-9306-b3490f592002 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:59.266486 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ae92f-0a51-4565-9306-b3490f592002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:59.268561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ae92f-0a51-4565-9306-b3490f592002 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:59.292327 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 399/809] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:15:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:59.293862 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ae92f-0a51-4565-9306-b3490f592002 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:59.312303 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e9564-6fbb-4ef0-8ca6-2734ea64dbd8 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:59.368000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305de5e5-0d96-4f8d-8b14-e4e98423dca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:59.368860 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305de5e5-0d96-4f8d-8b14-e4e98423dca1 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:59.369230 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305de5e5-0d96-4f8d-8b14-e4e98423dca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:59.369568 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305de5e5-0d96-4f8d-8b14-e4e98423dca1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:59.370180 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305de5e5-0d96-4f8d-8b14-e4e98423dca1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:59.371664 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305de5e5-0d96-4f8d-8b14-e4e98423dca1 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:59.384527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-305de5e5-0d96-4f8d-8b14-e4e98423dca1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 14:15:59.384527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:59.384527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:15:59.384527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:15:59.384527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:15:59.384527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:15:59.384527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:15:59.384527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:15:59.384527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 14:15:59.384527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:59.384527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:15:59.384527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:59.384527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:59.384527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:59.384527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:59.384527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:59.384527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:59.385741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:59.385741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:59.385741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:59.385741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:59.385741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:59.385741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:59.385741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:15:59.385741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:15:59.385741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:15:59.385741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:15:59.385741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:59.385741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:59.385741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:59.385741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:59.385741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:59.385741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:59.387035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:59.387035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:59.387035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:59.387035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:59.387035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:59.387035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:59.387035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:59.387035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:59.387035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:59.387035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:59.387035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:15:59.387035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:15:59.387035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 14:15:59.387035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:59.387035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 411/810] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Oct 4 14:15:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:59.388845 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305de5e5-0d96-4f8d-8b14-e4e98423dca1 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:59.393667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:59.406435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:59.540695 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ae92f-0a51-4565-9306-b3490f592002 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:59.628456 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b963f-0c02-43ce-aec5-87096c0cb1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:59.629514 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b963f-0c02-43ce-aec5-87096c0cb1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:59.630052 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b963f-0c02-43ce-aec5-87096c0cb1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:59.630507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b963f-0c02-43ce-aec5-87096c0cb1d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:59.630949 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305de5e5-0d96-4f8d-8b14-e4e98423dca1 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:59.645651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b963f-0c02-43ce-aec5-87096c0cb1d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:59.648487 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b963f-0c02-43ce-aec5-87096c0cb1d0 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:59.674904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-d80b963f-0c02-43ce-aec5-87096c0cb1d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:59.674904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:59.674904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:59.674904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:59.674904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:59.674904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:59.674904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:59.674904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:59.674904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:59.674904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:59.674904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:59.674904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:59.674904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:15:59.674904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:15:59.674904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:15:59.677112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:15:59.677112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:59.677112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:59.677112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:59.677112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:59.677112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:59.677112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:59.677112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:59.677112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:59.677112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:59.677112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:59.677112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:59.677112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:59.677112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:59.677112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:59.677112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:59.677112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:59.679272 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:15:59.679272 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:15:59.679272 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:15:59.679272 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:15:59.679272 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:15:59.679272 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:15:59.679272 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:15:59.679272 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:15:59.679272 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 400/811] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:15:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:59.679272 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b963f-0c02-43ce-aec5-87096c0cb1d0 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:59.708953 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd6885-1dae-4e11-a70b-4a432650008c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:59.710064 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd6885-1dae-4e11-a70b-4a432650008c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:59.710549 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd6885-1dae-4e11-a70b-4a432650008c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:59.711004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd6885-1dae-4e11-a70b-4a432650008c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:59.745209 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd6885-1dae-4e11-a70b-4a432650008c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:59.748170 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd6885-1dae-4e11-a70b-4a432650008c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:59.777581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-78fd6885-1dae-4e11-a70b-4a432650008c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:59.777581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:15:59.777581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:15:59.777581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:15:59.777581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:15:59.777581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:15:59.777581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:15:59.777581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:15:59.777581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:15:59.777581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:15:59.777581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:15:59.777581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:15:59.777581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:15:59.777581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:15:59.777581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:15:59.777581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:15:59.780459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:15:59.780459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:15:59.780459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:15:59.780459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:15:59.780459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:15:59.780459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:15:59.780459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:15:59.780459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:15:59.780459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:15:59.780459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:15:59.780459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:15:59.780459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:15:59.780459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:15:59.780459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:15:59.780459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:15:59.780459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:15:59.780459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:15:59.784722 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:15:59.784722 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:15:59.784722 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:15:59.784722 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 412/812] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:15:59.784722 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd6885-1dae-4e11-a70b-4a432650008c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:59.854558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:59.863773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b963f-0c02-43ce-aec5-87096c0cb1d0 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:15:59.899081 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:15:59.907441 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cc9cc-8971-497a-9fa0-a998d46e539c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:15:59.908509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cc9cc-8971-497a-9fa0-a998d46e539c None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:15:59.909033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cc9cc-8971-497a-9fa0-a998d46e539c None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:15:59.909488 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cc9cc-8971-497a-9fa0-a998d46e539c None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:15:59.910372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cc9cc-8971-497a-9fa0-a998d46e539c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:15:59.910897 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cc9cc-8971-497a-9fa0-a998d46e539c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:15:59.912731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cc9cc-8971-497a-9fa0-a998d46e539c None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:15:59.918218 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 401/813] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Oct 4 14:15:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:15:59.919577 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cc9cc-8971-497a-9fa0-a998d46e539c None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:15:59.990062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd6885-1dae-4e11-a70b-4a432650008c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:00.047293 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cc9cc-8971-497a-9fa0-a998d46e539c None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:00.062114 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b1bf0-9f12-4095-b0a7-69e469b3457a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:00.063338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b1bf0-9f12-4095-b0a7-69e469b3457a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:00.064180 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b1bf0-9f12-4095-b0a7-69e469b3457a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:00.065153 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b1bf0-9f12-4095-b0a7-69e469b3457a None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:00.066459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b1bf0-9f12-4095-b0a7-69e469b3457a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:00.066993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b1bf0-9f12-4095-b0a7-69e469b3457a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:00.070331 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b1bf0-9f12-4095-b0a7-69e469b3457a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:00.093449 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057975d-9361-4d6b-bcfe-8960ab81d28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:00.094098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057975d-9361-4d6b-bcfe-8960ab81d28b None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:00.094381 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057975d-9361-4d6b-bcfe-8960ab81d28b None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:00.094660 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057975d-9361-4d6b-bcfe-8960ab81d28b None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:00.095328 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057975d-9361-4d6b-bcfe-8960ab81d28b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:00.095632 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057975d-9361-4d6b-bcfe-8960ab81d28b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:00.096714 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 413/814] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:15:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:00.097844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b1bf0-9f12-4095-b0a7-69e469b3457a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:00.102500 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057975d-9361-4d6b-bcfe-8960ab81d28b None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:00.124660 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 402/815] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:00.125572 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057975d-9361-4d6b-bcfe-8960ab81d28b None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:00.173004 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:00.295355 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b1bf0-9f12-4095-b0a7-69e469b3457a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:00.325098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057975d-9361-4d6b-bcfe-8960ab81d28b None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:00.326567 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:00.352378 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854aefe-df96-489e-a27c-9786eac0a703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:00.353350 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854aefe-df96-489e-a27c-9786eac0a703 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:00.353844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854aefe-df96-489e-a27c-9786eac0a703 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:00.354447 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854aefe-df96-489e-a27c-9786eac0a703 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:00.355266 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854aefe-df96-489e-a27c-9786eac0a703 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:00.355778 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854aefe-df96-489e-a27c-9786eac0a703 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:00.357942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854aefe-df96-489e-a27c-9786eac0a703 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:00.367945 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 414/816] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Oct 4 14:16:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:00.369077 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854aefe-df96-489e-a27c-9786eac0a703 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:00.380269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb3df6-a43f-4991-854f-2080a8801fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:00.381765 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb3df6-a43f-4991-854f-2080a8801fbe None admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:00.382519 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb3df6-a43f-4991-854f-2080a8801fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:00.383256 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb3df6-a43f-4991-854f-2080a8801fbe None admin] PATH_INFO: `/v3/projects/fd73ece314ef4f2eabb34e2a88d610ba/users/4860d5958e724e568576a9067290a27e/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:00.386816 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb3df6-a43f-4991-854f-2080a8801fbe None admin] RBAC: Authorizing `identity:create_grant(project_id=fd73ece314ef4f2eabb34e2a88d610ba, user_id=4860d5958e724e568576a9067290a27e, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:00.390809 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb3df6-a43f-4991-854f-2080a8801fbe None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:00.416040 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 403/817] 10.222.0.62 () {58 vars in 1439 bytes} [Tue Oct 4 14:16:00 2022] PUT /identity/v3/projects/fd73ece314ef4f2eabb34e2a88d610ba/users/4860d5958e724e568576a9067290a27e/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:16:00.419528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca77556-d617-45ab-991f-74c6a7497a37 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:00.422153 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca77556-d617-45ab-991f-74c6a7497a37 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:00.423082 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca77556-d617-45ab-991f-74c6a7497a37 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:00.425709 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 404/818] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:16:00.427778 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca77556-d617-45ab-991f-74c6a7497a37 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:00.588963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854aefe-df96-489e-a27c-9786eac0a703 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:00.602007 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:00.650506 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca77556-d617-45ab-991f-74c6a7497a37 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:00.671445 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265ce6a-1831-41b8-844d-75eff7b3a0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:00.672846 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265ce6a-1831-41b8-844d-75eff7b3a0dd None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:00.672846 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265ce6a-1831-41b8-844d-75eff7b3a0dd None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:00.673246 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265ce6a-1831-41b8-844d-75eff7b3a0dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:00.690319 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265ce6a-1831-41b8-844d-75eff7b3a0dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:00.692472 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265ce6a-1831-41b8-844d-75eff7b3a0dd None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:00.705128 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeed9f7-ebff-47af-b63e-801a123d84ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:00.705772 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeed9f7-ebff-47af-b63e-801a123d84ff None admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:00.706051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeed9f7-ebff-47af-b63e-801a123d84ff None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:00.706322 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeed9f7-ebff-47af-b63e-801a123d84ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:00.707022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeed9f7-ebff-47af-b63e-801a123d84ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:00.708510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeed9f7-ebff-47af-b63e-801a123d84ff None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:00.727439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-3265ce6a-1831-41b8-844d-75eff7b3a0dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 14:16:00.727439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:00.727439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:00.727439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:00.727439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:00.727439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:00.727439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:00.727439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:00.727439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:00.727439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:00.727439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:00.727439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:00.727439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:16:00.727439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:16:00.727439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:16:00.727439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:16:00.728576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:00.728576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:00.728576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:16:00.728576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:16:00.728576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:16:00.728576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:16:00.728576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:00.728576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:00.728576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:00.728576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:00.728576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:00.728576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:00.728576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:00.728576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:00.728576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:00.728576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:00.728576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:00.728576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:00.729534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:00.729534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:00.729534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:16:00.729534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:16:00.729534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:16:00.729534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:16:00.729534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:16:00.729534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:16:00.729534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 14:16:00.729534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:00.731765 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 415/819] 10.222.0.62 () {56 vars in 1093 bytes} [Tue Oct 4 14:16:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:00.734317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55051c-3983-49d8-ad92-0ceb40c3e8b1 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:00.734799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55051c-3983-49d8-ad92-0ceb40c3e8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:00.736194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 405/820] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:16:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:16:00.740707 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55051c-3983-49d8-ad92-0ceb40c3e8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:00.750306 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeed9f7-ebff-47af-b63e-801a123d84ff None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:00.806053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-4d55051c-3983-49d8-ad92-0ceb40c3e8b1 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:00.808533 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4d55051c-3983-49d8-ad92-0ceb40c3e8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:00.906356 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:01.001561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeed9f7-ebff-47af-b63e-801a123d84ff None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:01.004792 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 416/821] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:16:01.054362 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c991591-3199-48f4-8222-6442766d56af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:01.054993 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c991591-3199-48f4-8222-6442766d56af None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:01.055272 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c991591-3199-48f4-8222-6442766d56af None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:01.055542 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c991591-3199-48f4-8222-6442766d56af None admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:01.056381 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c991591-3199-48f4-8222-6442766d56af None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:01.056698 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c991591-3199-48f4-8222-6442766d56af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:01.058398 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c991591-3199-48f4-8222-6442766d56af None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:01.062030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:01.087905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 406/822] 10.222.0.62 () {56 vars in 1133 bytes} [Tue Oct 4 14:16:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:01.097652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55051c-3983-49d8-ad92-0ceb40c3e8b1 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:01.278742 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55051c-3983-49d8-ad92-0ceb40c3e8b1 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:01.293681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d52cc9-78d4-4078-bf9f-411473aaf37c None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:01.294033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d52cc9-78d4-4078-bf9f-411473aaf37c None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:01.294396 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d52cc9-78d4-4078-bf9f-411473aaf37c None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:01.296707 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 407/823] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:16:01.302492 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f46860-941b-46f5-825a-92b09475acd4 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:01.302799 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f46860-941b-46f5-825a-92b09475acd4 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:01.303042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f46860-941b-46f5-825a-92b09475acd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:01.329440 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-c5f46860-941b-46f5-825a-92b09475acd4 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:01.330733 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-c5f46860-941b-46f5-825a-92b09475acd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:01.331986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe60644-f171-4d08-bdf8-f57bb7a9cedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:01.332620 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe60644-f171-4d08-bdf8-f57bb7a9cedc None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:01.332904 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe60644-f171-4d08-bdf8-f57bb7a9cedc None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:01.333175 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe60644-f171-4d08-bdf8-f57bb7a9cedc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:01.382770 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:01.423192 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe60644-f171-4d08-bdf8-f57bb7a9cedc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:01.425070 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe60644-f171-4d08-bdf8-f57bb7a9cedc None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:01.430674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 408/824] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:16:01.431678 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f46860-941b-46f5-825a-92b09475acd4 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:01.591687 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 417/825] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:16:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 14:16:01.600637 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe60644-f171-4d08-bdf8-f57bb7a9cedc None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:01.643020 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f46860-941b-46f5-825a-92b09475acd4 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:01.675527 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:01.690432 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36019913-1a18-4224-ad15-c842126436bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:01.691174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36019913-1a18-4224-ad15-c842126436bb None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:01.691461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36019913-1a18-4224-ad15-c842126436bb None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:01.691763 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36019913-1a18-4224-ad15-c842126436bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:01.705270 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36019913-1a18-4224-ad15-c842126436bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:16:01.710394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-36019913-1a18-4224-ad15-c842126436bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:16:01.710394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:01.710394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:01.710394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:01.710394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:01.710394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:01.710394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:01.710394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:01.710394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:01.710394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:01.710394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:01.710394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:01.710394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:16:01.710394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:16:01.710394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:16:01.710394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:16:01.711403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:16:01.711403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:16:01.711403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:16:01.711403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:16:01.711403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:01.711403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:01.711403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:01.711403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:01.711403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:01.711403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:01.711403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:01.711403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:01.711403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:01.711403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:01.711403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:01.711403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:01.712320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:01.712320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:01.712320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:01.712320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:01.712320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:16:01.712320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:16:01.712320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:16:01.712320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:16:01.712320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:16:01.712320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:16:01.712320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:16:01.712320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:01.716100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 409/826] 10.222.0.62 () {56 vars in 1102 bytes} [Tue Oct 4 14:16:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:01.718824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36019913-1a18-4224-ad15-c842126436bb None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:01.808404 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:01.848723 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36019913-1a18-4224-ad15-c842126436bb None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:01.876170 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe60644-f171-4d08-bdf8-f57bb7a9cedc None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:01.898239 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d317e6-76cf-48fe-93d7-3d3d09c83e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:01.899384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d317e6-76cf-48fe-93d7-3d3d09c83e12 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:01.899666 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d317e6-76cf-48fe-93d7-3d3d09c83e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:01.899990 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d317e6-76cf-48fe-93d7-3d3d09c83e12 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:01.900688 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d317e6-76cf-48fe-93d7-3d3d09c83e12 None admin] RBAC: Adding query filter params (name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:01.900995 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d317e6-76cf-48fe-93d7-3d3d09c83e12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:01.903185 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d317e6-76cf-48fe-93d7-3d3d09c83e12 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:01.916769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 410/827] 10.222.0.62 () {56 vars in 1103 bytes} [Tue Oct 4 14:16:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:01.917703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d317e6-76cf-48fe-93d7-3d3d09c83e12 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:01.921590 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9e76f-97c3-4bbb-aa87-b748d05bf98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:01.922253 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9e76f-97c3-4bbb-aa87-b748d05bf98b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:01.922533 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9e76f-97c3-4bbb-aa87-b748d05bf98b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:01.922803 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9e76f-97c3-4bbb-aa87-b748d05bf98b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:01.941043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9e76f-97c3-4bbb-aa87-b748d05bf98b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:01.942536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9e76f-97c3-4bbb-aa87-b748d05bf98b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:01.963351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-7cd9e76f-97c3-4bbb-aa87-b748d05bf98b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:01.963351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:01.963351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:01.963351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:01.963351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:01.963351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:01.963351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:01.963351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:01.963351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:01.963351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:01.963351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:01.963351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:01.963351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:16:01.963351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:16:01.963351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:16:01.963351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:16:01.964414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:01.964414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:01.964414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:01.964414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:01.964414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:01.964414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:01.964414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:01.964414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:01.964414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:01.964414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:01.964414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:01.964414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:01.964414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:01.964414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:01.964414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:01.964414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:01.964414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:16:01.965528 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:16:01.965528 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:01.965528 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:01.965528 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 418/828] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:01.967479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9e76f-97c3-4bbb-aa87-b748d05bf98b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:01.990205 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:02.057385 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d317e6-76cf-48fe-93d7-3d3d09c83e12 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:02.098191 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6948de6-1aa3-43fa-b3d3-777f1d3cf490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:02.099226 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6948de6-1aa3-43fa-b3d3-777f1d3cf490 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:02.099747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6948de6-1aa3-43fa-b3d3-777f1d3cf490 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:02.100241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6948de6-1aa3-43fa-b3d3-777f1d3cf490 None admin] PATH_INFO: `/v3/services/network` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:02.101084 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6948de6-1aa3-43fa-b3d3-777f1d3cf490 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:02.102731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6948de6-1aa3-43fa-b3d3-777f1d3cf490 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:02.114518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-b6948de6-1aa3-43fa-b3d3-777f1d3cf490 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 14:16:02.114518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:02.114518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:16:02.114518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:16:02.114518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:16:02.114518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:16:02.114518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:16:02.114518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:02.114518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 14:16:02.114518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:02.114518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:16:02.114518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:02.114518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:02.114518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:02.114518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:02.114518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:02.114518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:02.115585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:02.115585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:02.115585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:02.115585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:02.115585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:02.115585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:02.115585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:16:02.115585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:16:02.115585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:16:02.115585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:16:02.115585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:02.115585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:02.115585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:02.115585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:02.115585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:02.115585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:02.116563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:02.116563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:02.116563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:02.116563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:02.116563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:02.116563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:02.116563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:02.116563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:02.116563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:02.116563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:02.116563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:16:02.116563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:02.116563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 14:16:02.116563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:02.117300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9e76f-97c3-4bbb-aa87-b748d05bf98b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:02.124223 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 411/829] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:16:01 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:02.126355 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6948de6-1aa3-43fa-b3d3-777f1d3cf490 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:02.141340 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:02.164641 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b421beb-879b-49c1-b4ec-eed1daac2d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:02.165346 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b421beb-879b-49c1-b4ec-eed1daac2d9b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:02.165624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b421beb-879b-49c1-b4ec-eed1daac2d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:02.165897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b421beb-879b-49c1-b4ec-eed1daac2d9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:02.180412 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b421beb-879b-49c1-b4ec-eed1daac2d9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:02.181980 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b421beb-879b-49c1-b4ec-eed1daac2d9b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:02.202672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-5b421beb-879b-49c1-b4ec-eed1daac2d9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:02.202672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:02.202672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:02.202672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:02.202672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:02.202672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:02.202672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:02.202672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:02.202672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:02.202672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:02.202672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:02.202672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:02.202672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:16:02.202672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:16:02.202672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:16:02.202672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:16:02.203760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:02.203760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:02.203760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:02.203760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:02.203760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:02.203760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:02.203760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:02.203760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:02.203760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:02.203760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:02.203760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:02.203760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:02.203760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:02.203760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:02.203760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:02.203760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:02.203760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:16:02.204766 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:16:02.204766 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:02.204766 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:02.207843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 419/830] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:02.209083 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b421beb-879b-49c1-b4ec-eed1daac2d9b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:02.256780 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6948de6-1aa3-43fa-b3d3-777f1d3cf490 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:02.286488 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:02.340323 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354fa95-4d63-40d1-8f8b-bf984cb8bbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:02.343610 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354fa95-4d63-40d1-8f8b-bf984cb8bbe0 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:02.344471 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354fa95-4d63-40d1-8f8b-bf984cb8bbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:02.345223 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354fa95-4d63-40d1-8f8b-bf984cb8bbe0 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:02.346681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354fa95-4d63-40d1-8f8b-bf984cb8bbe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:02.347494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354fa95-4d63-40d1-8f8b-bf984cb8bbe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:02.350669 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354fa95-4d63-40d1-8f8b-bf984cb8bbe0 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:02.374533 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 412/831] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:02.376576 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354fa95-4d63-40d1-8f8b-bf984cb8bbe0 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:02.387737 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b421beb-879b-49c1-b4ec-eed1daac2d9b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:02.432249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62338b-164e-49a9-8a5d-41a8e5db95fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:02.432886 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62338b-164e-49a9-8a5d-41a8e5db95fc None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:02.433153 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62338b-164e-49a9-8a5d-41a8e5db95fc None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:02.433426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62338b-164e-49a9-8a5d-41a8e5db95fc None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:02.434080 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62338b-164e-49a9-8a5d-41a8e5db95fc None admin] RBAC: Adding query filter params (name=network) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:02.434378 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62338b-164e-49a9-8a5d-41a8e5db95fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:02.435995 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62338b-164e-49a9-8a5d-41a8e5db95fc None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:02.447760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 420/832] 10.222.0.62 () {56 vars in 1112 bytes} [Tue Oct 4 14:16:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:02.447760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62338b-164e-49a9-8a5d-41a8e5db95fc None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:02.492589 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:02.621741 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354fa95-4d63-40d1-8f8b-bf984cb8bbe0 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:02.635036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62338b-164e-49a9-8a5d-41a8e5db95fc None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:02.703518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dcf2f-28bf-4073-bf87-f0165a98adf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:02.704362 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dcf2f-28bf-4073-bf87-f0165a98adf6 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:02.704362 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dcf2f-28bf-4073-bf87-f0165a98adf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:02.704362 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dcf2f-28bf-4073-bf87-f0165a98adf6 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:02.705064 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469dcf2f-28bf-4073-bf87-f0165a98adf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:02.705638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469dcf2f-28bf-4073-bf87-f0165a98adf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:02.707889 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469dcf2f-28bf-4073-bf87-f0165a98adf6 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:02.716183 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf71bf1-1020-40ec-b902-1eaab62245e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:02.717710 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf71bf1-1020-40ec-b902-1eaab62245e8 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:02.718181 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf71bf1-1020-40ec-b902-1eaab62245e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:02.718627 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf71bf1-1020-40ec-b902-1eaab62245e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:02.735924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 413/833] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:02.735924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dcf2f-28bf-4073-bf87-f0165a98adf6 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:02.737238 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf71bf1-1020-40ec-b902-1eaab62245e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:02.739855 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf71bf1-1020-40ec-b902-1eaab62245e8 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:02.762271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-cbf71bf1-1020-40ec-b902-1eaab62245e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:16:02.762271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:02.762271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:02.762271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:02.762271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:02.762271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:02.762271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:02.762271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:02.762271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:02.762271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:02.762271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:02.762271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:02.762271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:16:02.762271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:16:02.762271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:16:02.763333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:16:02.763333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:02.763333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:02.763333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:02.763333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:02.763333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:02.763333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:02.763333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:02.763333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:02.763333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:02.763333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:02.763333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:02.763333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:02.763333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:02.763333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:02.763333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:02.763333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:02.764321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:16:02.764321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:16:02.764321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:16:02.764321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:16:02.764321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:16:02.764321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:16:02.764321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:16:02.764321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:02.767824 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 421/834] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:16:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:02.769201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf71bf1-1020-40ec-b902-1eaab62245e8 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:02.789357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:02.883487 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dcf2f-28bf-4073-bf87-f0165a98adf6 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:02.900136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf71bf1-1020-40ec-b902-1eaab62245e8 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:02.905299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:02.937331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd370b20-64b7-454f-a1ec-0e01acb1a30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:02.939255 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd370b20-64b7-454f-a1ec-0e01acb1a30d None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:02.939957 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd370b20-64b7-454f-a1ec-0e01acb1a30d None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:02.940564 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd370b20-64b7-454f-a1ec-0e01acb1a30d None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:02.941530 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd370b20-64b7-454f-a1ec-0e01acb1a30d None admin] RBAC: Adding query filter params (type=network) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:02.942036 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd370b20-64b7-454f-a1ec-0e01acb1a30d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:02.943880 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd370b20-64b7-454f-a1ec-0e01acb1a30d None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:02.945371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf82712-c837-456b-8160-389d9e620250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:02.946341 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf82712-c837-456b-8160-389d9e620250 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:02.946684 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf82712-c837-456b-8160-389d9e620250 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:02.947025 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf82712-c837-456b-8160-389d9e620250 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:02.952123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 414/835] 10.222.0.62 () {56 vars in 1112 bytes} [Tue Oct 4 14:16:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:02.953324 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd370b20-64b7-454f-a1ec-0e01acb1a30d None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:02.958039 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf82712-c837-456b-8160-389d9e620250 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:02.959001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf82712-c837-456b-8160-389d9e620250 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:02.983237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-8cf82712-c837-456b-8160-389d9e620250 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 14:16:02.983237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:02.983237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:02.983237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:02.983237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:02.983237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:02.983237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:02.983237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:02.983237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:02.983237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:02.983237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:02.983237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:02.983237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:16:02.983237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:16:02.983237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:16:02.983237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:16:02.984392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:02.984392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:02.984392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:16:02.984392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:16:02.984392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:16:02.984392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:16:02.984392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:02.984392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:02.984392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:02.984392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:02.984392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:02.984392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:02.984392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:02.984392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:02.984392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:02.984392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:02.984392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:02.984392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:02.985344 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:02.985344 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:02.985344 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:16:02.985344 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:16:02.985344 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:16:02.985344 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:16:02.985344 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:16:02.985344 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:16:02.985344 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 14:16:02.985344 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:02.992433 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 422/836] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Oct 4 14:16:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:02.994312 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf82712-c837-456b-8160-389d9e620250 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:03.089051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:03.098609 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd370b20-64b7-454f-a1ec-0e01acb1a30d None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:03.147162 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9d7d2-53b9-40f1-9aa3-bd9f10665bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:03.148254 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9d7d2-53b9-40f1-9aa3-bd9f10665bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:03.148785 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9d7d2-53b9-40f1-9aa3-bd9f10665bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:03.149284 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9d7d2-53b9-40f1-9aa3-bd9f10665bb3 None admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:03.150840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9d7d2-53b9-40f1-9aa3-bd9f10665bb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:03.151391 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9d7d2-53b9-40f1-9aa3-bd9f10665bb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:03.153101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9d7d2-53b9-40f1-9aa3-bd9f10665bb3 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:03.167784 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 415/837] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:16:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:03.169088 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9d7d2-53b9-40f1-9aa3-bd9f10665bb3 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:03.206060 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf82712-c837-456b-8160-389d9e620250 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:03.268544 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95378f-db49-42a3-91c4-1f3182d90044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:03.269223 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95378f-db49-42a3-91c4-1f3182d90044 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:03.269502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95378f-db49-42a3-91c4-1f3182d90044 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:03.269780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95378f-db49-42a3-91c4-1f3182d90044 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:03.270481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95378f-db49-42a3-91c4-1f3182d90044 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:03.272071 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95378f-db49-42a3-91c4-1f3182d90044 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:03.300572 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 423/838] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:16:02 2022] POST /identity/v3/endpoints => generated 337 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:16:03.301731 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95378f-db49-42a3-91c4-1f3182d90044 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:03.316473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9d7d2-53b9-40f1-9aa3-bd9f10665bb3 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:03.333163 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:03.380755 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19b423-1237-435a-b345-7970354f1a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:03.382596 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19b423-1237-435a-b345-7970354f1a42 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:03.383131 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19b423-1237-435a-b345-7970354f1a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:03.383616 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19b423-1237-435a-b345-7970354f1a42 None admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:03.384669 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19b423-1237-435a-b345-7970354f1a42 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:03.385191 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19b423-1237-435a-b345-7970354f1a42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:03.386944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19b423-1237-435a-b345-7970354f1a42 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:03.414988 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 416/839] 10.222.0.62 () {56 vars in 1149 bytes} [Tue Oct 4 14:16:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:03.423759 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19b423-1237-435a-b345-7970354f1a42 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:03.443440 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:03.518006 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95378f-db49-42a3-91c4-1f3182d90044 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:03.602522 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e4335-8d48-4b41-9fcc-cdedb7bb67df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:03.603610 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e4335-8d48-4b41-9fcc-cdedb7bb67df None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:03.604144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e4335-8d48-4b41-9fcc-cdedb7bb67df None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:03.604622 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e4335-8d48-4b41-9fcc-cdedb7bb67df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:03.605785 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e4335-8d48-4b41-9fcc-cdedb7bb67df None admin] RBAC: Adding query filter params (role.id=a16b6daeda5b4a67992f3c12514ca90e, scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba, user.id=151e7b9c7a7b46d58dc2f563d05775e2) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:03.606308 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e4335-8d48-4b41-9fcc-cdedb7bb67df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:03.608848 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e4335-8d48-4b41-9fcc-cdedb7bb67df None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:03.627291 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 424/840] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:16:03 2022] GET /identity/v3/role_assignments?user.id=151e7b9c7a7b46d58dc2f563d05775e2&scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba&role.id=a16b6daeda5b4a67992f3c12514ca90e => generated 608 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:03.698583 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19b423-1237-435a-b345-7970354f1a42 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:03.774696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8260f-db92-4fc8-8c6b-1938d5b89f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:03.775873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8260f-db92-4fc8-8c6b-1938d5b89f2c None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:03.776354 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8260f-db92-4fc8-8c6b-1938d5b89f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:03.776825 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8260f-db92-4fc8-8c6b-1938d5b89f2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:03.913113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8260f-db92-4fc8-8c6b-1938d5b89f2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:03.914826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8260f-db92-4fc8-8c6b-1938d5b89f2c None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:03.928050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:04.021269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79933db8-ca27-467c-8e37-b80213a1e1f8 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:04.022123 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79933db8-ca27-467c-8e37-b80213a1e1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:04.022123 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79933db8-ca27-467c-8e37-b80213a1e1f8 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:04.023516 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 425/841] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:16:04.030048 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c39fc-d058-4212-a283-b968fa8a3f9b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:04.030319 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c39fc-d058-4212-a283-b968fa8a3f9b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:04.030633 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c39fc-d058-4212-a283-b968fa8a3f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:04.055736 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-849c39fc-d058-4212-a283-b968fa8a3f9b None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:04.057253 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-849c39fc-d058-4212-a283-b968fa8a3f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:04.063485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 417/842] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:16:03 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 14:16:04.065105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fff22c-2573-41a5-abc8-cd6c2f6414f1 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:04.065391 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fff22c-2573-41a5-abc8-cd6c2f6414f1 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:04.065669 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fff22c-2573-41a5-abc8-cd6c2f6414f1 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:04.067074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 418/843] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:16:04.072348 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fff22c-2573-41a5-abc8-cd6c2f6414f1 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:04.160102 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 426/844] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:16:04.162321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe889d8c-14d3-4a6f-bd9e-3c9483f418ed None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:04.162806 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe889d8c-14d3-4a6f-bd9e-3c9483f418ed None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:04.163288 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe889d8c-14d3-4a6f-bd9e-3c9483f418ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:04.195926 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:04.209714 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-fe889d8c-14d3-4a6f-bd9e-3c9483f418ed None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:04.212257 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-fe889d8c-14d3-4a6f-bd9e-3c9483f418ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:04.278039 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fff22c-2573-41a5-abc8-cd6c2f6414f1 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:04.293741 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:04.347523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d046be-bc9b-4909-afa7-76e81fcfdf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:04.348591 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d046be-bc9b-4909-afa7-76e81fcfdf76 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:04.350623 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d046be-bc9b-4909-afa7-76e81fcfdf76 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:04.350623 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d046be-bc9b-4909-afa7-76e81fcfdf76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:04.376208 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d046be-bc9b-4909-afa7-76e81fcfdf76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:04.380297 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d046be-bc9b-4909-afa7-76e81fcfdf76 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:04.392288 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 427/845] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:16:04.413528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-f6d046be-bc9b-4909-afa7-76e81fcfdf76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:04.413528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:04.413528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:04.413528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:04.413528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:04.413528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:04.413528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:04.413528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:04.413528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:04.413528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:04.413528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:04.413528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:04.413528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:16:04.413528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:16:04.413528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:16:04.413528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:16:04.415874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:04.415874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:04.415874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:04.415874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:04.415874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:04.415874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:04.415874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:04.415874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:04.415874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:04.415874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:04.415874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:04.415874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:04.415874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:04.415874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:04.415874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:04.415874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:04.415874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:16:04.417592 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:16:04.417592 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:04.417592 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:04.421756 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 419/846] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:16:04.431860 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe889d8c-14d3-4a6f-bd9e-3c9483f418ed None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:04.518744 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d046be-bc9b-4909-afa7-76e81fcfdf76 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:04.632801 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe889d8c-14d3-4a6f-bd9e-3c9483f418ed None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:04.681978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022bcf7-7851-4eda-af4e-5d100e538837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:04.682588 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022bcf7-7851-4eda-af4e-5d100e538837 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:04.682921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022bcf7-7851-4eda-af4e-5d100e538837 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:04.683304 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022bcf7-7851-4eda-af4e-5d100e538837 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:04.684086 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022bcf7-7851-4eda-af4e-5d100e538837 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:04.684525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022bcf7-7851-4eda-af4e-5d100e538837 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:04.686932 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022bcf7-7851-4eda-af4e-5d100e538837 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:04.690592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:04.712217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 428/847] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:04.716959 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022bcf7-7851-4eda-af4e-5d100e538837 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:04.741659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d046be-bc9b-4909-afa7-76e81fcfdf76 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:04.794554 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bae0c-899d-4a1f-a0b3-40ac66f541a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:04.795629 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bae0c-899d-4a1f-a0b3-40ac66f541a0 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:04.796243 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bae0c-899d-4a1f-a0b3-40ac66f541a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:04.796765 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bae0c-899d-4a1f-a0b3-40ac66f541a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:04.810175 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bae0c-899d-4a1f-a0b3-40ac66f541a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:16:04.816731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-ab9bae0c-899d-4a1f-a0b3-40ac66f541a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:16:04.816731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:04.816731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:04.816731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:04.816731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:04.816731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:04.816731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:04.816731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:04.816731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:04.816731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:04.816731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:04.816731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:04.816731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:16:04.816731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:16:04.816731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:16:04.816731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:16:04.817771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:16:04.817771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:16:04.817771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:16:04.817771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:16:04.817771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:04.817771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:04.817771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:04.817771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:04.817771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:04.817771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:04.817771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:04.817771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:04.817771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:04.817771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:04.817771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:04.817771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:04.818624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:04.818624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:04.818624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:04.818624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:04.818624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:16:04.818624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:16:04.818624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:16:04.818624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:16:04.818624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:16:04.818624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:16:04.818624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:16:04.818624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:04.818624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 420/848] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:16:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:16:04.819377 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bae0c-899d-4a1f-a0b3-40ac66f541a0 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:04.848427 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:04.856163 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022bcf7-7851-4eda-af4e-5d100e538837 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:04.898481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd6446-bf73-405a-b7fd-86337332a6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:04.899642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd6446-bf73-405a-b7fd-86337332a6eb None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:04.900211 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd6446-bf73-405a-b7fd-86337332a6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:04.900715 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd6446-bf73-405a-b7fd-86337332a6eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:04.909363 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd6446-bf73-405a-b7fd-86337332a6eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:04.911353 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd6446-bf73-405a-b7fd-86337332a6eb None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:04.925548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-94bd6446-bf73-405a-b7fd-86337332a6eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:16:04.925548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:04.925548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:04.925548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:04.925548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:04.925548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:04.925548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:04.925548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:04.925548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:04.925548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:04.925548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:04.925548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:04.925548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:16:04.925548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:16:04.925548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:16:04.926721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:16:04.926721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:04.926721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:04.926721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:04.926721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:04.926721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:04.926721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:04.926721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:04.926721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:04.926721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:04.926721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:04.926721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:04.926721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:04.926721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:04.926721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:04.926721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:04.926721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:04.927839 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:16:04.927839 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:16:04.927839 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:16:04.927839 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:16:04.927839 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:16:04.927839 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:16:04.927839 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:16:04.927839 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:04.934690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 429/849] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:16:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:16:04.936506 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd6446-bf73-405a-b7fd-86337332a6eb None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:04.946934 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bae0c-899d-4a1f-a0b3-40ac66f541a0 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:04.986521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ba406-4747-4550-8633-1a1c1e24a17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:04.987177 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ba406-4747-4550-8633-1a1c1e24a17f None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:04.987458 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ba406-4747-4550-8633-1a1c1e24a17f None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:04.987754 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ba406-4747-4550-8633-1a1c1e24a17f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:04.988368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ba406-4747-4550-8633-1a1c1e24a17f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:04.989834 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ba406-4747-4550-8633-1a1c1e24a17f None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:05.000406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-306ba406-4747-4550-8633-1a1c1e24a17f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 14:16:05.000406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:05.000406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:16:05.000406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:16:05.000406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:16:05.000406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:16:05.000406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:16:05.000406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:05.000406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 14:16:05.000406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:05.000406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:16:05.000406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:05.000406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:05.000406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:05.000406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:05.000406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:05.000406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:05.001499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:05.001499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:05.001499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:05.001499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:05.001499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:05.001499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:05.001499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:16:05.001499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:16:05.001499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:16:05.001499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:16:05.001499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:05.001499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:05.001499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:05.001499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:05.001499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:05.001499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:05.002321 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:05.002321 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:05.002321 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:05.002321 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:05.002321 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:05.002321 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:05.002321 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:05.002321 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:05.002321 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:05.002321 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:05.002321 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:16:05.002321 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:05.002321 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 14:16:05.002321 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:05.002321 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 421/850] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Oct 4 14:16:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:05.003114 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ba406-4747-4550-8633-1a1c1e24a17f None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:05.011956 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:05.069430 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd6446-bf73-405a-b7fd-86337332a6eb None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:05.106126 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:05.127870 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16655810-b95b-4a50-8deb-2cb37247a72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:05.128505 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16655810-b95b-4a50-8deb-2cb37247a72e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:05.128777 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16655810-b95b-4a50-8deb-2cb37247a72e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:05.129053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16655810-b95b-4a50-8deb-2cb37247a72e None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:05.129840 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16655810-b95b-4a50-8deb-2cb37247a72e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:05.130147 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16655810-b95b-4a50-8deb-2cb37247a72e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:05.131730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16655810-b95b-4a50-8deb-2cb37247a72e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:05.137225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ba406-4747-4550-8633-1a1c1e24a17f None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:05.142548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 430/851] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:16:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:05.143504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16655810-b95b-4a50-8deb-2cb37247a72e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:05.196359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44ca94-023e-424a-9ef1-a2626eaebd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:05.197674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44ca94-023e-424a-9ef1-a2626eaebd46 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:05.198119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44ca94-023e-424a-9ef1-a2626eaebd46 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:05.198552 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44ca94-023e-424a-9ef1-a2626eaebd46 None admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:05.199744 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44ca94-023e-424a-9ef1-a2626eaebd46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:05.200237 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44ca94-023e-424a-9ef1-a2626eaebd46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:05.203597 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44ca94-023e-424a-9ef1-a2626eaebd46 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:05.219498 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 422/852] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:16:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:05.220999 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44ca94-023e-424a-9ef1-a2626eaebd46 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:05.294134 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16655810-b95b-4a50-8deb-2cb37247a72e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:05.319213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:05.341005 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d68e61-69d9-4183-b417-8fe8baceabc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:05.341653 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d68e61-69d9-4183-b417-8fe8baceabc4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:05.342045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d68e61-69d9-4183-b417-8fe8baceabc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:05.342655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d68e61-69d9-4183-b417-8fe8baceabc4 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:05.342918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d68e61-69d9-4183-b417-8fe8baceabc4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:05.343226 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d68e61-69d9-4183-b417-8fe8baceabc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:05.344776 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d68e61-69d9-4183-b417-8fe8baceabc4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:05.355392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 431/853] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Oct 4 14:16:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:05.355392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d68e61-69d9-4183-b417-8fe8baceabc4 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:05.389192 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44ca94-023e-424a-9ef1-a2626eaebd46 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:05.434540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835336b-917b-43d8-9b8e-01cb629d72df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:05.435919 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835336b-917b-43d8-9b8e-01cb629d72df None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:05.436350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835336b-917b-43d8-9b8e-01cb629d72df None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:05.436868 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835336b-917b-43d8-9b8e-01cb629d72df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:05.449796 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835336b-917b-43d8-9b8e-01cb629d72df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:05.451960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835336b-917b-43d8-9b8e-01cb629d72df None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:05.455896 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:05.471221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-c835336b-917b-43d8-9b8e-01cb629d72df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:05.471221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:05.471221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:05.471221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:05.471221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:05.471221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:05.471221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:05.471221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:05.471221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:05.471221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:05.471221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:05.471221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:05.471221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:16:05.471221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:16:05.471221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:16:05.471221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:16:05.473626 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:05.473626 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:05.473626 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:05.473626 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:05.473626 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:05.473626 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:05.473626 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:05.473626 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:05.473626 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:05.473626 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:05.473626 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:05.473626 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:05.473626 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:05.473626 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:05.473626 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:05.473626 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:05.473626 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:16:05.475421 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:16:05.475421 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:05.475421 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:05.477949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 423/854] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:05.479049 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835336b-917b-43d8-9b8e-01cb629d72df None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:05.535805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d68e61-69d9-4183-b417-8fe8baceabc4 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:05.587695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17112cfe-51b9-4f27-860a-a61201041337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:05.588347 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17112cfe-51b9-4f27-860a-a61201041337 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:05.588629 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17112cfe-51b9-4f27-860a-a61201041337 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:05.588899 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17112cfe-51b9-4f27-860a-a61201041337 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:05.589651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17112cfe-51b9-4f27-860a-a61201041337 None admin] RBAC: Adding query filter params (role.id=e5d031634de14f1e86b912ddddfe7f8c, scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba, user.id=c5dc12a8bc2b406b8a148bf609d5d2ba) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:05.589950 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17112cfe-51b9-4f27-860a-a61201041337 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:05.591517 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17112cfe-51b9-4f27-860a-a61201041337 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:05.598924 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 432/855] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:16:05 2022] GET /identity/v3/role_assignments?user.id=c5dc12a8bc2b406b8a148bf609d5d2ba&scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba&role.id=e5d031634de14f1e86b912ddddfe7f8c => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:05.599815 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17112cfe-51b9-4f27-860a-a61201041337 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:05.654606 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835336b-917b-43d8-9b8e-01cb629d72df None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:05.672217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:05.702265 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f94c6-8266-43c5-8f1b-d9e59ad61d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:05.703275 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f94c6-8266-43c5-8f1b-d9e59ad61d5c None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:05.703700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f94c6-8266-43c5-8f1b-d9e59ad61d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:05.704266 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f94c6-8266-43c5-8f1b-d9e59ad61d5c None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:05.705172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f94c6-8266-43c5-8f1b-d9e59ad61d5c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:05.705755 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f94c6-8266-43c5-8f1b-d9e59ad61d5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:05.707545 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f94c6-8266-43c5-8f1b-d9e59ad61d5c None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:05.720183 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 424/856] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Oct 4 14:16:05 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:05.745429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17112cfe-51b9-4f27-860a-a61201041337 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:05.792048 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9455fb-92c8-42fb-a9f2-4cc5cf5b2525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:05.792738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9455fb-92c8-42fb-a9f2-4cc5cf5b2525 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:05.793020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9455fb-92c8-42fb-a9f2-4cc5cf5b2525 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:05.793297 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9455fb-92c8-42fb-a9f2-4cc5cf5b2525 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:05.793989 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9455fb-92c8-42fb-a9f2-4cc5cf5b2525 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:05.794293 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9455fb-92c8-42fb-a9f2-4cc5cf5b2525 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:05.796722 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9455fb-92c8-42fb-a9f2-4cc5cf5b2525 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:05.813483 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 433/857] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:05.819954 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f94c6-8266-43c5-8f1b-d9e59ad61d5c None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:05.947861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:06.011102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f94c6-8266-43c5-8f1b-d9e59ad61d5c None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:06.060585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220efe7-fb49-4da9-8e74-a69dd1b2f3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:06.061390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220efe7-fb49-4da9-8e74-a69dd1b2f3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:06.061671 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220efe7-fb49-4da9-8e74-a69dd1b2f3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:06.062027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220efe7-fb49-4da9-8e74-a69dd1b2f3b3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:06.073068 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220efe7-fb49-4da9-8e74-a69dd1b2f3b3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:06.074628 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220efe7-fb49-4da9-8e74-a69dd1b2f3b3 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:06.088526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-1220efe7-fb49-4da9-8e74-a69dd1b2f3b3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 14:16:06.088526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:06.088526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:06.088526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:06.088526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:06.088526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:06.088526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:06.088526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:06.088526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:06.088526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:06.088526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:06.088526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:06.088526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:16:06.088526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:16:06.088526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:16:06.088526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:16:06.090584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:06.090584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:06.090584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:16:06.090584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:16:06.090584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:16:06.090584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:16:06.090584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:06.090584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:06.090584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:06.090584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:06.090584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:06.090584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:06.090584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:06.090584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:06.090584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:06.090584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:06.090584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:06.090584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:06.093308 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:06.093308 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:06.093308 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:16:06.093308 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:16:06.093308 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:16:06.093308 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:16:06.093308 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:16:06.093308 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:16:06.093308 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 14:16:06.093308 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:06.093308 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 425/858] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:16:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:06.097042 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9455fb-92c8-42fb-a9f2-4cc5cf5b2525 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:06.257741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9455fb-92c8-42fb-a9f2-4cc5cf5b2525 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:06.267155 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:06.299074 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd2a50-e956-40af-be92-42e9e0d9592c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:06.299720 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd2a50-e956-40af-be92-42e9e0d9592c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:06.300026 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd2a50-e956-40af-be92-42e9e0d9592c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:06.300297 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd2a50-e956-40af-be92-42e9e0d9592c None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:06.301038 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd2a50-e956-40af-be92-42e9e0d9592c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:06.301346 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd2a50-e956-40af-be92-42e9e0d9592c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:06.302822 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd2a50-e956-40af-be92-42e9e0d9592c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:06.324716 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 434/859] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Oct 4 14:16:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:06.334310 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220efe7-fb49-4da9-8e74-a69dd1b2f3b3 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:06.509128 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36789c7-99e8-4bae-bab4-02baab1de3f8 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:06.509676 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36789c7-99e8-4bae-bab4-02baab1de3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:06.510221 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36789c7-99e8-4bae-bab4-02baab1de3f8 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:06.515619 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 435/860] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:16:06.521177 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a7867-f6c5-4e84-8927-71d8ada3e330 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:06.521832 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a7867-f6c5-4e84-8927-71d8ada3e330 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:06.522312 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a7867-f6c5-4e84-8927-71d8ada3e330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:06.545605 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220efe7-fb49-4da9-8e74-a69dd1b2f3b3 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:06.564653 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-8e7a7867-f6c5-4e84-8927-71d8ada3e330 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:06.567745 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8e7a7867-f6c5-4e84-8927-71d8ada3e330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:06.583036 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:06.608812 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860acb8-206f-4715-adb1-61ee45822532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:06.610152 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860acb8-206f-4715-adb1-61ee45822532 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:06.610657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860acb8-206f-4715-adb1-61ee45822532 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:06.611187 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860acb8-206f-4715-adb1-61ee45822532 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:06.723773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 436/861] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 14:16:06.724368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860acb8-206f-4715-adb1-61ee45822532 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:06.725835 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860acb8-206f-4715-adb1-61ee45822532 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:06.851745 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 426/862] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:16:06 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 14:16:06.860900 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a7867-f6c5-4e84-8927-71d8ada3e330 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:06.974385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:06.983033 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a7867-f6c5-4e84-8927-71d8ada3e330 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:07.027691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e1722-c125-4c08-89bb-92f0b000fb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:07.028382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e1722-c125-4c08-89bb-92f0b000fb67 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:07.028657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e1722-c125-4c08-89bb-92f0b000fb67 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:07.029108 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e1722-c125-4c08-89bb-92f0b000fb67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:07.041647 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e1722-c125-4c08-89bb-92f0b000fb67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:07.043140 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e1722-c125-4c08-89bb-92f0b000fb67 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:07.060318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-da0e1722-c125-4c08-89bb-92f0b000fb67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:07.060318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:07.060318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:07.060318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:07.060318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:07.060318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:07.060318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:07.060318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:07.060318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:07.060318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:07.060318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:07.060318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:07.060318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:16:07.060318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:16:07.060318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:16:07.060318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:16:07.061437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:07.061437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:07.061437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:07.061437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:07.061437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:07.061437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:07.061437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:07.061437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:07.061437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:07.061437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:07.061437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:07.061437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:07.061437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:07.061437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:07.061437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:07.061437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:07.061437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:16:07.062471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:16:07.062471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:07.062471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:07.062471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 437/863] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:07.069955 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860acb8-206f-4715-adb1-61ee45822532 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:07.097484 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:07.213807 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e1722-c125-4c08-89bb-92f0b000fb67 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:07.269572 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860acb8-206f-4715-adb1-61ee45822532 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:07.342631 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f5636-5d53-47c1-bb0b-fbd42d2d76ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:07.343656 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f5636-5d53-47c1-bb0b-fbd42d2d76ac None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:07.344143 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f5636-5d53-47c1-bb0b-fbd42d2d76ac None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:07.344593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f5636-5d53-47c1-bb0b-fbd42d2d76ac None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:07.345728 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22f5636-5d53-47c1-bb0b-fbd42d2d76ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:07.346282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22f5636-5d53-47c1-bb0b-fbd42d2d76ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:07.348907 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22f5636-5d53-47c1-bb0b-fbd42d2d76ac None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:07.379566 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 427/864] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:07.383405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f5636-5d53-47c1-bb0b-fbd42d2d76ac None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:07.443495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e1722-c125-4c08-89bb-92f0b000fb67 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:07.514494 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe1e67-7166-4065-b4aa-b032e2750c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:07.515684 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe1e67-7166-4065-b4aa-b032e2750c02 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:07.516222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe1e67-7166-4065-b4aa-b032e2750c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:07.516685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe1e67-7166-4065-b4aa-b032e2750c02 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:07.517680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe1e67-7166-4065-b4aa-b032e2750c02 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:07.521352 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe1e67-7166-4065-b4aa-b032e2750c02 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:07.546029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-1ffe1e67-7166-4065-b4aa-b032e2750c02 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 14:16:07.546029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:07.546029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:16:07.546029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:16:07.546029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:16:07.546029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:16:07.546029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:16:07.546029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:07.546029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 14:16:07.546029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:07.546029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:16:07.546029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:07.546029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:07.546029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:07.546029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:07.546029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:07.555955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:07.555955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:07.555955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:07.555955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:07.555955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:07.555955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:07.555955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:07.555955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:16:07.555955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:16:07.555955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:16:07.555955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:16:07.555955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:07.555955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:07.555955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:07.555955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:07.555955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:07.555955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:07.557821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:07.557821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:07.557821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:07.557821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:07.557821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:07.557821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:07.557821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:07.557821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:07.557821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:07.557821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:07.557821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:16:07.557821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:07.557821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 14:16:07.557821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:07.557821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 438/865] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Oct 4 14:16:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:07.560294 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe1e67-7166-4065-b4aa-b032e2750c02 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:07.586071 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:07.592853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:07.622206 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f5636-5d53-47c1-bb0b-fbd42d2d76ac None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:07.672725 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cee060-f275-4dca-a9ad-7ab3852db0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:07.673748 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cee060-f275-4dca-a9ad-7ab3852db0c9 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:07.674227 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cee060-f275-4dca-a9ad-7ab3852db0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:07.674693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cee060-f275-4dca-a9ad-7ab3852db0c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:07.682963 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cee060-f275-4dca-a9ad-7ab3852db0c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:07.684947 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cee060-f275-4dca-a9ad-7ab3852db0c9 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:07.698480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-a6cee060-f275-4dca-a9ad-7ab3852db0c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:16:07.698480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:07.698480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:07.698480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:07.698480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:07.698480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:07.698480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:07.698480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:07.698480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:07.698480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:07.698480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:07.698480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:07.698480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:16:07.698480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:16:07.698480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:16:07.699443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:16:07.699443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:07.699443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:07.699443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:07.699443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:07.699443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:07.699443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:07.699443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:07.699443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:07.699443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:07.699443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:07.699443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:07.699443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:07.699443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:07.699443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:07.699443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:07.699443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:07.700778 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:16:07.700778 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:16:07.700778 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:16:07.700778 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:16:07.700778 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:16:07.700778 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:16:07.700778 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:16:07.700778 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:07.708522 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 428/866] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:16:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:07.709819 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cee060-f275-4dca-a9ad-7ab3852db0c9 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:07.792226 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe1e67-7166-4065-b4aa-b032e2750c02 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:07.836935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce49b9-beb5-453f-b0fe-521f5ba68ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:07.837990 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce49b9-beb5-453f-b0fe-521f5ba68ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:07.838486 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce49b9-beb5-453f-b0fe-521f5ba68ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:07.838956 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce49b9-beb5-453f-b0fe-521f5ba68ad2 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:07.839928 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce49b9-beb5-453f-b0fe-521f5ba68ad2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:07.840447 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce49b9-beb5-453f-b0fe-521f5ba68ad2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:07.842273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce49b9-beb5-453f-b0fe-521f5ba68ad2 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:07.851213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 439/867] 10.222.0.62 () {56 vars in 1126 bytes} [Tue Oct 4 14:16:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:07.856692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce49b9-beb5-453f-b0fe-521f5ba68ad2 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:07.881427 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cee060-f275-4dca-a9ad-7ab3852db0c9 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:07.933637 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad959dd1-5687-41dd-acc9-77db32691f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:07.934523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad959dd1-5687-41dd-acc9-77db32691f24 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:07.934676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad959dd1-5687-41dd-acc9-77db32691f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:07.934921 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad959dd1-5687-41dd-acc9-77db32691f24 None admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:07.936540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad959dd1-5687-41dd-acc9-77db32691f24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:07.936900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad959dd1-5687-41dd-acc9-77db32691f24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:07.938772 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad959dd1-5687-41dd-acc9-77db32691f24 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:07.949740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:07.960079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 429/868] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:16:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:07.961205 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad959dd1-5687-41dd-acc9-77db32691f24 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:07.968355 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:08.002281 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce49b9-beb5-453f-b0fe-521f5ba68ad2 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:08.049688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0996e5d-e524-468d-9423-5fb2329a30ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:08.050980 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0996e5d-e524-468d-9423-5fb2329a30ce None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:08.051511 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0996e5d-e524-468d-9423-5fb2329a30ce None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:08.052201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0996e5d-e524-468d-9423-5fb2329a30ce None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:08.053539 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0996e5d-e524-468d-9423-5fb2329a30ce None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:08.054356 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0996e5d-e524-468d-9423-5fb2329a30ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:08.056000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0996e5d-e524-468d-9423-5fb2329a30ce None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:08.065118 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 440/869] 10.222.0.62 () {56 vars in 1126 bytes} [Tue Oct 4 14:16:07 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:08.106228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad959dd1-5687-41dd-acc9-77db32691f24 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:08.150388 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f98c3b-8a02-4d22-8f83-c0e9467e18fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:08.151423 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f98c3b-8a02-4d22-8f83-c0e9467e18fe None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:08.151926 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f98c3b-8a02-4d22-8f83-c0e9467e18fe None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:08.152386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f98c3b-8a02-4d22-8f83-c0e9467e18fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:08.153364 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f98c3b-8a02-4d22-8f83-c0e9467e18fe None admin] RBAC: Adding query filter params (role.id=a16b6daeda5b4a67992f3c12514ca90e, scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba, user.id=4860d5958e724e568576a9067290a27e) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:08.154540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f98c3b-8a02-4d22-8f83-c0e9467e18fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:08.156748 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f98c3b-8a02-4d22-8f83-c0e9467e18fe None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:08.165347 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 430/870] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:16:07 2022] GET /identity/v3/role_assignments?user.id=4860d5958e724e568576a9067290a27e&scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba&role.id=a16b6daeda5b4a67992f3c12514ca90e => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:08.651234 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec070a3f-f9bc-46dd-aa1b-e90990da42ef None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:08.652317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec070a3f-f9bc-46dd-aa1b-e90990da42ef None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:08.652818 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec070a3f-f9bc-46dd-aa1b-e90990da42ef None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:08.655738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 441/871] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:16:08.661950 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0487c-a03d-419f-a6a7-aab0436a53f9 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:08.662985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0487c-a03d-419f-a6a7-aab0436a53f9 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:08.663467 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0487c-a03d-419f-a6a7-aab0436a53f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:08.666437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36714a08-7031-4b1f-8bb4-d42cf2e8c246 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:08.666727 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36714a08-7031-4b1f-8bb4-d42cf2e8c246 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:08.666989 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36714a08-7031-4b1f-8bb4-d42cf2e8c246 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:08.668738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 442/872] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:16:08.675752 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b2abf-a351-4404-b049-7645ddbec11b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:08.676104 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b2abf-a351-4404-b049-7645ddbec11b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:08.676307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b2abf-a351-4404-b049-7645ddbec11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:08.690461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-dcb0487c-a03d-419f-a6a7-aab0436a53f9 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:08.692923 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-dcb0487c-a03d-419f-a6a7-aab0436a53f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:08.703304 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-245b2abf-a351-4404-b049-7645ddbec11b None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:08.705000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-245b2abf-a351-4404-b049-7645ddbec11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:08.795857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 443/873] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 14:16:08.808633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:08.823932 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 431/874] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:16:09.293230 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b2abf-a351-4404-b049-7645ddbec11b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:09.336650 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0487c-a03d-419f-a6a7-aab0436a53f9 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:09.394642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:09.446511 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b2abf-a351-4404-b049-7645ddbec11b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:09.510672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc31ab-6f74-4428-876b-9e93a20450b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:09.512044 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0487c-a03d-419f-a6a7-aab0436a53f9 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:09.512445 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc31ab-6f74-4428-876b-9e93a20450b1 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:09.513847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc31ab-6f74-4428-876b-9e93a20450b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:09.514715 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc31ab-6f74-4428-876b-9e93a20450b1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:09.543902 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc31ab-6f74-4428-876b-9e93a20450b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:16:09.565798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-e6fc31ab-6f74-4428-876b-9e93a20450b1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 14:16:09.565798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:09.565798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:09.565798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:09.565798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:09.565798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:09.565798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:09.565798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:09.565798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:09.565798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:09.565798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:09.565798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:09.565798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:16:09.565798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:16:09.565798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:16:09.565798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:16:09.567690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:16:09.567690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:16:09.567690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:16:09.567690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:16:09.567690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:09.567690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:09.567690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:09.567690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:09.567690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:09.567690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:09.567690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:09.567690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:09.567690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:09.567690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:09.567690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:09.567690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:09.569448 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:09.569448 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:09.569448 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:09.569448 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:09.569448 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:16:09.569448 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:16:09.569448 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:16:09.569448 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:16:09.569448 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:16:09.569448 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:16:09.569448 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 14:16:09.569448 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:09.574453 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 444/875] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Oct 4 14:16:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:09.584217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc31ab-6f74-4428-876b-9e93a20450b1 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:09.595055 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a75832-cc87-4ae6-ac30-76c8f0040e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:09.596594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a75832-cc87-4ae6-ac30-76c8f0040e4b None admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:09.597373 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a75832-cc87-4ae6-ac30-76c8f0040e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:09.598120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a75832-cc87-4ae6-ac30-76c8f0040e4b None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:09.599633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a75832-cc87-4ae6-ac30-76c8f0040e4b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:09.603497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a75832-cc87-4ae6-ac30-76c8f0040e4b None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:09.640977 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 432/876] 10.222.0.62 () {60 vars in 1141 bytes} [Tue Oct 4 14:16:09 2022] POST /identity/v3/services => generated 251 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:16:09.822391 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc31ab-6f74-4428-876b-9e93a20450b1 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:09.881439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:09.908878 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecce939-6ef3-40d7-8c18-83c87d952db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:09.909927 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecce939-6ef3-40d7-8c18-83c87d952db0 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:09.910427 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecce939-6ef3-40d7-8c18-83c87d952db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:09.910918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecce939-6ef3-40d7-8c18-83c87d952db0 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:09.912225 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecce939-6ef3-40d7-8c18-83c87d952db0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:09.912774 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecce939-6ef3-40d7-8c18-83c87d952db0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:09.915425 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecce939-6ef3-40d7-8c18-83c87d952db0 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:09.934780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 445/877] 10.222.0.62 () {56 vars in 1115 bytes} [Tue Oct 4 14:16:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:09.946264 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a75832-cc87-4ae6-ac30-76c8f0040e4b None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:10.067361 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:10.165945 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a75832-cc87-4ae6-ac30-76c8f0040e4b None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:10.260320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff504625-75cd-42a3-94e9-8ac19462c693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:10.261487 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff504625-75cd-42a3-94e9-8ac19462c693 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:10.261989 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff504625-75cd-42a3-94e9-8ac19462c693 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:10.262470 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff504625-75cd-42a3-94e9-8ac19462c693 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:10.296640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff504625-75cd-42a3-94e9-8ac19462c693 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:10.299506 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff504625-75cd-42a3-94e9-8ac19462c693 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:10.331030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-ff504625-75cd-42a3-94e9-8ac19462c693 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:10.331030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:10.331030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:10.331030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:10.331030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:10.331030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:10.331030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:10.331030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:10.331030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:10.331030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:10.331030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:10.331030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:10.331030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:16:10.331030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:16:10.331030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:16:10.331030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:16:10.332997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:10.332997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:10.332997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:10.332997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:10.332997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:10.332997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:10.332997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:10.332997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:10.332997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:10.332997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:10.332997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:10.332997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:10.332997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:10.332997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:10.332997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:10.332997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:10.332997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:16:10.334820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:16:10.334820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:10.334820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:10.339658 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 433/878] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:10.341820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecce939-6ef3-40d7-8c18-83c87d952db0 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:10.549078 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecce939-6ef3-40d7-8c18-83c87d952db0 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:10.595043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4cb15-7d4e-495e-9634-535bc59ecc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:10.595701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4cb15-7d4e-495e-9634-535bc59ecc60 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:10.596014 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4cb15-7d4e-495e-9634-535bc59ecc60 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:10.596291 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4cb15-7d4e-495e-9634-535bc59ecc60 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:10.597020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4cb15-7d4e-495e-9634-535bc59ecc60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:10.597333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4cb15-7d4e-495e-9634-535bc59ecc60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:10.598898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4cb15-7d4e-495e-9634-535bc59ecc60 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:10.621813 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 446/879] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:10.624782 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff504625-75cd-42a3-94e9-8ac19462c693 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:10.772766 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739d203-eb6e-4f3b-923f-2fa13177777e None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:10.773073 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739d203-eb6e-4f3b-923f-2fa13177777e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:10.773636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739d203-eb6e-4f3b-923f-2fa13177777e None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:10.775486 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff504625-75cd-42a3-94e9-8ac19462c693 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:10.776689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 447/880] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:16:10.783006 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ee5ea-2dd1-4cef-b875-951e0d593b11 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:10.783302 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ee5ea-2dd1-4cef-b875-951e0d593b11 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:10.783573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ee5ea-2dd1-4cef-b875-951e0d593b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:10.785383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:10.805448 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-a40ee5ea-2dd1-4cef-b875-951e0d593b11 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:10.806618 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a40ee5ea-2dd1-4cef-b875-951e0d593b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:10.820615 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f14b7-662c-44aa-8919-240383492a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:10.821352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f14b7-662c-44aa-8919-240383492a94 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:10.821621 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f14b7-662c-44aa-8919-240383492a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:10.821895 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f14b7-662c-44aa-8919-240383492a94 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:10.831500 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f14b7-662c-44aa-8919-240383492a94 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:10.833117 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f14b7-662c-44aa-8919-240383492a94 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:10.847588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-233f14b7-662c-44aa-8919-240383492a94 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 14:16:10.847588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:10.847588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:10.847588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:10.847588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:10.847588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:10.847588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:10.847588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:10.847588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:10.847588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:10.847588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:10.847588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:10.847588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:16:10.847588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:16:10.847588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:16:10.847588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:16:10.848969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:10.848969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:10.848969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:16:10.848969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:16:10.848969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:16:10.848969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:16:10.848969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:10.848969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:10.848969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:10.848969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:10.848969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:10.848969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:10.848969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:10.848969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:10.848969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:10.848969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:10.848969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:10.848969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:10.850148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:10.850148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:10.850148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:16:10.850148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:16:10.850148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:16:10.850148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:16:10.850148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:16:10.850148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:16:10.850148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 14:16:10.850148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:10.850148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 434/881] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Oct 4 14:16:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:10.850742 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf16d7e-1b37-40c2-bed8-9bc438611d7f None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:10.850981 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf16d7e-1b37-40c2-bed8-9bc438611d7f None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:10.851261 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf16d7e-1b37-40c2-bed8-9bc438611d7f None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:10.852700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 435/882] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:16:10.858322 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf16d7e-1b37-40c2-bed8-9bc438611d7f None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:10.869678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:10.900845 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 448/883] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:10 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 14:16:10.908660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cb5fd-2f53-4d9b-ac32-0a9a8b3594c0 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:10.909386 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cb5fd-2f53-4d9b-ac32-0a9a8b3594c0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:10.909849 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cb5fd-2f53-4d9b-ac32-0a9a8b3594c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:10.934496 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-4b6cb5fd-2f53-4d9b-ac32-0a9a8b3594c0 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:10.937200 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4b6cb5fd-2f53-4d9b-ac32-0a9a8b3594c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:10.996576 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf16d7e-1b37-40c2-bed8-9bc438611d7f None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:11.038087 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 449/884] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:10 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:16:11.058562 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b4eb7-a480-481b-9653-9d4d5a04b93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:11.059484 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b4eb7-a480-481b-9653-9d4d5a04b93f None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:11.059995 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b4eb7-a480-481b-9653-9d4d5a04b93f None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:11.060556 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b4eb7-a480-481b-9653-9d4d5a04b93f None admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:11.061594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b4eb7-a480-481b-9653-9d4d5a04b93f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:11.062089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b4eb7-a480-481b-9653-9d4d5a04b93f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:11.064111 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b4eb7-a480-481b-9653-9d4d5a04b93f None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:11.085877 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 436/885] 10.222.0.62 () {56 vars in 1149 bytes} [Tue Oct 4 14:16:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:11.093766 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cb5fd-2f53-4d9b-ac32-0a9a8b3594c0 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:11.214433 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cb5fd-2f53-4d9b-ac32-0a9a8b3594c0 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:11.224742 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:11.227121 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b4eb7-a480-481b-9653-9d4d5a04b93f None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:11.262447 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:11.268385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc245b0-44bd-46cb-b10c-74805d7c6b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:11.269076 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc245b0-44bd-46cb-b10c-74805d7c6b49 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:11.269481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc245b0-44bd-46cb-b10c-74805d7c6b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:11.269847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc245b0-44bd-46cb-b10c-74805d7c6b49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:11.404775 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc245b0-44bd-46cb-b10c-74805d7c6b49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:11.407599 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc245b0-44bd-46cb-b10c-74805d7c6b49 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:11.417518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b4eb7-a480-481b-9653-9d4d5a04b93f None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:11.492092 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cad4fc-e2fc-46be-9650-2dd63e424487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:11.493269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cad4fc-e2fc-46be-9650-2dd63e424487 None admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:11.493749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cad4fc-e2fc-46be-9650-2dd63e424487 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:11.494216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cad4fc-e2fc-46be-9650-2dd63e424487 None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:11.495399 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cad4fc-e2fc-46be-9650-2dd63e424487 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:11.498614 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cad4fc-e2fc-46be-9650-2dd63e424487 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:11.522973 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 437/886] 10.222.0.62 () {60 vars in 1141 bytes} [Tue Oct 4 14:16:11 2022] POST /identity/v3/services => generated 269 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:16:11.523889 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cad4fc-e2fc-46be-9650-2dd63e424487 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:11.585260 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 450/887] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:16:11 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 14:16:11.594346 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc245b0-44bd-46cb-b10c-74805d7c6b49 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:11.616057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:11.696502 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:11.728237 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cad4fc-e2fc-46be-9650-2dd63e424487 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:11.800379 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32913f5-43c1-4e6c-8c92-314435858e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:11.802216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32913f5-43c1-4e6c-8c92-314435858e39 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:11.803071 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32913f5-43c1-4e6c-8c92-314435858e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:11.803560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32913f5-43c1-4e6c-8c92-314435858e39 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:11.805057 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32913f5-43c1-4e6c-8c92-314435858e39 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:11.808723 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32913f5-43c1-4e6c-8c92-314435858e39 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:11.809235 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc245b0-44bd-46cb-b10c-74805d7c6b49 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:11.832229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-a32913f5-43c1-4e6c-8c92-314435858e39 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 14:16:11.832229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:11.832229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:16:11.832229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:16:11.832229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:16:11.832229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:16:11.832229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:16:11.832229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:11.832229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 14:16:11.832229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:11.832229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:16:11.832229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:11.832229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:11.832229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:11.832229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:11.832229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:11.832229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:11.833296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:11.833296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:11.833296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:11.833296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:11.833296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:11.833296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:11.833296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:16:11.833296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:16:11.833296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:16:11.833296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:16:11.833296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:11.833296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:11.833296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:11.833296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:11.833296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:11.833296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:11.834138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:11.834138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:11.834138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:11.834138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:11.834138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:11.834138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:11.834138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:11.834138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:11.834138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:11.834138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:11.834138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:16:11.834138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:11.834138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 14:16:11.834138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:11.834138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 438/888] 10.222.0.62 () {56 vars in 1126 bytes} [Tue Oct 4 14:16:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:11.846766 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32913f5-43c1-4e6c-8c92-314435858e39 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:11.874077 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab55330-888e-47d5-b8fc-8deb04c618bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:11.875313 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab55330-888e-47d5-b8fc-8deb04c618bd None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:11.875808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab55330-888e-47d5-b8fc-8deb04c618bd None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:11.876063 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab55330-888e-47d5-b8fc-8deb04c618bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:11.894138 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab55330-888e-47d5-b8fc-8deb04c618bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:11.895798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab55330-888e-47d5-b8fc-8deb04c618bd None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:11.923502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-4ab55330-888e-47d5-b8fc-8deb04c618bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:11.923502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:11.923502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:11.923502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:11.923502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:11.923502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:11.923502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:11.923502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:11.923502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:11.923502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:11.923502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:11.923502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:11.923502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:16:11.923502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:16:11.923502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:16:11.923502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:16:11.924843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:11.924843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:11.924843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:11.924843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:11.924843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:11.924843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:11.924843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:11.924843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:11.924843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:11.924843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:11.924843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:11.924843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:11.924843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:11.924843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:11.924843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:11.924843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:11.924843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:16:11.926805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:16:11.926805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:11.926805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:11.932082 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 451/889] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:11.944231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab55330-888e-47d5-b8fc-8deb04c618bd None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:12.068518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32913f5-43c1-4e6c-8c92-314435858e39 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:12.092835 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:12.152913 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572df98-4b34-4bac-b483-8a2391f5c8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:12.155029 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572df98-4b34-4bac-b483-8a2391f5c8bb None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:12.155684 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572df98-4b34-4bac-b483-8a2391f5c8bb None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:12.156321 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572df98-4b34-4bac-b483-8a2391f5c8bb None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:12.158619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572df98-4b34-4bac-b483-8a2391f5c8bb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:12.159701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572df98-4b34-4bac-b483-8a2391f5c8bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:12.162642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572df98-4b34-4bac-b483-8a2391f5c8bb None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:12.183055 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 439/890] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Oct 4 14:16:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:12.187196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572df98-4b34-4bac-b483-8a2391f5c8bb None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:12.202208 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab55330-888e-47d5-b8fc-8deb04c618bd None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:12.212612 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:12.283097 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddc62f-2744-4692-b9b9-7418fa938750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:12.284401 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddc62f-2744-4692-b9b9-7418fa938750 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:12.284934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddc62f-2744-4692-b9b9-7418fa938750 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:12.285447 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddc62f-2744-4692-b9b9-7418fa938750 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:12.286768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddc62f-2744-4692-b9b9-7418fa938750 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:12.287347 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddc62f-2744-4692-b9b9-7418fa938750 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:12.290086 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddc62f-2744-4692-b9b9-7418fa938750 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:12.315679 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 452/891] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:12.322358 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddc62f-2744-4692-b9b9-7418fa938750 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:12.412541 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572df98-4b34-4bac-b483-8a2391f5c8bb None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:12.494528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2eef4f-427b-4a45-98fc-81ec9a96d0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:12.496071 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eef4f-427b-4a45-98fc-81ec9a96d0da None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:12.496801 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eef4f-427b-4a45-98fc-81ec9a96d0da None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:12.497584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eef4f-427b-4a45-98fc-81ec9a96d0da None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:12.498989 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2eef4f-427b-4a45-98fc-81ec9a96d0da None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:12.499838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2eef4f-427b-4a45-98fc-81ec9a96d0da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:12.502621 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2eef4f-427b-4a45-98fc-81ec9a96d0da None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:12.511754 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 440/892] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Oct 4 14:16:12 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:12.544006 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddc62f-2744-4692-b9b9-7418fa938750 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:12.591127 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:12.630297 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4e1f4-3ff3-43e3-8778-30c8468665c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:12.631376 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4e1f4-3ff3-43e3-8778-30c8468665c6 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:12.631896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4e1f4-3ff3-43e3-8778-30c8468665c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:12.632366 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4e1f4-3ff3-43e3-8778-30c8468665c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:12.646327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4e1f4-3ff3-43e3-8778-30c8468665c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:12.649224 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4e1f4-3ff3-43e3-8778-30c8468665c6 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:12.674764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-04d4e1f4-3ff3-43e3-8778-30c8468665c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:16:12.674764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:12.674764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:12.674764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:12.674764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:12.674764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:12.674764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:12.674764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:12.674764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:12.674764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:12.674764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:12.674764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:12.674764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:16:12.674764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:16:12.674764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:16:12.677968 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:16:12.677968 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:12.677968 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:12.677968 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:12.677968 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:12.677968 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:12.677968 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:12.677968 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:12.677968 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:12.677968 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:12.677968 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:12.677968 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:12.677968 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:12.677968 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:12.677968 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:12.677968 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:12.677968 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:12.680647 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:16:12.680647 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:16:12.680647 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:16:12.680647 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:16:12.680647 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:16:12.680647 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:16:12.680647 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:16:12.680647 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:12.680647 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 453/893] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:16:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:16:12.692647 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2eef4f-427b-4a45-98fc-81ec9a96d0da None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:12.845628 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:12.908391 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2eef4f-427b-4a45-98fc-81ec9a96d0da None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:12.979865 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1918f-9d47-44aa-803e-353dc81ddb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:12.980913 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1918f-9d47-44aa-803e-353dc81ddb42 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:12.981388 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1918f-9d47-44aa-803e-353dc81ddb42 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:12.981884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1918f-9d47-44aa-803e-353dc81ddb42 None admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:12.983204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1918f-9d47-44aa-803e-353dc81ddb42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:12.983658 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1918f-9d47-44aa-803e-353dc81ddb42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:12.986422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1918f-9d47-44aa-803e-353dc81ddb42 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:13.011472 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 441/894] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:16:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:13.021781 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4e1f4-3ff3-43e3-8778-30c8468665c6 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:13.104540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e08266-b7cf-49e4-9139-4db01990f3b1 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:13.105388 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e08266-b7cf-49e4-9139-4db01990f3b1 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:13.105388 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e08266-b7cf-49e4-9139-4db01990f3b1 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:13.108405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 442/895] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:16:13.117279 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c0481-3683-4727-9195-c7c80feb87f5 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:13.117771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c0481-3683-4727-9195-c7c80feb87f5 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:13.118247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c0481-3683-4727-9195-c7c80feb87f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:13.152511 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-378c0481-3683-4727-9195-c7c80feb87f5 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:13.155419 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-378c0481-3683-4727-9195-c7c80feb87f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:13.244254 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4e1f4-3ff3-43e3-8778-30c8468665c6 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:13.318500 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 443/896] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 14:16:13.323485 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae5263-9753-48ea-944f-a1d0108b45b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:13.324562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae5263-9753-48ea-944f-a1d0108b45b1 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:13.325046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae5263-9753-48ea-944f-a1d0108b45b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:13.325546 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae5263-9753-48ea-944f-a1d0108b45b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:13.328008 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae5263-9753-48ea-944f-a1d0108b45b1 None admin] RBAC: Adding query filter params (role.id=d07f12353933422cbbf32385916d2bfa, scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba, user.id=c5dc12a8bc2b406b8a148bf609d5d2ba) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:13.328621 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae5263-9753-48ea-944f-a1d0108b45b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:13.331361 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae5263-9753-48ea-944f-a1d0108b45b1 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:13.344419 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 454/897] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:16:13 2022] GET /identity/v3/role_assignments?user.id=c5dc12a8bc2b406b8a148bf609d5d2ba&scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba&role.id=d07f12353933422cbbf32385916d2bfa => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:13.802252 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c0481-3683-4727-9195-c7c80feb87f5 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:13.878219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:13.942754 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c0481-3683-4727-9195-c7c80feb87f5 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:14.011597 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea86f9-714c-48ce-9d55-1c1d25d9759f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:14.013203 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea86f9-714c-48ce-9d55-1c1d25d9759f None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:14.014048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea86f9-714c-48ce-9d55-1c1d25d9759f None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:14.015000 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea86f9-714c-48ce-9d55-1c1d25d9759f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:14.016415 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea86f9-714c-48ce-9d55-1c1d25d9759f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:14.019113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea86f9-714c-48ce-9d55-1c1d25d9759f None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:14.037061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-d2ea86f9-714c-48ce-9d55-1c1d25d9759f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 14:16:14.037061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:14.037061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:16:14.037061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:16:14.037061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:16:14.037061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:16:14.037061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:16:14.037061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:14.037061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 14:16:14.037061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:14.037061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:16:14.037061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:14.037061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:14.037061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:14.037061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:14.037061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:14.037061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:14.039033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:14.039033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:14.039033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:14.039033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:14.039033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:14.039033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:14.039033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:16:14.039033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:16:14.039033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:16:14.039033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:16:14.039033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:14.039033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:14.039033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:14.039033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:14.039033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:14.039033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:14.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:14.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:14.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:14.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:14.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:14.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:14.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:14.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:14.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:14.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:14.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:16:14.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:14.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 14:16:14.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:14.046304 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 444/898] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Oct 4 14:16:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:14.054717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae5263-9753-48ea-944f-a1d0108b45b1 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:14.141262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:14.230175 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae5263-9753-48ea-944f-a1d0108b45b1 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:14.301169 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7a7b1-f7f1-4916-9ecf-ff85d0697af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:14.302759 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7a7b1-f7f1-4916-9ecf-ff85d0697af0 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:14.303528 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7a7b1-f7f1-4916-9ecf-ff85d0697af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:14.304389 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7a7b1-f7f1-4916-9ecf-ff85d0697af0 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:14.305828 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7a7b1-f7f1-4916-9ecf-ff85d0697af0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:14.306665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7a7b1-f7f1-4916-9ecf-ff85d0697af0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:14.309598 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7a7b1-f7f1-4916-9ecf-ff85d0697af0 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:14.320537 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 455/899] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Oct 4 14:16:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:14.328770 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea86f9-714c-48ce-9d55-1c1d25d9759f None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:14.526156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea86f9-714c-48ce-9d55-1c1d25d9759f None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:14.576991 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:14.592850 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3c491-75e2-40ca-8257-93bf1c5e2eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:14.593903 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3c491-75e2-40ca-8257-93bf1c5e2eec None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:14.594399 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3c491-75e2-40ca-8257-93bf1c5e2eec None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:14.594884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3c491-75e2-40ca-8257-93bf1c5e2eec None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:14.596085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3c491-75e2-40ca-8257-93bf1c5e2eec None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:14.596621 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3c491-75e2-40ca-8257-93bf1c5e2eec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:14.599222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3c491-75e2-40ca-8257-93bf1c5e2eec None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:14.610087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 445/900] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Oct 4 14:16:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:14.618426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7a7b1-f7f1-4916-9ecf-ff85d0697af0 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:14.788859 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7a7b1-f7f1-4916-9ecf-ff85d0697af0 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:14.817260 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:14.856596 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cc2dd-9768-43f1-8441-3a6011ede43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:14.857699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cc2dd-9768-43f1-8441-3a6011ede43a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:14.858163 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cc2dd-9768-43f1-8441-3a6011ede43a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:14.858650 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cc2dd-9768-43f1-8441-3a6011ede43a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:14.860107 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cc2dd-9768-43f1-8441-3a6011ede43a None admin] RBAC: Adding query filter params (interface=public, service_id=18bfde46746948e4b766f59ae3549678, region_id=RegionOne) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:14.860644 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cc2dd-9768-43f1-8441-3a6011ede43a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:14.863207 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cc2dd-9768-43f1-8441-3a6011ede43a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:14.874344 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 456/901] 10.222.0.62 () {56 vars in 1251 bytes} [Tue Oct 4 14:16:14 2022] GET /identity/v3/endpoints?service_id=18bfde46746948e4b766f59ae3549678&interface=public®ion_id=RegionOne => generated 194 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:14.879979 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3c491-75e2-40ca-8257-93bf1c5e2eec None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:15.047859 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3c491-75e2-40ca-8257-93bf1c5e2eec None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:15.125261 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85bf374-a0d1-4ac2-801e-0c0ea9a53228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:15.126348 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bf374-a0d1-4ac2-801e-0c0ea9a53228 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:15.126845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bf374-a0d1-4ac2-801e-0c0ea9a53228 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:15.127335 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bf374-a0d1-4ac2-801e-0c0ea9a53228 None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:15.128531 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85bf374-a0d1-4ac2-801e-0c0ea9a53228 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:15.131223 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85bf374-a0d1-4ac2-801e-0c0ea9a53228 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:15.145343 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 446/902] 10.222.0.62 () {56 vars in 1087 bytes} [Tue Oct 4 14:16:14 2022] GET /identity/v3/services => generated 1268 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:16:15.332058 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f1dd3-c504-469c-bc5d-7a98af71d2b4 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:15.332597 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f1dd3-c504-469c-bc5d-7a98af71d2b4 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:15.332932 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f1dd3-c504-469c-bc5d-7a98af71d2b4 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:15.335994 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 457/903] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:16:15.346313 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee68f9c-b2d6-4fa0-8b60-f6449f3c21b2 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:15.346835 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee68f9c-b2d6-4fa0-8b60-f6449f3c21b2 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:15.347268 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee68f9c-b2d6-4fa0-8b60-f6449f3c21b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:15.379994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-8ee68f9c-b2d6-4fa0-8b60-f6449f3c21b2 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:15.382099 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-8ee68f9c-b2d6-4fa0-8b60-f6449f3c21b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:15.485934 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:15.522189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 447/904] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:15 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:16:15.954719 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc84b6-a106-4d0f-ac95-f7c92afd3ed2 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:15.955202 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc84b6-a106-4d0f-ac95-f7c92afd3ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:15.956051 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc84b6-a106-4d0f-ac95-f7c92afd3ed2 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:15.959534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 458/905] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:16:15.970596 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e31b4-547d-47ee-9833-3b7ca16ccb3d None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:15.971535 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e31b4-547d-47ee-9833-3b7ca16ccb3d None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:15.972381 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e31b4-547d-47ee-9833-3b7ca16ccb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:16.005686 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-cf8e31b4-547d-47ee-9833-3b7ca16ccb3d None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:16.008331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-cf8e31b4-547d-47ee-9833-3b7ca16ccb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:16.059038 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc84b6-a106-4d0f-ac95-f7c92afd3ed2 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:16.120661 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 448/906] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:15 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:16:16.122015 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543aa97-3c74-4a3a-a927-4afdd5c876dd None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:16.122878 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543aa97-3c74-4a3a-a927-4afdd5c876dd None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:16.123275 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543aa97-3c74-4a3a-a927-4afdd5c876dd None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:16.129662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 449/907] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:16:16.131083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da039b00-0828-418f-a5aa-970ef0cf5ce7 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:16.131382 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da039b00-0828-418f-a5aa-970ef0cf5ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:16.131651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da039b00-0828-418f-a5aa-970ef0cf5ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:16.153254 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-da039b00-0828-418f-a5aa-970ef0cf5ce7 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:16.155316 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-da039b00-0828-418f-a5aa-970ef0cf5ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:16.259961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 450/908] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:16 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:16:16.274713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc84b6-a106-4d0f-ac95-f7c92afd3ed2 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:16.341529 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8bc8c-7f50-46a3-b623-50322614f59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:16.343894 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8bc8c-7f50-46a3-b623-50322614f59a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:16.344685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8bc8c-7f50-46a3-b623-50322614f59a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:16.345422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8bc8c-7f50-46a3-b623-50322614f59a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:16.346865 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8bc8c-7f50-46a3-b623-50322614f59a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:16.349969 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8bc8c-7f50-46a3-b623-50322614f59a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:16.369709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-14a8bc8c-7f50-46a3-b623-50322614f59a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 14:16:16.369709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:16.369709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:16:16.369709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:16:16.369709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:16:16.369709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:16:16.369709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:16:16.369709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:16.369709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 14:16:16.369709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:16.369709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:16:16.369709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:16.369709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:16.369709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:16.369709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:16.369709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:16.371527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:16.371527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:16.371527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:16.371527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:16.371527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:16.371527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:16.371527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:16.371527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:16:16.371527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:16:16.371527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:16:16.371527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:16:16.371527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:16.371527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:16.371527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:16.371527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:16.371527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:16.371527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:16.374592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:16.374592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:16.374592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:16.374592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:16.374592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:16.374592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:16.374592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:16.374592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:16.374592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:16.374592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:16.374592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:16:16.374592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:16.374592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 14:16:16.374592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:16.374592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 459/909] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Oct 4 14:16:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:16.380859 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da039b00-0828-418f-a5aa-970ef0cf5ce7 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:16.439970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8bc8c-7f50-46a3-b623-50322614f59a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:16.480678 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:16.492043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:16.581133 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da039b00-0828-418f-a5aa-970ef0cf5ce7 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:16.613620 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8bc8c-7f50-46a3-b623-50322614f59a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:16.624739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50235b5-0a02-4884-9642-d31caa5ed006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:16.625809 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50235b5-0a02-4884-9642-d31caa5ed006 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:16.625809 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50235b5-0a02-4884-9642-d31caa5ed006 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:16.626015 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50235b5-0a02-4884-9642-d31caa5ed006 None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:16.626551 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50235b5-0a02-4884-9642-d31caa5ed006 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:16.626854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50235b5-0a02-4884-9642-d31caa5ed006 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:16.628337 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50235b5-0a02-4884-9642-d31caa5ed006 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:16.634190 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 451/910] 10.222.0.62 () {56 vars in 1126 bytes} [Tue Oct 4 14:16:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:16.640655 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50235b5-0a02-4884-9642-d31caa5ed006 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:16.661143 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ad1b1-ba18-4c89-983f-2de786df9d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:16.662322 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ad1b1-ba18-4c89-983f-2de786df9d7b None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:16.662890 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ad1b1-ba18-4c89-983f-2de786df9d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:16.663445 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ad1b1-ba18-4c89-983f-2de786df9d7b None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:16.664353 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ad1b1-ba18-4c89-983f-2de786df9d7b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:16.666099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ad1b1-ba18-4c89-983f-2de786df9d7b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:16.696488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 460/911] 10.222.0.62 () {60 vars in 1141 bytes} [Tue Oct 4 14:16:16 2022] POST /identity/v3/services => generated 241 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:16:16.696488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ad1b1-ba18-4c89-983f-2de786df9d7b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:16.810036 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50235b5-0a02-4884-9642-d31caa5ed006 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:16.822924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:16.860209 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:16.865538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897573c-8e8e-4d0f-b384-2315b711514f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:16.867280 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897573c-8e8e-4d0f-b384-2315b711514f None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:16.867822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897573c-8e8e-4d0f-b384-2315b711514f None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:16.868271 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897573c-8e8e-4d0f-b384-2315b711514f None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:16.869481 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897573c-8e8e-4d0f-b384-2315b711514f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:16.869988 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897573c-8e8e-4d0f-b384-2315b711514f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:16.871624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ad1b1-ba18-4c89-983f-2de786df9d7b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:16.872191 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897573c-8e8e-4d0f-b384-2315b711514f None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:16.879390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 452/912] 10.222.0.62 () {56 vars in 1126 bytes} [Tue Oct 4 14:16:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:16.885359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897573c-8e8e-4d0f-b384-2315b711514f None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:16.921814 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4dd65-cef3-423d-bb3b-54db0a339fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:16.922821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4dd65-cef3-423d-bb3b-54db0a339fee None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:16.923108 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4dd65-cef3-423d-bb3b-54db0a339fee None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:16.923401 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4dd65-cef3-423d-bb3b-54db0a339fee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:16.940300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4dd65-cef3-423d-bb3b-54db0a339fee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:16:16.948669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-78e4dd65-cef3-423d-bb3b-54db0a339fee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 14:16:16.948669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:16.948669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:16.948669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:16.948669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:16.948669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:16.948669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:16.948669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:16.948669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:16.948669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:16.948669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:16.948669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:16.948669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:16:16.948669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:16:16.948669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:16:16.948669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:16:16.949799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:16:16.949799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:16:16.949799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:16:16.949799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:16:16.949799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:16.949799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:16.949799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:16.949799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:16.949799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:16.949799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:16.949799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:16.949799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:16.949799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:16.949799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:16.949799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:16.949799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:16.950794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:16.950794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:16.950794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:16.950794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:16.950794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:16:16.950794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:16:16.950794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:16:16.950794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:16:16.950794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:16:16.950794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:16:16.950794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 14:16:16.950794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:16.954610 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 461/913] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Oct 4 14:16:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:16.964383 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4dd65-cef3-423d-bb3b-54db0a339fee None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:17.033183 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897573c-8e8e-4d0f-b384-2315b711514f None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:17.097310 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd67398-7538-4db2-930a-85b9587e623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:17.097851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd67398-7538-4db2-930a-85b9587e623b None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:17.099753 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd67398-7538-4db2-930a-85b9587e623b None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:17.099753 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd67398-7538-4db2-930a-85b9587e623b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:17.100053 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd67398-7538-4db2-930a-85b9587e623b None admin] RBAC: Adding query filter params (interface=public, service_id=c1a5c976ae834a529c423e4837dc09c5, region_id=RegionOne) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:17.100415 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd67398-7538-4db2-930a-85b9587e623b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:17.101813 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd67398-7538-4db2-930a-85b9587e623b None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:17.110052 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 453/914] 10.222.0.62 () {56 vars in 1251 bytes} [Tue Oct 4 14:16:16 2022] GET /identity/v3/endpoints?service_id=c1a5c976ae834a529c423e4837dc09c5&interface=public®ion_id=RegionOne => generated 194 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:17.117554 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd67398-7538-4db2-930a-85b9587e623b None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:17.155443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4dd65-cef3-423d-bb3b-54db0a339fee None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:17.162441 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:17.206036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ab97e-8e3a-41ec-8860-0f9cb29350fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:17.206782 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ab97e-8e3a-41ec-8860-0f9cb29350fb None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:17.207065 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ab97e-8e3a-41ec-8860-0f9cb29350fb None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:17.207335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ab97e-8e3a-41ec-8860-0f9cb29350fb None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:17.208169 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ab97e-8e3a-41ec-8860-0f9cb29350fb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:17.208477 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ab97e-8e3a-41ec-8860-0f9cb29350fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:17.209979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ab97e-8e3a-41ec-8860-0f9cb29350fb None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:17.224306 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 462/915] 10.222.0.62 () {56 vars in 1115 bytes} [Tue Oct 4 14:16:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:17.229732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ab97e-8e3a-41ec-8860-0f9cb29350fb None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:17.252004 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd67398-7538-4db2-930a-85b9587e623b None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:17.252652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:17.296646 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab565a7-5c48-4b6d-91b0-30484cd8daf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:17.297545 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab565a7-5c48-4b6d-91b0-30484cd8daf6 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:17.298005 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab565a7-5c48-4b6d-91b0-30484cd8daf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:17.298424 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab565a7-5c48-4b6d-91b0-30484cd8daf6 None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:17.299218 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab565a7-5c48-4b6d-91b0-30484cd8daf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:17.301061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab565a7-5c48-4b6d-91b0-30484cd8daf6 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:17.315908 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 454/916] 10.222.0.62 () {56 vars in 1087 bytes} [Tue Oct 4 14:16:17 2022] GET /identity/v3/services => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:16:17.358961 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ab97e-8e3a-41ec-8860-0f9cb29350fb None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:17.402573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe67f92-2068-45ad-92cf-910063e5245e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:17.403266 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe67f92-2068-45ad-92cf-910063e5245e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:17.403573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe67f92-2068-45ad-92cf-910063e5245e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:17.404002 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe67f92-2068-45ad-92cf-910063e5245e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:17.428411 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe67f92-2068-45ad-92cf-910063e5245e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:17.431321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe67f92-2068-45ad-92cf-910063e5245e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:17.463365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-5fe67f92-2068-45ad-92cf-910063e5245e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:17.463365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:17.463365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:17.463365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:17.463365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:17.463365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:17.463365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:17.463365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:17.463365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:17.463365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:17.463365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:17.463365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:17.463365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:16:17.463365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:16:17.463365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:16:17.463365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:16:17.464573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:17.464573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:17.464573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:17.464573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:17.464573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:17.464573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:17.464573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:17.464573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:17.464573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:17.464573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:17.464573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:17.464573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:17.464573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:17.464573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:17.464573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:17.464573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:17.464573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:16:17.465656 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:16:17.465656 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:17.465656 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:17.465982 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 463/917] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:17.476194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab565a7-5c48-4b6d-91b0-30484cd8daf6 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:17.687247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:17.698874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab565a7-5c48-4b6d-91b0-30484cd8daf6 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:17.753889 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe7249-d552-40c1-8b1c-52220ae9c335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:17.754812 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe7249-d552-40c1-8b1c-52220ae9c335 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:17.755241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe7249-d552-40c1-8b1c-52220ae9c335 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:17.755662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe7249-d552-40c1-8b1c-52220ae9c335 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:17.756523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe7249-d552-40c1-8b1c-52220ae9c335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:17.756988 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe7249-d552-40c1-8b1c-52220ae9c335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:17.758590 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe7249-d552-40c1-8b1c-52220ae9c335 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:17.770416 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d17649-825b-4eca-8525-366c6de89f24 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:17.770735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d17649-825b-4eca-8525-366c6de89f24 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:17.771015 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d17649-825b-4eca-8525-366c6de89f24 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:17.773104 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 464/918] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:16:17.774626 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 455/919] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:17.779553 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5878e1a-0d98-45af-92c3-2bac107a9f59 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:17.779877 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5878e1a-0d98-45af-92c3-2bac107a9f59 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:17.780183 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5878e1a-0d98-45af-92c3-2bac107a9f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:17.782120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe7249-d552-40c1-8b1c-52220ae9c335 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:17.801335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-b5878e1a-0d98-45af-92c3-2bac107a9f59 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:17.802927 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b5878e1a-0d98-45af-92c3-2bac107a9f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:17.904841 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:17.917721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 465/920] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:16:17.920704 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe7249-d552-40c1-8b1c-52220ae9c335 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:17.987497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588a6c0-1f76-4ec9-b48f-47c04686002d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:17.989155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588a6c0-1f76-4ec9-b48f-47c04686002d None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:17.989858 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588a6c0-1f76-4ec9-b48f-47c04686002d None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:17.990554 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588a6c0-1f76-4ec9-b48f-47c04686002d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:18.006741 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588a6c0-1f76-4ec9-b48f-47c04686002d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:18.009951 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588a6c0-1f76-4ec9-b48f-47c04686002d None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:18.036853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-9588a6c0-1f76-4ec9-b48f-47c04686002d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 14:16:18.036853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:18.036853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:18.036853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:18.036853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:18.036853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:18.036853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:18.036853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:18.036853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:18.036853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:18.036853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:18.036853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:18.036853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:16:18.036853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:16:18.036853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:16:18.036853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:16:18.038826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:18.038826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:18.038826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:16:18.038826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:16:18.038826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:16:18.038826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:16:18.038826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:18.038826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:18.038826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:18.038826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:18.038826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:18.038826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:18.038826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:18.038826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:18.038826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:18.038826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:18.038826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:18.038826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:18.040792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:18.040792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:18.040792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:16:18.040792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:16:18.040792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:16:18.040792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:16:18.040792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:16:18.040792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:16:18.040792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 14:16:18.040792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:18.045507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 456/921] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Oct 4 14:16:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:18.053153 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5878e1a-0d98-45af-92c3-2bac107a9f59 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:18.173383 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5878e1a-0d98-45af-92c3-2bac107a9f59 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:18.222788 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2a335-b63d-47e8-9f73-45522eabb5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:18.223867 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2a335-b63d-47e8-9f73-45522eabb5a5 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:18.224282 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2a335-b63d-47e8-9f73-45522eabb5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:18.224767 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2a335-b63d-47e8-9f73-45522eabb5a5 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:18.226181 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2a335-b63d-47e8-9f73-45522eabb5a5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:18.226714 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2a335-b63d-47e8-9f73-45522eabb5a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:18.229450 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2a335-b63d-47e8-9f73-45522eabb5a5 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:18.266363 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 466/922] 10.222.0.62 () {56 vars in 1149 bytes} [Tue Oct 4 14:16:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:18.275297 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588a6c0-1f76-4ec9-b48f-47c04686002d None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:18.311751 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:18.326840 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2a335-b63d-47e8-9f73-45522eabb5a5 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:18.446288 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:18.491143 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588a6c0-1f76-4ec9-b48f-47c04686002d None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:18.538249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2a335-b63d-47e8-9f73-45522eabb5a5 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:18.562924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5573d0-f866-4f90-9857-9c993c49970e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:18.564344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5573d0-f866-4f90-9857-9c993c49970e None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:18.564942 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5573d0-f866-4f90-9857-9c993c49970e None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:18.565482 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5573d0-f866-4f90-9857-9c993c49970e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:18.580002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5573d0-f866-4f90-9857-9c993c49970e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:18.582206 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5573d0-f866-4f90-9857-9c993c49970e None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:18.601282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-7a5573d0-f866-4f90-9857-9c993c49970e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:18.601282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:18.601282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:18.601282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:18.601282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:18.601282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:18.601282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:18.601282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:18.601282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:18.601282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:18.601282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:18.601282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:18.601282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:16:18.601282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:16:18.601282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:16:18.601282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:16:18.602343 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:18.602343 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:18.602343 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:18.602343 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:18.602343 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:18.602343 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:18.602343 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:18.602343 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:18.602343 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:18.602343 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:18.602343 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:18.602343 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:18.602343 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:18.602343 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:18.602343 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:18.602343 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:18.602343 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:16:18.603265 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:16:18.603265 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:18.603265 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:18.603446 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19cf05-d257-4d54-84d2-11c6cd3c4bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:18.604092 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19cf05-d257-4d54-84d2-11c6cd3c4bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:18.604547 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19cf05-d257-4d54-84d2-11c6cd3c4bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:18.604996 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19cf05-d257-4d54-84d2-11c6cd3c4bd9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:18.606085 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19cf05-d257-4d54-84d2-11c6cd3c4bd9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:18.606627 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 457/923] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:18.612385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19cf05-d257-4d54-84d2-11c6cd3c4bd9 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:18.614476 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5573d0-f866-4f90-9857-9c993c49970e None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:18.628285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-6d19cf05-d257-4d54-84d2-11c6cd3c4bd9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 14:16:18.628285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:18.628285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:16:18.628285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:16:18.628285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:16:18.628285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:16:18.628285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:16:18.628285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:18.628285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 14:16:18.628285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:18.628285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:16:18.628285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:18.628285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:18.628285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:18.628285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:18.628285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:18.628285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:18.629426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:18.629426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:18.629426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:18.629426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:18.629426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:18.629426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:18.629426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:16:18.629426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:16:18.629426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:16:18.629426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:16:18.629426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:18.629426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:18.629426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:18.629426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:18.629426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:18.629426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:18.630290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:18.630290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:18.630290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:18.630290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:18.630290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:18.630290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:18.630290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:18.630290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:18.630290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:18.630290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:18.630290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:16:18.630290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:18.630290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 14:16:18.630290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:18.636046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 467/924] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Oct 4 14:16:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:18.640840 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19cf05-d257-4d54-84d2-11c6cd3c4bd9 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:18.710012 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:18.754649 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5573d0-f866-4f90-9857-9c993c49970e None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:18.798512 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b02a0-4582-45f2-adc3-7c59e2cf88b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:18.799606 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b02a0-4582-45f2-adc3-7c59e2cf88b4 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:18.800161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b02a0-4582-45f2-adc3-7c59e2cf88b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:18.800722 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b02a0-4582-45f2-adc3-7c59e2cf88b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:18.801770 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b02a0-4582-45f2-adc3-7c59e2cf88b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:18.802358 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b02a0-4582-45f2-adc3-7c59e2cf88b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:18.804110 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b02a0-4582-45f2-adc3-7c59e2cf88b4 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:18.825102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 458/925] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:18.827968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b02a0-4582-45f2-adc3-7c59e2cf88b4 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:18.838747 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19cf05-d257-4d54-84d2-11c6cd3c4bd9 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:18.882112 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:18.914914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec21ca3-e272-47e5-b5a2-33c9b1c01331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:18.915991 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec21ca3-e272-47e5-b5a2-33c9b1c01331 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:18.916476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec21ca3-e272-47e5-b5a2-33c9b1c01331 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:18.917045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec21ca3-e272-47e5-b5a2-33c9b1c01331 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:18.918152 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec21ca3-e272-47e5-b5a2-33c9b1c01331 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:18.918709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec21ca3-e272-47e5-b5a2-33c9b1c01331 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:18.922994 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec21ca3-e272-47e5-b5a2-33c9b1c01331 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:18.940187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 468/926] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Oct 4 14:16:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:18.943965 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec21ca3-e272-47e5-b5a2-33c9b1c01331 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:18.961464 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b02a0-4582-45f2-adc3-7c59e2cf88b4 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:18.994961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:19.007141 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d4319-9744-44cb-b8d0-451af09498a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:19.008372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d4319-9744-44cb-b8d0-451af09498a9 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:19.008903 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d4319-9744-44cb-b8d0-451af09498a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:19.009441 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d4319-9744-44cb-b8d0-451af09498a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:19.019294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d4319-9744-44cb-b8d0-451af09498a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:19.021267 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d4319-9744-44cb-b8d0-451af09498a9 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:19.036523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-f65d4319-9744-44cb-b8d0-451af09498a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:16:19.036523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:19.036523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:19.036523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:19.036523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:19.036523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:19.036523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:19.036523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:19.036523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:19.036523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:19.036523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:19.036523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:19.036523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:16:19.036523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:16:19.036523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:16:19.037585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:16:19.037585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:19.037585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:19.037585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:19.037585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:19.037585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:19.037585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:19.037585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:19.037585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:19.037585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:19.037585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:19.037585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:19.037585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:19.037585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:19.037585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:19.037585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:19.037585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:19.038482 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:16:19.038482 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:16:19.038482 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:16:19.038482 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:16:19.038482 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:16:19.038482 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:16:19.038482 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:16:19.038482 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:19.047824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 459/927] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:16:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:16:19.049844 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d4319-9744-44cb-b8d0-451af09498a9 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:19.180476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec21ca3-e272-47e5-b5a2-33c9b1c01331 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:19.185746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d4319-9744-44cb-b8d0-451af09498a9 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:19.231012 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888f052-911a-4037-9215-88c9592d8b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:19.232949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888f052-911a-4037-9215-88c9592d8b45 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:19.233705 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888f052-911a-4037-9215-88c9592d8b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:19.234213 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888f052-911a-4037-9215-88c9592d8b45 None admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:19.235167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888f052-911a-4037-9215-88c9592d8b45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:19.235737 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888f052-911a-4037-9215-88c9592d8b45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:19.237566 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888f052-911a-4037-9215-88c9592d8b45 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:19.259905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 460/928] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:16:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:19.261325 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2f3f4-f756-4d89-9608-8157f0083088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:19.262487 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2f3f4-f756-4d89-9608-8157f0083088 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:19.263866 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2f3f4-f756-4d89-9608-8157f0083088 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:19.264636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2f3f4-f756-4d89-9608-8157f0083088 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:19.265854 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2f3f4-f756-4d89-9608-8157f0083088 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:19.266427 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2f3f4-f756-4d89-9608-8157f0083088 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:19.266582 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888f052-911a-4037-9215-88c9592d8b45 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:19.269104 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2f3f4-f756-4d89-9608-8157f0083088 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:19.287849 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 469/929] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Oct 4 14:16:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:19.292238 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2f3f4-f756-4d89-9608-8157f0083088 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:19.372701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:19.394875 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:19.472642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888f052-911a-4037-9215-88c9592d8b45 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:19.498018 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2f3f4-f756-4d89-9608-8157f0083088 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:19.545050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051095a-3765-4e80-9bd7-a18501b21926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:19.546490 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051095a-3765-4e80-9bd7-a18501b21926 None admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:19.546650 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051095a-3765-4e80-9bd7-a18501b21926 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:19.547001 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051095a-3765-4e80-9bd7-a18501b21926 None admin] PATH_INFO: `/v3/projects/fd73ece314ef4f2eabb34e2a88d610ba/users/c5dc12a8bc2b406b8a148bf609d5d2ba/roles/d07f12353933422cbbf32385916d2bfa` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:19.555868 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051095a-3765-4e80-9bd7-a18501b21926 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd73ece314ef4f2eabb34e2a88d610ba, user_id=c5dc12a8bc2b406b8a148bf609d5d2ba, role_id=d07f12353933422cbbf32385916d2bfa)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:19.558602 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051095a-3765-4e80-9bd7-a18501b21926 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:19.566886 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00cdc3-1b19-4072-91c4-327cef27607b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:19.567675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00cdc3-1b19-4072-91c4-327cef27607b None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:19.567961 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00cdc3-1b19-4072-91c4-327cef27607b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:19.568239 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00cdc3-1b19-4072-91c4-327cef27607b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:19.569098 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00cdc3-1b19-4072-91c4-327cef27607b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:19.570760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00cdc3-1b19-4072-91c4-327cef27607b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:19.580826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 461/930] 10.222.0.62 () {58 vars in 1439 bytes} [Tue Oct 4 14:16:19 2022] PUT /identity/v3/projects/fd73ece314ef4f2eabb34e2a88d610ba/users/c5dc12a8bc2b406b8a148bf609d5d2ba/roles/d07f12353933422cbbf32385916d2bfa => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:16:19.587264 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86549853-1d32-4aa1-8a12-ec808fb31447 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:19.588099 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86549853-1d32-4aa1-8a12-ec808fb31447 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:19.588890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86549853-1d32-4aa1-8a12-ec808fb31447 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:19.599474 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 462/931] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:19 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:16:19.601894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46de8a4-f9be-4de4-ad05-ac6bdd85bd64 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:19.602412 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46de8a4-f9be-4de4-ad05-ac6bdd85bd64 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:19.602913 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46de8a4-f9be-4de4-ad05-ac6bdd85bd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:19.604055 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 470/932] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:16:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:16:19.648245 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-f46de8a4-f9be-4de4-ad05-ac6bdd85bd64 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:19.650220 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f46de8a4-f9be-4de4-ad05-ac6bdd85bd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:19.812245 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 463/933] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 14:16:20.328280 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00cdc3-1b19-4072-91c4-327cef27607b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:20.570810 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00cdc3-1b19-4072-91c4-327cef27607b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:20.588211 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:20.614595 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affc0b4-c2a0-4767-ad79-da7e68297ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:20.615256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affc0b4-c2a0-4767-ad79-da7e68297ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:20.615534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affc0b4-c2a0-4767-ad79-da7e68297ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:20.615839 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affc0b4-c2a0-4767-ad79-da7e68297ae3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:20.616437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affc0b4-c2a0-4767-ad79-da7e68297ae3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:20.617925 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affc0b4-c2a0-4767-ad79-da7e68297ae3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:20.628639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-9affc0b4-c2a0-4767-ad79-da7e68297ae3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 14:16:20.628639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:20.628639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:16:20.628639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:16:20.628639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:16:20.628639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:16:20.628639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:16:20.628639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:20.628639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 14:16:20.628639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:20.628639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:16:20.628639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:20.628639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:20.628639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:20.628639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:20.628639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:20.628639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:20.630510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:20.630510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:20.630510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:20.630510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:20.630510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:20.630510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:20.630510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:16:20.630510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:16:20.630510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:16:20.630510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:16:20.630510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:20.630510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:20.630510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:20.630510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:20.630510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:20.630510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:20.632258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:20.632258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:20.632258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:20.632258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:20.632258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:20.632258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:20.632258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:20.632258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:20.632258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:20.632258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:20.632258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:16:20.632258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:20.632258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 14:16:20.632258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:20.632258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 471/934] 10.222.0.62 () {56 vars in 1126 bytes} [Tue Oct 4 14:16:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:16:20.639842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46de8a4-f9be-4de4-ad05-ac6bdd85bd64 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:20.682759 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:20.748802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdfad1-0b24-4cdd-a038-ca3435cd756b None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:20.749228 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdfad1-0b24-4cdd-a038-ca3435cd756b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:20.749468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdfad1-0b24-4cdd-a038-ca3435cd756b None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:20.751298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 472/935] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:16:20.757445 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2171f-254f-49e5-a71d-8f10089674f7 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:20.757912 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2171f-254f-49e5-a71d-8f10089674f7 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:20.758157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2171f-254f-49e5-a71d-8f10089674f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:20.781689 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46de8a4-f9be-4de4-ad05-ac6bdd85bd64 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:20.787765 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-55a2171f-254f-49e5-a71d-8f10089674f7 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:20.790066 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-55a2171f-254f-49e5-a71d-8f10089674f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:20.827867 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c80740-4e27-45b6-ab36-93c82c8e57be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:20.828508 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c80740-4e27-45b6-ab36-93c82c8e57be None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:20.828781 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c80740-4e27-45b6-ab36-93c82c8e57be None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:20.829050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c80740-4e27-45b6-ab36-93c82c8e57be None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:20.829715 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c80740-4e27-45b6-ab36-93c82c8e57be None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:20.830012 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c80740-4e27-45b6-ab36-93c82c8e57be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:20.831461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c80740-4e27-45b6-ab36-93c82c8e57be None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:20.837628 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 464/936] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Oct 4 14:16:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:20.844822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c80740-4e27-45b6-ab36-93c82c8e57be None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:20.931137 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 473/937] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:16:20.976240 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c80740-4e27-45b6-ab36-93c82c8e57be None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:20.979733 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:21.021445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2aab9-aef9-4499-92cf-ad5e91dd32e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:21.022113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2aab9-aef9-4499-92cf-ad5e91dd32e3 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:21.022384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2aab9-aef9-4499-92cf-ad5e91dd32e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:21.022633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2aab9-aef9-4499-92cf-ad5e91dd32e3 None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:21.023326 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2aab9-aef9-4499-92cf-ad5e91dd32e3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:21.023656 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2aab9-aef9-4499-92cf-ad5e91dd32e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:21.025149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2aab9-aef9-4499-92cf-ad5e91dd32e3 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:21.032411 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 465/938] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Oct 4 14:16:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:21.039221 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2171f-254f-49e5-a71d-8f10089674f7 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:21.220572 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2aab9-aef9-4499-92cf-ad5e91dd32e3 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:21.248056 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2171f-254f-49e5-a71d-8f10089674f7 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:21.268135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:21.319399 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c780fc0-7d0d-4740-81b2-49e383f1b5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:21.320496 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c780fc0-7d0d-4740-81b2-49e383f1b5e6 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:21.320987 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c780fc0-7d0d-4740-81b2-49e383f1b5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:21.321620 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c780fc0-7d0d-4740-81b2-49e383f1b5e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:21.322955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c780fc0-7d0d-4740-81b2-49e383f1b5e6 None admin] RBAC: Adding query filter params (interface=public, service_id=6e8970ed9ace48a2a1999485ec560808, region_id=RegionOne) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:21.323728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c780fc0-7d0d-4740-81b2-49e383f1b5e6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:21.326997 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c780fc0-7d0d-4740-81b2-49e383f1b5e6 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:21.338110 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 474/939] 10.222.0.62 () {56 vars in 1251 bytes} [Tue Oct 4 14:16:21 2022] GET /identity/v3/endpoints?service_id=6e8970ed9ace48a2a1999485ec560808&interface=public®ion_id=RegionOne => generated 194 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:21.347645 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c780fc0-7d0d-4740-81b2-49e383f1b5e6 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:21.370135 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2aab9-aef9-4499-92cf-ad5e91dd32e3 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:21.457307 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a00778-81b8-410e-86fe-b3758347e66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:21.458404 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a00778-81b8-410e-86fe-b3758347e66d None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:21.458882 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a00778-81b8-410e-86fe-b3758347e66d None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:21.459352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a00778-81b8-410e-86fe-b3758347e66d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:21.461302 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a00778-81b8-410e-86fe-b3758347e66d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:21.465568 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a00778-81b8-410e-86fe-b3758347e66d None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:21.490668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-a9a00778-81b8-410e-86fe-b3758347e66d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 14:16:21.490668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:21.490668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:16:21.490668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:16:21.490668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:16:21.490668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:16:21.490668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:16:21.490668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:21.490668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 14:16:21.490668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:21.490668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:16:21.490668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:21.490668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:21.490668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:21.490668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:21.490668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:21.491701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:21.491701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:21.491701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:21.491701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:21.491701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:21.491701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:21.491701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:21.491701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:16:21.491701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:16:21.491701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:16:21.491701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:16:21.491701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:21.491701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:21.491701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:21.491701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:21.491701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:21.491701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:21.492633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:21.492633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:21.492633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:21.492633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:21.492633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:21.492633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:21.492633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:21.492633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:21.492633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:21.492633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:21.492633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:16:21.492633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:21.492633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 14:16:21.492633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:21.493942 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 466/940] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Oct 4 14:16:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:21.499168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c780fc0-7d0d-4740-81b2-49e383f1b5e6 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:21.509252 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a00778-81b8-410e-86fe-b3758347e66d None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:21.553782 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289af540-6bf8-4eaf-90d3-88d805fc68ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:21.554417 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289af540-6bf8-4eaf-90d3-88d805fc68ea None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:21.554706 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289af540-6bf8-4eaf-90d3-88d805fc68ea None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:21.555016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289af540-6bf8-4eaf-90d3-88d805fc68ea None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:21.555644 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289af540-6bf8-4eaf-90d3-88d805fc68ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:21.557870 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289af540-6bf8-4eaf-90d3-88d805fc68ea None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:21.565064 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 475/941] 10.222.0.62 () {56 vars in 1087 bytes} [Tue Oct 4 14:16:21 2022] GET /identity/v3/services => generated 1497 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:16:21.584155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:21.740191 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a00778-81b8-410e-86fe-b3758347e66d None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:21.815153 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d4d5a-5cd7-4fe1-a2c1-ee298b9996be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:21.816592 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d4d5a-5cd7-4fe1-a2c1-ee298b9996be None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:21.817293 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d4d5a-5cd7-4fe1-a2c1-ee298b9996be None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:21.817977 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d4d5a-5cd7-4fe1-a2c1-ee298b9996be None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:21.819366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d4d5a-5cd7-4fe1-a2c1-ee298b9996be None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:21.820086 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d4d5a-5cd7-4fe1-a2c1-ee298b9996be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:21.822901 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d4d5a-5cd7-4fe1-a2c1-ee298b9996be None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:21.833146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 467/942] 10.222.0.62 () {56 vars in 1126 bytes} [Tue Oct 4 14:16:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:21.838880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289af540-6bf8-4eaf-90d3-88d805fc68ea None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:21.872872 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:21.959461 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289af540-6bf8-4eaf-90d3-88d805fc68ea None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:22.000012 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f0681-2f78-4c25-b84d-b5b46288089d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:22.000738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f0681-2f78-4c25-b84d-b5b46288089d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:22.001014 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f0681-2f78-4c25-b84d-b5b46288089d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:22.001283 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f0681-2f78-4c25-b84d-b5b46288089d None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:22.001937 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f0681-2f78-4c25-b84d-b5b46288089d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:22.002238 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f0681-2f78-4c25-b84d-b5b46288089d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:22.003649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f0681-2f78-4c25-b84d-b5b46288089d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:22.014603 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 476/943] 10.222.0.62 () {56 vars in 1126 bytes} [Tue Oct 4 14:16:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:22.016842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d4d5a-5cd7-4fe1-a2c1-ee298b9996be None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:22.126418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:22.138546 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d4d5a-5cd7-4fe1-a2c1-ee298b9996be None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:22.183238 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec816c6-f5be-4639-a463-b79a6b349772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:22.183908 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec816c6-f5be-4639-a463-b79a6b349772 None admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:22.184188 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec816c6-f5be-4639-a463-b79a6b349772 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:22.184456 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec816c6-f5be-4639-a463-b79a6b349772 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:22.185868 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec816c6-f5be-4639-a463-b79a6b349772 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:22.187541 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec816c6-f5be-4639-a463-b79a6b349772 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:22.211746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 468/944] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:16:22 2022] POST /identity/v3/endpoints => generated 347 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:16:22.454652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78943918-3df0-4719-a589-c8fcb23fc52c None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:22.454843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78943918-3df0-4719-a589-c8fcb23fc52c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:22.455182 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78943918-3df0-4719-a589-c8fcb23fc52c None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:22.456655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 477/945] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:16:22.465296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85526a2-0d30-44a7-9b4f-51d0045e07e6 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:22.465614 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85526a2-0d30-44a7-9b4f-51d0045e07e6 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:22.466776 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85526a2-0d30-44a7-9b4f-51d0045e07e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:22.488671 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-c85526a2-0d30-44a7-9b4f-51d0045e07e6 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:22.490038 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-c85526a2-0d30-44a7-9b4f-51d0045e07e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:22.588874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 469/946] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:16:22.642280 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e1180-e368-41c1-9237-da3df21e6bb7 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:22.642620 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e1180-e368-41c1-9237-da3df21e6bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:22.642839 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e1180-e368-41c1-9237-da3df21e6bb7 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:22.644669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 478/947] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:16:22.650723 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe13031-81de-41bb-928c-b2d7fbfa8597 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:22.651031 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe13031-81de-41bb-928c-b2d7fbfa8597 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:22.651282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe13031-81de-41bb-928c-b2d7fbfa8597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:22.674282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-2fe13031-81de-41bb-928c-b2d7fbfa8597 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:22.675518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-2fe13031-81de-41bb-928c-b2d7fbfa8597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:22.758173 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 470/948] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 14:16:22.992770 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e1180-e368-41c1-9237-da3df21e6bb7 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:23.102677 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:23.115244 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e1180-e368-41c1-9237-da3df21e6bb7 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:23.158826 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc2676-e89c-42f1-a7f0-02633a84e874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:23.161145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc2676-e89c-42f1-a7f0-02633a84e874 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:23.161607 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc2676-e89c-42f1-a7f0-02633a84e874 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:23.162065 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc2676-e89c-42f1-a7f0-02633a84e874 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:23.162813 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe13031-81de-41bb-928c-b2d7fbfa8597 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:23.166369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:23.178542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc2676-e89c-42f1-a7f0-02633a84e874 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:16:23.183768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-a5fc2676-e89c-42f1-a7f0-02633a84e874 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 14:16:23.183768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:23.183768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:23.183768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:23.183768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:23.183768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:23.183768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:23.183768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:23.183768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:23.183768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:23.183768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:23.183768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:23.183768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:16:23.183768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:16:23.183768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:16:23.183768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:16:23.185043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:16:23.185043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:16:23.185043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:16:23.185043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:16:23.185043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:23.185043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:23.185043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:23.185043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:23.185043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:23.185043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:23.185043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:23.185043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:23.185043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:23.185043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:23.185043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:23.185043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:23.186222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:23.186222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:23.186222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:23.186222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:23.186222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:16:23.186222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:16:23.186222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:16:23.186222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:16:23.186222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:16:23.186222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:16:23.186222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 14:16:23.186222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:23.189130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 479/949] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Oct 4 14:16:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:23.195553 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc2676-e89c-42f1-a7f0-02633a84e874 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:23.329118 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc2676-e89c-42f1-a7f0-02633a84e874 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:23.376239 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe13031-81de-41bb-928c-b2d7fbfa8597 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:23.408090 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c60c82-8ee8-47e9-938c-2e0ee3512b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:23.409634 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c60c82-8ee8-47e9-938c-2e0ee3512b3a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:23.410361 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c60c82-8ee8-47e9-938c-2e0ee3512b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:23.411129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c60c82-8ee8-47e9-938c-2e0ee3512b3a None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:23.412769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c60c82-8ee8-47e9-938c-2e0ee3512b3a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:23.413562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c60c82-8ee8-47e9-938c-2e0ee3512b3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:23.416577 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c60c82-8ee8-47e9-938c-2e0ee3512b3a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:23.440239 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 480/950] 10.222.0.62 () {56 vars in 1115 bytes} [Tue Oct 4 14:16:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:23.442322 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b685491-10c3-48b0-b644-02a513b62b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:23.443371 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b685491-10c3-48b0-b644-02a513b62b87 None admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:23.443908 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b685491-10c3-48b0-b644-02a513b62b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:23.444373 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b685491-10c3-48b0-b644-02a513b62b87 None admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:23.445653 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b685491-10c3-48b0-b644-02a513b62b87 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:23.448049 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c60c82-8ee8-47e9-938c-2e0ee3512b3a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:23.448816 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b685491-10c3-48b0-b644-02a513b62b87 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:23.454135 dv-cinder-860260-1-smb devstack@keystone.service[81468]: WARNING keystone.server.flask.common [None req-7b685491-10c3-48b0-b644-02a513b62b87 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 04 14:16:23.480842 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:23.491550 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.sql.core [None req-7b685491-10c3-48b0-b644-02a513b62b87 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 14:16:23.491550 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 14:16:23.491550 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [parameters: {'id': '71f1dc53b73f456bbdc2c7c74bc5e1d3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 04 14:16:23.491550 dv-cinder-860260-1-smb devstack@keystone.service[81468]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81468) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 14:16:23.508726 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-7b685491-10c3-48b0-b644-02a513b62b87 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 71f1dc53b73f456bbdc2c7c74bc5e1d3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 71f1dc53b73f456bbdc2c7c74bc5e1d3. Oct 04 14:16:23.508726 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:23.508726 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 14:16:23.508726 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 14:16:23.508726 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 14:16:23.508726 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 14:16:23.508726 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 14:16:23.508726 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 14:16:23.508726 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 14:16:23.508726 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application conn.query(q) Oct 04 14:16:23.508726 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 14:16:23.508726 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 14:16:23.508726 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 14:16:23.510555 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application result.read() Oct 04 14:16:23.510555 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 14:16:23.510555 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 14:16:23.510555 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 14:16:23.510555 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 14:16:23.510555 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 14:16:23.510555 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 14:16:23.510555 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 14:16:23.510555 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 14:16:23.510555 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 14:16:23.510555 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:23.510555 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 14:16:23.510555 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:23.510555 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:23.510555 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 14:16:23.510555 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 14:16:23.510555 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 04 14:16:23.510555 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 04 14:16:23.512839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 14:16:23.512839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application next(self.gen) Oct 04 14:16:23.512839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 14:16:23.512839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application yield resource Oct 04 14:16:23.512839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 14:16:23.512839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application next(self.gen) Oct 04 14:16:23.512839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 14:16:23.512839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 14:16:23.512839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 14:16:23.512839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 14:16:23.512839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 14:16:23.512839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise self.value Oct 04 14:16:23.512839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 14:16:23.512839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 14:16:23.512839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 14:16:23.512839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application session.commit() Oct 04 14:16:23.512839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 14:16:23.514890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 14:16:23.514890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 14:16:23.514890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 14:16:23.514890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 14:16:23.514890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self.session.flush() Oct 04 14:16:23.514890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 14:16:23.514890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 14:16:23.514890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 14:16:23.514890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 14:16:23.514890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 14:16:23.514890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application compat.raise_( Oct 04 14:16:23.514890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 14:16:23.514890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception Oct 04 14:16:23.514890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 14:16:23.514890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 14:16:23.514890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 14:16:23.514890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 14:16:23.516758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 14:16:23.516758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 14:16:23.516758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 14:16:23.516758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 14:16:23.516758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 04 14:16:23.516758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 04 14:16:23.516758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 14:16:23.516758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 14:16:23.516758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 14:16:23.516758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 14:16:23.516758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 14:16:23.516758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 14:16:23.516758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 14:16:23.516758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 14:16:23.516758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 14:16:23.518363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 14:16:23.518363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 14:16:23.518363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception Oct 04 14:16:23.518363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 14:16:23.518363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 14:16:23.518363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 14:16:23.518363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 14:16:23.518363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 14:16:23.518363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 14:16:23.518363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 14:16:23.518363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application conn.query(q) Oct 04 14:16:23.518363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 14:16:23.518363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 14:16:23.518363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 14:16:23.518363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application result.read() Oct 04 14:16:23.518363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 14:16:23.518363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 14:16:23.521221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 14:16:23.521221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 14:16:23.521221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 14:16:23.521221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 14:16:23.521221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 14:16:23.521221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 14:16:23.521221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 14:16:23.521221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 14:16:23.521221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [parameters: {'id': '71f1dc53b73f456bbdc2c7c74bc5e1d3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 04 14:16:23.521221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 14:16:23.521221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:23.521221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:16:23.521221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:23.521221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:23.521221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 04 14:16:23.525871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 04 14:16:23.525871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 14:16:23.525871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 14:16:23.525871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 04 14:16:23.525871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:23.525871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:16:23.525871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:23.525871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:23.525871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:23.525871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:23.525871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:23.525871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:23.525871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:23.525871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:23.525871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:23.525871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:23.525871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:23.530075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:23.530075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 04 14:16:23.530075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 04 14:16:23.530075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:23.530075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:23.530075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 04 14:16:23.530075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 04 14:16:23.530075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 71f1dc53b73f456bbdc2c7c74bc5e1d3. Oct 04 14:16:23.530075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:23.530075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 471/951] 10.222.0.62 () {60 vars in 1140 bytes} [Tue Oct 4 14:16:23 2022] POST /identity/v3/projects => generated 262 bytes in 349 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:23.530075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b685491-10c3-48b0-b644-02a513b62b87 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:23.653198 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:23.656653 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c60c82-8ee8-47e9-938c-2e0ee3512b3a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:23.719752 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d80d24-3637-4532-8481-907b121cdd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:23.721463 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d80d24-3637-4532-8481-907b121cdd6b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:23.722211 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d80d24-3637-4532-8481-907b121cdd6b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:23.722978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d80d24-3637-4532-8481-907b121cdd6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:23.736873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b685491-10c3-48b0-b644-02a513b62b87 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:23.747747 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d80d24-3637-4532-8481-907b121cdd6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:23.751854 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d80d24-3637-4532-8481-907b121cdd6b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:23.787249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-00d80d24-3637-4532-8481-907b121cdd6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:23.787249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:23.787249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:23.787249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:23.787249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:23.787249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:23.787249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:23.787249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:23.787249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:23.787249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:23.787249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:23.787249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:23.787249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:16:23.787249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:16:23.787249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:16:23.787249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:16:23.788713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:23.788713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:23.788713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:23.788713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:23.788713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:23.788713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:23.788713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:23.788713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:23.788713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:23.788713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:23.788713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:23.788713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:23.788713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:23.788713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:23.788713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:23.788713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:23.788713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:16:23.789737 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:16:23.789737 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:23.789737 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:23.800147 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 481/952] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:16:23.804721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d80d24-3637-4532-8481-907b121cdd6b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:23.805559 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16a87f-2ba0-49de-b76e-d3e5e2919d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:23.806576 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16a87f-2ba0-49de-b76e-d3e5e2919d51 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:23.807031 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16a87f-2ba0-49de-b76e-d3e5e2919d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:23.807486 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16a87f-2ba0-49de-b76e-d3e5e2919d51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:23.820715 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16a87f-2ba0-49de-b76e-d3e5e2919d51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:23.823593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16a87f-2ba0-49de-b76e-d3e5e2919d51 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:23.846106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-9b16a87f-2ba0-49de-b76e-d3e5e2919d51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:16:23.846106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:23.846106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:23.846106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:23.846106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:23.846106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:23.846106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:23.846106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:23.846106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:23.846106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:23.846106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:23.846106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:23.846106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:16:23.846106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:16:23.846106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:16:23.847855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:16:23.847855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:23.847855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:23.847855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:23.847855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:23.847855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:23.847855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:23.847855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:23.847855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:23.847855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:23.847855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:23.847855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:23.847855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:23.847855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:23.847855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:23.847855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:23.847855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:23.849591 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:16:23.849591 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:16:23.849591 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:16:23.849591 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:16:23.849591 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:16:23.849591 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:16:23.849591 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:16:23.849591 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:23.851871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 472/953] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:16:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:23.858273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16a87f-2ba0-49de-b76e-d3e5e2919d51 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:23.951409 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:24.037511 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d80d24-3637-4532-8481-907b121cdd6b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:24.065663 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16a87f-2ba0-49de-b76e-d3e5e2919d51 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:24.101635 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:24.112033 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b8c9c-2296-4d74-8d98-0f9c6cee1a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:24.113927 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b8c9c-2296-4d74-8d98-0f9c6cee1a0b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:24.115830 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b8c9c-2296-4d74-8d98-0f9c6cee1a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:24.116672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b8c9c-2296-4d74-8d98-0f9c6cee1a0b None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:24.118746 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b8c9c-2296-4d74-8d98-0f9c6cee1a0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:24.119791 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b8c9c-2296-4d74-8d98-0f9c6cee1a0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:24.123548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b8c9c-2296-4d74-8d98-0f9c6cee1a0b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:24.136329 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dc974-72b1-4b2a-a4f6-982f0d4eb899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:24.137335 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dc974-72b1-4b2a-a4f6-982f0d4eb899 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:24.138747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dc974-72b1-4b2a-a4f6-982f0d4eb899 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:24.139215 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dc974-72b1-4b2a-a4f6-982f0d4eb899 None admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:24.141216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95dc974-72b1-4b2a-a4f6-982f0d4eb899 None admin] RBAC: Adding query filter params (name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:24.141216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95dc974-72b1-4b2a-a4f6-982f0d4eb899 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:24.143551 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95dc974-72b1-4b2a-a4f6-982f0d4eb899 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:24.151453 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 482/954] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:24.164005 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b8c9c-2296-4d74-8d98-0f9c6cee1a0b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:24.191900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 473/955] 10.222.0.62 () {56 vars in 1112 bytes} [Tue Oct 4 14:16:23 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:24.214578 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855af38b-946f-4e25-abd6-51fb6d2413a9 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:24.214980 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855af38b-946f-4e25-abd6-51fb6d2413a9 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:24.215481 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855af38b-946f-4e25-abd6-51fb6d2413a9 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:24.225839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 474/956] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:24 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:16:24.228729 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b862877-d94f-4ddf-9f78-2c524b446cf9 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:24.229226 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b862877-d94f-4ddf-9f78-2c524b446cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:24.229719 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b862877-d94f-4ddf-9f78-2c524b446cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:24.265328 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-4b862877-d94f-4ddf-9f78-2c524b446cf9 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:24.268234 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-4b862877-d94f-4ddf-9f78-2c524b446cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:24.311745 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b8c9c-2296-4d74-8d98-0f9c6cee1a0b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:24.352344 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:24.365354 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddb58f-2293-4a3d-ae5a-822c954b0a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:24.366439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddb58f-2293-4a3d-ae5a-822c954b0a1e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:24.366943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddb58f-2293-4a3d-ae5a-822c954b0a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:24.367447 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddb58f-2293-4a3d-ae5a-822c954b0a1e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:24.383198 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eddb58f-2293-4a3d-ae5a-822c954b0a1e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:24.387395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eddb58f-2293-4a3d-ae5a-822c954b0a1e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:24.411570 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 475/957] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 14:16:24.418749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-4eddb58f-2293-4a3d-ae5a-822c954b0a1e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 14:16:24.418749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:24.418749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:24.418749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:24.418749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:24.418749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:24.418749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:24.418749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:24.418749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:24.418749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:24.418749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:24.418749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:24.418749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:16:24.418749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:16:24.418749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:16:24.418749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:16:24.420560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:24.420560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:24.420560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:16:24.420560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:16:24.420560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:16:24.420560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:16:24.420560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:24.420560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:24.420560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:24.420560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:24.420560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:24.420560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:24.420560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:24.420560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:24.420560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:24.420560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:24.420560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:24.420560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:24.421529 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:24.421529 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:24.421529 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:16:24.421529 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:16:24.421529 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:16:24.421529 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:16:24.421529 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:16:24.421529 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:16:24.421529 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 14:16:24.421529 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:24.424505 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 483/958] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Oct 4 14:16:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:16:24.431103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b862877-d94f-4ddf-9f78-2c524b446cf9 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:24.620479 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b862877-d94f-4ddf-9f78-2c524b446cf9 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:24.643060 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:24.655222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0585eb7-0737-4289-b786-8c09dd45c4c9 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:24.655582 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0585eb7-0737-4289-b786-8c09dd45c4c9 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:24.655805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0585eb7-0737-4289-b786-8c09dd45c4c9 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:24.657525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 484/959] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:16:24.663217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b851f-6304-4f46-89b5-c945be6c04bd None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:24.663587 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b851f-6304-4f46-89b5-c945be6c04bd None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:24.663924 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b851f-6304-4f46-89b5-c945be6c04bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:24.688955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-d97b851f-6304-4f46-89b5-c945be6c04bd None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:24.690207 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d97b851f-6304-4f46-89b5-c945be6c04bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:24.698247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd26015-2df6-4054-8cc7-8ecafa329f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:24.699803 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd26015-2df6-4054-8cc7-8ecafa329f89 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:24.701100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd26015-2df6-4054-8cc7-8ecafa329f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:24.701809 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd26015-2df6-4054-8cc7-8ecafa329f89 None admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:24.703405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd26015-2df6-4054-8cc7-8ecafa329f89 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:24.704266 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd26015-2df6-4054-8cc7-8ecafa329f89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:24.707191 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd26015-2df6-4054-8cc7-8ecafa329f89 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:24.744827 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 476/960] 10.222.0.62 () {56 vars in 1149 bytes} [Tue Oct 4 14:16:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:24.756289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd26015-2df6-4054-8cc7-8ecafa329f89 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:24.784387 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 485/961] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 14:16:24.808685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b851f-6304-4f46-89b5-c945be6c04bd None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:24.929653 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd26015-2df6-4054-8cc7-8ecafa329f89 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:24.987947 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b76d5b-9546-4597-a1ac-8058ffb6e264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:24.989030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b76d5b-9546-4597-a1ac-8058ffb6e264 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:24.989377 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b76d5b-9546-4597-a1ac-8058ffb6e264 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:24.989712 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b76d5b-9546-4597-a1ac-8058ffb6e264 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:24.997642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b851f-6304-4f46-89b5-c945be6c04bd None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:25.026268 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:25.053238 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a14ec-c7e5-458b-b76a-5df3cf07ecec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:25.054236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a14ec-c7e5-458b-b76a-5df3cf07ecec None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:25.054236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a14ec-c7e5-458b-b76a-5df3cf07ecec None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:25.054554 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a14ec-c7e5-458b-b76a-5df3cf07ecec None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:25.055010 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a14ec-c7e5-458b-b76a-5df3cf07ecec None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:25.056462 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a14ec-c7e5-458b-b76a-5df3cf07ecec None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:25.067864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-3d0a14ec-c7e5-458b-b76a-5df3cf07ecec None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 14:16:25.067864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:25.067864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:16:25.067864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:16:25.067864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:16:25.067864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:16:25.067864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:16:25.067864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:25.067864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 14:16:25.067864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:25.067864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:16:25.067864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:25.067864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:25.067864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:25.067864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:25.067864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:25.067864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:25.069651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:25.069651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:25.069651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:25.069651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:25.069651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:25.069651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:25.069651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:16:25.069651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:16:25.069651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:16:25.069651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:16:25.069651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:25.069651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:25.069651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:25.069651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:25.069651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:25.069651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:25.071144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:25.071144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:25.071144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:25.071144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:25.071144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:25.071144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:25.071144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:25.071144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:25.071144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:25.071144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:25.071144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:16:25.071144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:25.071144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 14:16:25.071144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:25.074507 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 486/962] 10.222.0.62 () {56 vars in 1126 bytes} [Tue Oct 4 14:16:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:16:25.076584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a14ec-c7e5-458b-b76a-5df3cf07ecec None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:25.082935 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:25.139095 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b76d5b-9546-4597-a1ac-8058ffb6e264 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:25.140675 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b76d5b-9546-4597-a1ac-8058ffb6e264 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:25.221429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a14ec-c7e5-458b-b76a-5df3cf07ecec None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:25.276306 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 477/963] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:16:24 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 14:16:25.277154 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2c598-8ced-4f78-afc4-526eb827ed26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:25.277825 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b76d5b-9546-4597-a1ac-8058ffb6e264 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:25.278737 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2c598-8ced-4f78-afc4-526eb827ed26 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:25.279176 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2c598-8ced-4f78-afc4-526eb827ed26 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:25.279653 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2c598-8ced-4f78-afc4-526eb827ed26 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:25.280829 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2c598-8ced-4f78-afc4-526eb827ed26 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:25.281336 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2c598-8ced-4f78-afc4-526eb827ed26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:25.284034 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2c598-8ced-4f78-afc4-526eb827ed26 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:25.293306 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 487/964] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Oct 4 14:16:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:25.295222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2c598-8ced-4f78-afc4-526eb827ed26 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:25.374823 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:25.389389 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:25.457811 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b76d5b-9546-4597-a1ac-8058ffb6e264 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:25.467650 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2c598-8ced-4f78-afc4-526eb827ed26 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:25.520595 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b19af-1753-4b34-89cd-996f1fd690ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:25.521300 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b19af-1753-4b34-89cd-996f1fd690ab None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:25.521607 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b19af-1753-4b34-89cd-996f1fd690ab None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:25.522044 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b19af-1753-4b34-89cd-996f1fd690ab None admin] PATH_INFO: `/v3/services/compute` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:25.522971 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b19af-1753-4b34-89cd-996f1fd690ab None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:25.527173 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b19af-1753-4b34-89cd-996f1fd690ab None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:25.532337 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29462d-fcca-40d2-851a-d0d0d11bce88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:25.533198 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29462d-fcca-40d2-851a-d0d0d11bce88 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:25.533501 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29462d-fcca-40d2-851a-d0d0d11bce88 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:25.533761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29462d-fcca-40d2-851a-d0d0d11bce88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:25.539145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-642b19af-1753-4b34-89cd-996f1fd690ab None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 14:16:25.539145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:25.539145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:16:25.539145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:16:25.539145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:16:25.539145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:16:25.539145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:16:25.539145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:25.539145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 14:16:25.539145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:25.539145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:16:25.539145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:25.539145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:25.539145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:25.539145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:25.539145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:25.539145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:25.541352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:25.541352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:25.541352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:25.541352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:25.541352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:25.541352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:25.541352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:16:25.541352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:16:25.541352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:16:25.541352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:16:25.541352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:25.541352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:25.541352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:25.541352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:25.541352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:25.541352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:25.543087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:25.543087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:25.543087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:25.543087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:25.543087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:25.543087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:25.543087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:25.543087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:25.543087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:25.543087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:25.543087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:16:25.543087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:25.543087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 14:16:25.543087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:25.543087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 478/965] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:16:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:25.547335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29462d-fcca-40d2-851a-d0d0d11bce88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:25.548974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29462d-fcca-40d2-851a-d0d0d11bce88 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:25.549612 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b19af-1753-4b34-89cd-996f1fd690ab None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:25.576566 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-fe29462d-fcca-40d2-851a-d0d0d11bce88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:25.576566 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:25.576566 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:25.576566 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:25.576566 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:25.576566 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:25.576566 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:25.576566 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:25.576566 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:25.576566 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:25.576566 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:25.576566 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:25.576566 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:16:25.576566 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:16:25.576566 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:16:25.576566 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:16:25.577636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:25.577636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:25.577636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:25.577636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:25.577636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:25.577636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:25.577636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:25.577636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:25.577636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:25.577636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:25.577636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:25.577636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:25.577636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:25.577636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:25.577636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:25.577636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:25.577636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:16:25.584012 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:16:25.584012 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:25.584012 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:25.584012 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 488/966] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:25.584012 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29462d-fcca-40d2-851a-d0d0d11bce88 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:25.704925 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b19af-1753-4b34-89cd-996f1fd690ab None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:25.734095 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:25.742076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:25.743780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29462d-fcca-40d2-851a-d0d0d11bce88 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:25.750187 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35851d-ac40-4b35-9bc3-37d2e53bb9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:25.750807 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35851d-ac40-4b35-9bc3-37d2e53bb9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:25.751084 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35851d-ac40-4b35-9bc3-37d2e53bb9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:25.751352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35851d-ac40-4b35-9bc3-37d2e53bb9d2 None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:25.752025 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35851d-ac40-4b35-9bc3-37d2e53bb9d2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:25.752309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35851d-ac40-4b35-9bc3-37d2e53bb9d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:25.753987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35851d-ac40-4b35-9bc3-37d2e53bb9d2 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:25.765261 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 479/967] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Oct 4 14:16:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:25.766270 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35851d-ac40-4b35-9bc3-37d2e53bb9d2 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:25.791371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82065b21-554c-48c9-9717-7f6d17f56116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:25.792219 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82065b21-554c-48c9-9717-7f6d17f56116 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:25.792663 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82065b21-554c-48c9-9717-7f6d17f56116 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:25.793078 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82065b21-554c-48c9-9717-7f6d17f56116 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:25.793960 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82065b21-554c-48c9-9717-7f6d17f56116 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:25.794539 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82065b21-554c-48c9-9717-7f6d17f56116 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:25.796340 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82065b21-554c-48c9-9717-7f6d17f56116 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:25.802624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 489/968] 10.222.0.62 () {56 vars in 1112 bytes} [Tue Oct 4 14:16:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:25.804167 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82065b21-554c-48c9-9717-7f6d17f56116 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:25.908771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35851d-ac40-4b35-9bc3-37d2e53bb9d2 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:25.940540 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82065b21-554c-48c9-9717-7f6d17f56116 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:25.962314 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703016b-445a-48e4-9656-2b1ac3d7c65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:25.963261 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703016b-445a-48e4-9656-2b1ac3d7c65f None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:25.963468 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703016b-445a-48e4-9656-2b1ac3d7c65f None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:25.963800 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703016b-445a-48e4-9656-2b1ac3d7c65f None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:25.965074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703016b-445a-48e4-9656-2b1ac3d7c65f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:25.965723 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703016b-445a-48e4-9656-2b1ac3d7c65f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:25.967660 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703016b-445a-48e4-9656-2b1ac3d7c65f None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:25.981163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 480/969] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:25.987268 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703016b-445a-48e4-9656-2b1ac3d7c65f None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:26.007067 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fba740-d2bc-44e2-9a89-15973a60c93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:26.008147 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fba740-d2bc-44e2-9a89-15973a60c93c None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:26.008623 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fba740-d2bc-44e2-9a89-15973a60c93c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:26.009090 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fba740-d2bc-44e2-9a89-15973a60c93c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:26.010552 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fba740-d2bc-44e2-9a89-15973a60c93c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:26.014335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fba740-d2bc-44e2-9a89-15973a60c93c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:26.057514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 490/970] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:16:25 2022] POST /identity/v3/endpoints => generated 349 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:16:26.057514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fba740-d2bc-44e2-9a89-15973a60c93c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:26.061637 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:26.098566 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:26.152418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703016b-445a-48e4-9656-2b1ac3d7c65f None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:26.210123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b47dc-8ae7-46e0-8c29-22b508710976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:26.210799 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b47dc-8ae7-46e0-8c29-22b508710976 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:26.211078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b47dc-8ae7-46e0-8c29-22b508710976 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:26.211446 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b47dc-8ae7-46e0-8c29-22b508710976 None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:26.212524 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b47dc-8ae7-46e0-8c29-22b508710976 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:26.212800 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b47dc-8ae7-46e0-8c29-22b508710976 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:26.214355 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b47dc-8ae7-46e0-8c29-22b508710976 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:26.225882 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 481/971] 10.222.0.62 () {56 vars in 1112 bytes} [Tue Oct 4 14:16:25 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:26.254112 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fba740-d2bc-44e2-9a89-15973a60c93c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:26.299541 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b6f6f-8526-4fbd-9746-3e73b398ffdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:26.300246 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b6f6f-8526-4fbd-9746-3e73b398ffdd None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:26.300523 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b6f6f-8526-4fbd-9746-3e73b398ffdd None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:26.300795 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b6f6f-8526-4fbd-9746-3e73b398ffdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:26.309117 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b6f6f-8526-4fbd-9746-3e73b398ffdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:26.311605 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b6f6f-8526-4fbd-9746-3e73b398ffdd None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:26.325728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-d05b6f6f-8526-4fbd-9746-3e73b398ffdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:16:26.325728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:26.325728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:26.325728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:26.325728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:26.325728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:26.325728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:26.325728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:26.325728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:26.325728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:26.325728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:26.325728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:26.325728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:16:26.325728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:16:26.325728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:16:26.327660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:16:26.327660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:26.327660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:26.327660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:26.327660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:26.327660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:26.327660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:26.327660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:26.327660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:26.327660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:26.327660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:26.327660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:26.327660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:26.327660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:26.327660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:26.327660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:26.327660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:26.329982 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:16:26.329982 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:16:26.329982 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:16:26.329982 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:16:26.329982 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:16:26.329982 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:16:26.329982 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:16:26.329982 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:26.329982 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 491/972] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:16:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:26.334120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b47dc-8ae7-46e0-8c29-22b508710976 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:26.471972 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b47dc-8ae7-46e0-8c29-22b508710976 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:26.490759 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:26.520781 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16aa36d-4820-447d-80aa-100107d06156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:26.521417 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16aa36d-4820-447d-80aa-100107d06156 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:26.521697 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16aa36d-4820-447d-80aa-100107d06156 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:26.521968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16aa36d-4820-447d-80aa-100107d06156 None admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:26.522754 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16aa36d-4820-447d-80aa-100107d06156 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:26.523057 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16aa36d-4820-447d-80aa-100107d06156 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:26.524634 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16aa36d-4820-447d-80aa-100107d06156 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:26.540969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 482/973] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:16:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:26.547333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b6f6f-8526-4fbd-9746-3e73b398ffdd None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:26.647523 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:26.698947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b6f6f-8526-4fbd-9746-3e73b398ffdd None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:26.741996 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2882c-1897-4245-b9d0-d17768a23575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:26.742637 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2882c-1897-4245-b9d0-d17768a23575 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:26.742912 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2882c-1897-4245-b9d0-d17768a23575 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:26.743187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2882c-1897-4245-b9d0-d17768a23575 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:26.744015 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2882c-1897-4245-b9d0-d17768a23575 None admin] RBAC: Adding query filter params (role.id=d07f12353933422cbbf32385916d2bfa, scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba, user.id=c5dc12a8bc2b406b8a148bf609d5d2ba) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:26.744330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2882c-1897-4245-b9d0-d17768a23575 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:26.745832 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2882c-1897-4245-b9d0-d17768a23575 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:26.754742 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 492/974] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:16:26 2022] GET /identity/v3/role_assignments?user.id=c5dc12a8bc2b406b8a148bf609d5d2ba&scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba&role.id=d07f12353933422cbbf32385916d2bfa => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:27.851128 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89181488-d020-4d2d-9c9a-924f8bc13f3d None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:27.851935 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89181488-d020-4d2d-9c9a-924f8bc13f3d None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:27.851935 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89181488-d020-4d2d-9c9a-924f8bc13f3d None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:27.854970 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 483/975] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:16:27.864132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2cc11-d344-4b1a-a68e-a809a0e25831 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:27.865118 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2cc11-d344-4b1a-a68e-a809a0e25831 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:27.865118 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2cc11-d344-4b1a-a68e-a809a0e25831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:27.897912 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-6ff2cc11-d344-4b1a-a68e-a809a0e25831 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:27.903891 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6ff2cc11-d344-4b1a-a68e-a809a0e25831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:28.005255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 493/976] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:16:28.504040 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89181488-d020-4d2d-9c9a-924f8bc13f3d None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:28.621728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d84b6f-2538-4cbd-8064-5885fea1e3c7 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:28.622879 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d84b6f-2538-4cbd-8064-5885fea1e3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:28.623175 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d84b6f-2538-4cbd-8064-5885fea1e3c7 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:28.625099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 494/977] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:16:28.631384 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51a628-52ee-4dbe-8f28-6549f6e5b5ad None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:28.632202 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51a628-52ee-4dbe-8f28-6549f6e5b5ad None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:28.632387 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51a628-52ee-4dbe-8f28-6549f6e5b5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:28.666111 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-9e51a628-52ee-4dbe-8f28-6549f6e5b5ad None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:28.669611 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9e51a628-52ee-4dbe-8f28-6549f6e5b5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:28.691601 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89181488-d020-4d2d-9c9a-924f8bc13f3d None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:28.750649 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3e537-e771-48f1-9265-d0ad07fcaef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:28.751930 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3e537-e771-48f1-9265-d0ad07fcaef4 None admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:28.752401 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3e537-e771-48f1-9265-d0ad07fcaef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:28.752930 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3e537-e771-48f1-9265-d0ad07fcaef4 None admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:28.754195 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3e537-e771-48f1-9265-d0ad07fcaef4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:28.756932 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3e537-e771-48f1-9265-d0ad07fcaef4 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:28.779773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:28.780529 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 495/978] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:16:28.780916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.sql.core [None req-1cb3e537-e771-48f1-9265-d0ad07fcaef4 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 14:16:28.780916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 04 14:16:28.780916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [parameters: {'user_id': 'ecc4c20bf892477a8de1c0ad3b5855b5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 04 14:16:28.780916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81468) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 14:16:28.794685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-1cb3e537-e771-48f1-9265-d0ad07fcaef4 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 04 14:16:28.794685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:28.794685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 14:16:28.794685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 14:16:28.794685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 14:16:28.794685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 14:16:28.794685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 14:16:28.794685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 14:16:28.794685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 14:16:28.794685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application conn.query(q) Oct 04 14:16:28.794685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 14:16:28.794685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 14:16:28.794685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 14:16:28.794685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application result.read() Oct 04 14:16:28.794685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 14:16:28.795838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 14:16:28.795838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 14:16:28.795838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 14:16:28.795838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 14:16:28.795838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 14:16:28.795838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 14:16:28.795838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 14:16:28.795838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 14:16:28.795838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:28.795838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 14:16:28.795838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:28.795838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:28.795838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 14:16:28.795838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 14:16:28.795838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 04 14:16:28.795838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 04 14:16:28.795838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 14:16:28.795838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application next(self.gen) Oct 04 14:16:28.796822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 14:16:28.796822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application yield resource Oct 04 14:16:28.796822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 14:16:28.796822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application next(self.gen) Oct 04 14:16:28.796822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 14:16:28.796822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 14:16:28.796822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 14:16:28.796822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 14:16:28.796822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 14:16:28.796822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise self.value Oct 04 14:16:28.796822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 14:16:28.796822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 14:16:28.796822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 14:16:28.796822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application session.commit() Oct 04 14:16:28.796822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 14:16:28.796822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 14:16:28.796822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 14:16:28.797746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 14:16:28.797746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 14:16:28.797746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self.session.flush() Oct 04 14:16:28.797746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 14:16:28.797746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 14:16:28.797746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 14:16:28.797746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 14:16:28.797746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 14:16:28.797746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application compat.raise_( Oct 04 14:16:28.797746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 14:16:28.797746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception Oct 04 14:16:28.797746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 14:16:28.797746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 14:16:28.797746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 14:16:28.797746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 14:16:28.797746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 14:16:28.797746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 14:16:28.798674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 14:16:28.798674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 14:16:28.798674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 14:16:28.798674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 04 14:16:28.798674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 14:16:28.798674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 14:16:28.798674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 14:16:28.798674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 14:16:28.798674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 14:16:28.798674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 14:16:28.798674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 14:16:28.798674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 14:16:28.798674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 14:16:28.798674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 14:16:28.798674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 14:16:28.798674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception Oct 04 14:16:28.799558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 14:16:28.799558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 14:16:28.799558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 14:16:28.799558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 14:16:28.799558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 14:16:28.799558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 14:16:28.799558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 14:16:28.799558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application conn.query(q) Oct 04 14:16:28.799558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 14:16:28.799558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 14:16:28.799558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 14:16:28.799558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application result.read() Oct 04 14:16:28.799558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 14:16:28.799558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 14:16:28.799558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 14:16:28.799558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 14:16:28.800457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 14:16:28.800457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 14:16:28.800457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 14:16:28.800457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 14:16:28.800457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 14:16:28.800457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 04 14:16:28.800457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ecc4c20bf892477a8de1c0ad3b5855b5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 04 14:16:28.800457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 14:16:28.800457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:28.800457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:16:28.800457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:28.800457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:28.800457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:28.800457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:28.800457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:28.801269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:28.801269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:28.801269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:28.801269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:28.801269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:28.801269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:28.801269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:28.801269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 04 14:16:28.801269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 04 14:16:28.801269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:28.801269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:28.801269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:16:28.801269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:16:28.801269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:16:28.801269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:16:28.801269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 04 14:16:28.801269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 04 14:16:28.802219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 04 14:16:28.802219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 04 14:16:28.802219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 14:16:28.802219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 14:16:28.802219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 04 14:16:28.802219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:28.802219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 484/979] 10.222.0.62 () {60 vars in 1131 bytes} [Tue Oct 4 14:16:28 2022] POST /identity/v3/users => generated 160 bytes in 294 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:28.806714 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51a628-52ee-4dbe-8f28-6549f6e5b5ad None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:28.932367 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51a628-52ee-4dbe-8f28-6549f6e5b5ad None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:28.971886 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a7ab9-8cef-42ab-a0c5-4f8d4f2736f2 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:28.972487 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a7ab9-8cef-42ab-a0c5-4f8d4f2736f2 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:28.972835 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a7ab9-8cef-42ab-a0c5-4f8d4f2736f2 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:28.977342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd04064-587e-4e88-8292-a751e9dff959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:28.978397 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd04064-587e-4e88-8292-a751e9dff959 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:28.978882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd04064-587e-4e88-8292-a751e9dff959 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:28.979407 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd04064-587e-4e88-8292-a751e9dff959 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:28.988321 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 485/980] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:28 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:16:28.989663 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd04064-587e-4e88-8292-a751e9dff959 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:28.991299 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dba0d-81e4-4219-8d61-62451cc3324d None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:28.991652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd04064-587e-4e88-8292-a751e9dff959 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:28.991805 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dba0d-81e4-4219-8d61-62451cc3324d None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:28.992287 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dba0d-81e4-4219-8d61-62451cc3324d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:29.016864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-8cd04064-587e-4e88-8292-a751e9dff959 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 14:16:29.016864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:29.016864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:29.016864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:29.016864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:29.016864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:29.016864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:29.016864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:29.016864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:29.016864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:29.016864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:29.016864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:29.016864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:16:29.016864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:16:29.016864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:16:29.016864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:16:29.018442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:29.018442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:29.018442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:16:29.018442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:16:29.018442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:16:29.018442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:16:29.018442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:29.018442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:29.018442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:29.018442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:29.018442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:29.018442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:29.018442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:29.018442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:29.018442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:29.018442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:29.018442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:29.018442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:29.019413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:29.019413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:29.019413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:16:29.019413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:16:29.019413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:16:29.019413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:16:29.019413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:16:29.019413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:16:29.019413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 14:16:29.019413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:29.030292 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 496/981] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:16:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:29.032439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd04064-587e-4e88-8292-a751e9dff959 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:29.039006 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-841dba0d-81e4-4219-8d61-62451cc3324d None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:29.041759 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-841dba0d-81e4-4219-8d61-62451cc3324d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:29.083654 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:29.105577 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:29.135122 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 486/982] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 14:16:29.140739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841dba0d-81e4-4219-8d61-62451cc3324d None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:29.157462 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd04064-587e-4e88-8292-a751e9dff959 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:29.202558 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c4df5-f997-4676-9794-1bd65dbb4df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:29.203701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c4df5-f997-4676-9794-1bd65dbb4df9 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:29.203701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c4df5-f997-4676-9794-1bd65dbb4df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:29.203896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c4df5-f997-4676-9794-1bd65dbb4df9 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:29.204595 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c4df5-f997-4676-9794-1bd65dbb4df9 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:29.204904 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c4df5-f997-4676-9794-1bd65dbb4df9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:29.206574 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c4df5-f997-4676-9794-1bd65dbb4df9 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:29.256239 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 497/983] 10.222.0.62 () {56 vars in 1101 bytes} [Tue Oct 4 14:16:29 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:29.288550 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841dba0d-81e4-4219-8d61-62451cc3324d None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:29.335290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4371523-572c-4229-8dc9-721a3893c2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:29.336363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4371523-572c-4229-8dc9-721a3893c2cb None admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:29.336889 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4371523-572c-4229-8dc9-721a3893c2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:29.337381 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4371523-572c-4229-8dc9-721a3893c2cb None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:29.338311 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4371523-572c-4229-8dc9-721a3893c2cb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:29.340228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4371523-572c-4229-8dc9-721a3893c2cb None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:29.366921 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 487/984] 10.222.0.62 () {60 vars in 1141 bytes} [Tue Oct 4 14:16:29 2022] POST /identity/v3/services => generated 242 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:16:29.510148 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c4df5-f997-4676-9794-1bd65dbb4df9 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:29.694717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c4df5-f997-4676-9794-1bd65dbb4df9 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:29.721580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:29.759337 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcb98d-f8f9-483e-802c-f58a525c5b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:29.760490 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcb98d-f8f9-483e-802c-f58a525c5b24 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:29.761091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcb98d-f8f9-483e-802c-f58a525c5b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:29.761608 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcb98d-f8f9-483e-802c-f58a525c5b24 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:29.762478 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fcb98d-f8f9-483e-802c-f58a525c5b24 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:29.765554 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fcb98d-f8f9-483e-802c-f58a525c5b24 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:29.776007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-31fcb98d-f8f9-483e-802c-f58a525c5b24 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 14:16:29.776007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:29.776007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:16:29.776007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:16:29.776007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:16:29.776007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:16:29.776007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:16:29.776007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:29.776007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 14:16:29.776007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:29.776007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:16:29.776007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:29.776007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:29.776007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:29.776007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:29.776007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:29.776007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:29.777986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:29.777986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:29.777986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:29.777986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:29.777986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:29.777986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:29.777986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:16:29.777986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:16:29.777986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:16:29.777986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:16:29.777986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:29.777986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:29.777986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:29.777986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:29.777986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:29.777986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:29.780276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:29.780276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:29.780276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:29.780276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:29.780276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:29.780276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:29.780276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:29.780276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:29.780276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:29.780276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:29.780276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:16:29.780276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:29.780276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 14:16:29.780276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:29.780276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 498/985] 10.222.0.62 () {56 vars in 1126 bytes} [Tue Oct 4 14:16:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:29.787397 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4371523-572c-4229-8dc9-721a3893c2cb None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:29.845186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:29.851225 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cd304-c225-4cdb-9ee3-ca5dc80395d1 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:29.851640 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cd304-c225-4cdb-9ee3-ca5dc80395d1 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:29.851969 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cd304-c225-4cdb-9ee3-ca5dc80395d1 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:29.853339 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 499/986] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:16:29.859479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c564c-9472-4d4b-8b80-977896bcd2e4 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:29.859966 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c564c-9472-4d4b-8b80-977896bcd2e4 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:29.860147 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c564c-9472-4d4b-8b80-977896bcd2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:29.880396 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-590c564c-9472-4d4b-8b80-977896bcd2e4 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:29.881630 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-590c564c-9472-4d4b-8b80-977896bcd2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:29.961761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4371523-572c-4229-8dc9-721a3893c2cb None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:30.003566 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc4649-7ad3-43c5-afd0-fb658e7553df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:30.004319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc4649-7ad3-43c5-afd0-fb658e7553df None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:30.004563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc4649-7ad3-43c5-afd0-fb658e7553df None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:30.007919 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc4649-7ad3-43c5-afd0-fb658e7553df None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:30.008106 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 500/987] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:29 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 14:16:30.008777 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc4649-7ad3-43c5-afd0-fb658e7553df None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:30.008777 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc4649-7ad3-43c5-afd0-fb658e7553df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:30.008777 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc4649-7ad3-43c5-afd0-fb658e7553df None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:30.020783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 488/988] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Oct 4 14:16:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:30.027215 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c564c-9472-4d4b-8b80-977896bcd2e4 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:30.222335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c564c-9472-4d4b-8b80-977896bcd2e4 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:30.238128 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:30.291901 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e96da-e6bb-4a03-955d-894181c0854c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:30.293037 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e96da-e6bb-4a03-955d-894181c0854c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:30.293533 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e96da-e6bb-4a03-955d-894181c0854c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:30.294705 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e96da-e6bb-4a03-955d-894181c0854c None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:30.295913 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e96da-e6bb-4a03-955d-894181c0854c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:30.296450 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e96da-e6bb-4a03-955d-894181c0854c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:30.298927 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e96da-e6bb-4a03-955d-894181c0854c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:30.313477 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 501/989] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Oct 4 14:16:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:30.315330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc4649-7ad3-43c5-afd0-fb658e7553df None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:30.370903 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e96da-e6bb-4a03-955d-894181c0854c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:30.441691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:30.455728 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc4649-7ad3-43c5-afd0-fb658e7553df None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:30.495835 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616baec-691e-4448-b51f-ca7de211324c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:30.496470 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616baec-691e-4448-b51f-ca7de211324c None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:30.496776 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616baec-691e-4448-b51f-ca7de211324c None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:30.497049 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616baec-691e-4448-b51f-ca7de211324c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:30.497776 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f616baec-691e-4448-b51f-ca7de211324c None admin] RBAC: Adding query filter params (interface=admin, service_id=6e8970ed9ace48a2a1999485ec560808, region_id=RegionOne) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:30.498089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f616baec-691e-4448-b51f-ca7de211324c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:30.499467 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f616baec-691e-4448-b51f-ca7de211324c None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:30.510276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 489/990] 10.222.0.62 () {56 vars in 1249 bytes} [Tue Oct 4 14:16:30 2022] GET /identity/v3/endpoints?service_id=6e8970ed9ace48a2a1999485ec560808&interface=admin®ion_id=RegionOne => generated 193 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:30.511621 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616baec-691e-4448-b51f-ca7de211324c None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:30.580820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e96da-e6bb-4a03-955d-894181c0854c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:30.644738 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616baec-691e-4448-b51f-ca7de211324c None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:30.654938 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0ff62-0c0d-4016-8f14-217840ba5b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:30.656051 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0ff62-0c0d-4016-8f14-217840ba5b59 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:30.656519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0ff62-0c0d-4016-8f14-217840ba5b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:30.656999 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0ff62-0c0d-4016-8f14-217840ba5b59 None admin] PATH_INFO: `/v3/services/image` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:30.658100 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0ff62-0c0d-4016-8f14-217840ba5b59 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:30.660769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0ff62-0c0d-4016-8f14-217840ba5b59 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:30.678189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-61e0ff62-0c0d-4016-8f14-217840ba5b59 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 14:16:30.678189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:30.678189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:16:30.678189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:16:30.678189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:16:30.678189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:16:30.678189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:16:30.678189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:30.678189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 14:16:30.678189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:30.678189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:16:30.678189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:30.678189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:30.678189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:30.678189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:30.678189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:30.678189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:30.679963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:30.679963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:30.679963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:30.679963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:30.679963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:30.679963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:30.679963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:16:30.679963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:16:30.679963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:16:30.679963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:16:30.679963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:30.679963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:30.679963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:30.679963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:30.679963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:30.679963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:30.681597 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:30.681597 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:30.681597 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:30.681597 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:30.681597 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:30.681597 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:30.681597 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:30.681597 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:30.681597 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:30.681597 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:30.681597 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:16:30.681597 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:30.681597 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 14:16:30.681597 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:30.681597 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 502/991] 10.222.0.62 () {56 vars in 1105 bytes} [Tue Oct 4 14:16:30 2022] GET /identity/v3/services/image => generated 86 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:30.689351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0ff62-0c0d-4016-8f14-217840ba5b59 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:30.702816 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783683eb-c0fb-4df7-b639-5f01f54e4fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:30.703926 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783683eb-c0fb-4df7-b639-5f01f54e4fbc None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:30.704499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783683eb-c0fb-4df7-b639-5f01f54e4fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:30.704901 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783683eb-c0fb-4df7-b639-5f01f54e4fbc None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:30.706054 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783683eb-c0fb-4df7-b639-5f01f54e4fbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:30.708698 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783683eb-c0fb-4df7-b639-5f01f54e4fbc None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:30.732213 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 490/992] 10.222.0.62 () {56 vars in 1087 bytes} [Tue Oct 4 14:16:30 2022] GET /identity/v3/services => generated 1727 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:16:30.751414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:30.867032 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0ff62-0c0d-4016-8f14-217840ba5b59 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:30.911509 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544c110-ed2d-40af-88a8-db8af18da4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:30.912181 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544c110-ed2d-40af-88a8-db8af18da4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:30.912452 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544c110-ed2d-40af-88a8-db8af18da4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:30.912720 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544c110-ed2d-40af-88a8-db8af18da4b3 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:30.913385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544c110-ed2d-40af-88a8-db8af18da4b3 None admin] RBAC: Adding query filter params (name=image) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:30.913679 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544c110-ed2d-40af-88a8-db8af18da4b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:30.915103 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544c110-ed2d-40af-88a8-db8af18da4b3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:30.921410 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 503/993] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:30.928230 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783683eb-c0fb-4df7-b639-5f01f54e4fbc None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:30.968538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:31.106030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783683eb-c0fb-4df7-b639-5f01f54e4fbc None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:31.177944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f6363-e3d3-46e7-a307-b9324978a9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:31.178970 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f6363-e3d3-46e7-a307-b9324978a9ec None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:31.179447 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f6363-e3d3-46e7-a307-b9324978a9ec None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:31.179968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f6363-e3d3-46e7-a307-b9324978a9ec None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:31.181065 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f6363-e3d3-46e7-a307-b9324978a9ec None admin] RBAC: Adding query filter params (type=image) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:31.181565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f6363-e3d3-46e7-a307-b9324978a9ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:31.184087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f6363-e3d3-46e7-a307-b9324978a9ec None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:31.199774 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 491/994] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:30 2022] GET /identity/v3/services?type=image => generated 122 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:32.181079 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f3fe9-af89-45d3-94ee-b4b6091cc240 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:32.181918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f3fe9-af89-45d3-94ee-b4b6091cc240 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:32.181918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f3fe9-af89-45d3-94ee-b4b6091cc240 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:32.183002 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 504/995] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:16:32.190637 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69637c7-c35c-47f2-9eba-7e82dd619337 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:32.191498 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69637c7-c35c-47f2-9eba-7e82dd619337 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:32.191498 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69637c7-c35c-47f2-9eba-7e82dd619337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:32.211399 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-f69637c7-c35c-47f2-9eba-7e82dd619337 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:32.212676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f69637c7-c35c-47f2-9eba-7e82dd619337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:32.300487 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 492/996] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:16:32.574612 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f3fe9-af89-45d3-94ee-b4b6091cc240 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:32.706138 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:32.715010 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f3fe9-af89-45d3-94ee-b4b6091cc240 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:32.797433 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b79bd-4a72-48cc-9d13-2a4be6402620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:32.798510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b79bd-4a72-48cc-9d13-2a4be6402620 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:32.798991 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b79bd-4a72-48cc-9d13-2a4be6402620 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:32.799481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b79bd-4a72-48cc-9d13-2a4be6402620 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:32.800582 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b79bd-4a72-48cc-9d13-2a4be6402620 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:32.802986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b79bd-4a72-48cc-9d13-2a4be6402620 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:32.820898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-fe8b79bd-4a72-48cc-9d13-2a4be6402620 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 14:16:32.820898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:32.820898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:16:32.820898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:16:32.820898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:16:32.820898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:16:32.820898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:16:32.820898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:32.820898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 14:16:32.820898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:32.820898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:16:32.820898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:32.820898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:32.820898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:32.820898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:32.820898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:32.820898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:32.822395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:32.822395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:32.822395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:32.822395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:32.822395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:32.822395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:32.822395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:16:32.822395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:16:32.822395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:16:32.822395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:16:32.822395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:32.822395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:32.822395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:32.822395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:32.822395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:32.822395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:32.824602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:32.824602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:32.824602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:32.824602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:32.824602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:32.824602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:32.824602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:32.824602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:32.824602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:32.824602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:32.824602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:16:32.824602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:32.824602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 14:16:32.824602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:32.828273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 505/997] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:16:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:32.831781 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69637c7-c35c-47f2-9eba-7e82dd619337 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:32.858786 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:33.025167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69637c7-c35c-47f2-9eba-7e82dd619337 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:33.096120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aadef6-5bef-4739-90b6-b8f48813bf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:33.097068 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aadef6-5bef-4739-90b6-b8f48813bf9c None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:33.097539 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aadef6-5bef-4739-90b6-b8f48813bf9c None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:33.098013 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aadef6-5bef-4739-90b6-b8f48813bf9c None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:33.099171 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aadef6-5bef-4739-90b6-b8f48813bf9c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:33.099697 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aadef6-5bef-4739-90b6-b8f48813bf9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:33.102323 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aadef6-5bef-4739-90b6-b8f48813bf9c None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:33.112768 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 493/998] 10.222.0.62 () {56 vars in 1112 bytes} [Tue Oct 4 14:16:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:33.123338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b79bd-4a72-48cc-9d13-2a4be6402620 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:33.347326 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b79bd-4a72-48cc-9d13-2a4be6402620 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:33.411808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8deba7-ac67-4994-a169-420da8b4945a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:33.412857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8deba7-ac67-4994-a169-420da8b4945a None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:33.413338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8deba7-ac67-4994-a169-420da8b4945a None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:33.413814 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8deba7-ac67-4994-a169-420da8b4945a None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:33.414961 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8deba7-ac67-4994-a169-420da8b4945a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:33.415488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8deba7-ac67-4994-a169-420da8b4945a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:33.418133 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8deba7-ac67-4994-a169-420da8b4945a None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:33.431879 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 506/999] 10.222.0.62 () {56 vars in 1112 bytes} [Tue Oct 4 14:16:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:33.436241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aadef6-5bef-4739-90b6-b8f48813bf9c None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:33.561268 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:33.610673 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aadef6-5bef-4739-90b6-b8f48813bf9c None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:33.679430 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173bc3a-b74f-4d63-9d56-69b70e5fd413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:33.680509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173bc3a-b74f-4d63-9d56-69b70e5fd413 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:33.680992 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173bc3a-b74f-4d63-9d56-69b70e5fd413 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:33.681440 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173bc3a-b74f-4d63-9d56-69b70e5fd413 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:33.682728 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173bc3a-b74f-4d63-9d56-69b70e5fd413 None admin] RBAC: Adding query filter params (interface=public, service_id=fcff89d6fbc547efb8fb517a6615ce16, region_id=RegionOne) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:33.683264 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173bc3a-b74f-4d63-9d56-69b70e5fd413 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:33.686424 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173bc3a-b74f-4d63-9d56-69b70e5fd413 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:33.702186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 494/1000] 10.222.0.62 () {56 vars in 1251 bytes} [Tue Oct 4 14:16:33 2022] GET /identity/v3/endpoints?service_id=fcff89d6fbc547efb8fb517a6615ce16&interface=public®ion_id=RegionOne => generated 194 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:33.704051 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8deba7-ac67-4994-a169-420da8b4945a None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:33.755318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:33.843920 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c644b-d9de-47bb-b60b-8ab8edfba4cc None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:33.844185 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c644b-d9de-47bb-b60b-8ab8edfba4cc None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:33.844525 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c644b-d9de-47bb-b60b-8ab8edfba4cc None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:33.846145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 495/1001] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:16:33.853002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824431c9-8f72-4ef4-9849-8b03eccd0900 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:33.853887 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824431c9-8f72-4ef4-9849-8b03eccd0900 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:33.854579 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824431c9-8f72-4ef4-9849-8b03eccd0900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:33.880132 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-824431c9-8f72-4ef4-9849-8b03eccd0900 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:33.881543 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-824431c9-8f72-4ef4-9849-8b03eccd0900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:33.890834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8deba7-ac67-4994-a169-420da8b4945a None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:33.940072 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954248d-4597-44bc-8cc1-295ef2ff1699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:33.941056 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954248d-4597-44bc-8cc1-295ef2ff1699 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:33.941484 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954248d-4597-44bc-8cc1-295ef2ff1699 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:33.941919 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954248d-4597-44bc-8cc1-295ef2ff1699 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:33.942952 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954248d-4597-44bc-8cc1-295ef2ff1699 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:33.945399 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954248d-4597-44bc-8cc1-295ef2ff1699 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:33.958290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 507/1002] 10.222.0.62 () {56 vars in 1087 bytes} [Tue Oct 4 14:16:33 2022] GET /identity/v3/services => generated 1727 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:16:33.994774 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 496/1003] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:16:34.172682 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad084d-06a4-42c7-8579-20ef16a2e11b None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:34.172869 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad084d-06a4-42c7-8579-20ef16a2e11b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:34.173210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad084d-06a4-42c7-8579-20ef16a2e11b None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:34.174510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 508/1004] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:16:34.180530 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba207914-8b7a-4c68-bf01-5d7f64d58f89 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:34.180822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba207914-8b7a-4c68-bf01-5d7f64d58f89 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:34.181235 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba207914-8b7a-4c68-bf01-5d7f64d58f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:34.203837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-ba207914-8b7a-4c68-bf01-5d7f64d58f89 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:34.205055 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-ba207914-8b7a-4c68-bf01-5d7f64d58f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:34.276148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:34.283510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 497/1005] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:34 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:16:34.284010 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad084d-06a4-42c7-8579-20ef16a2e11b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:34.402255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:34.420282 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad084d-06a4-42c7-8579-20ef16a2e11b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:34.467852 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba62339-bd4f-4021-9b7f-f15691bf8b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:34.468369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba62339-bd4f-4021-9b7f-f15691bf8b03 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:34.468662 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba62339-bd4f-4021-9b7f-f15691bf8b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:34.468925 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba62339-bd4f-4021-9b7f-f15691bf8b03 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:34.469512 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba62339-bd4f-4021-9b7f-f15691bf8b03 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:34.470918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba62339-bd4f-4021-9b7f-f15691bf8b03 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:34.481335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-3ba62339-bd4f-4021-9b7f-f15691bf8b03 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 14:16:34.481335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:34.481335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:16:34.481335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:16:34.481335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:16:34.481335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:16:34.481335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:16:34.481335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:34.481335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 14:16:34.481335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:34.481335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:16:34.481335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:34.481335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:34.481335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:34.481335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:34.481335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:34.481335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:34.483338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:34.483338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:34.483338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:34.483338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:34.483338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:34.483338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:34.483338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:16:34.483338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:16:34.483338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:16:34.483338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:16:34.483338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:34.483338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:34.483338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:34.483338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:34.483338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:34.483338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:34.485074 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:34.485074 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:34.485074 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:34.485074 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:34.485074 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:34.485074 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:34.485074 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:34.485074 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:34.485074 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:34.485074 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:34.485074 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:16:34.485074 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:34.485074 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 14:16:34.485074 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:34.485074 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 509/1006] 10.222.0.62 () {56 vars in 1126 bytes} [Tue Oct 4 14:16:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:16:34.494295 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba207914-8b7a-4c68-bf01-5d7f64d58f89 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:34.562407 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba62339-bd4f-4021-9b7f-f15691bf8b03 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:34.662732 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba207914-8b7a-4c68-bf01-5d7f64d58f89 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:34.706877 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9543c9-ee6c-405a-bd80-1751667822aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:34.707499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9543c9-ee6c-405a-bd80-1751667822aa None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:34.707822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9543c9-ee6c-405a-bd80-1751667822aa None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:34.708092 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9543c9-ee6c-405a-bd80-1751667822aa None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:34.708853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9543c9-ee6c-405a-bd80-1751667822aa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:34.709158 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9543c9-ee6c-405a-bd80-1751667822aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:34.710670 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9543c9-ee6c-405a-bd80-1751667822aa None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:34.722476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba62339-bd4f-4021-9b7f-f15691bf8b03 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:34.722741 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 498/1007] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Oct 4 14:16:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:34.723752 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9543c9-ee6c-405a-bd80-1751667822aa None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:34.791903 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33a78a-18d6-43c4-bde1-43c4efc7a4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:34.792773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33a78a-18d6-43c4-bde1-43c4efc7a4bd None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:34.793182 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33a78a-18d6-43c4-bde1-43c4efc7a4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:34.793880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33a78a-18d6-43c4-bde1-43c4efc7a4bd None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:34.795072 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33a78a-18d6-43c4-bde1-43c4efc7a4bd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:34.797304 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33a78a-18d6-43c4-bde1-43c4efc7a4bd None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:34.829665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:34.835578 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 510/1008] 10.222.0.62 () {60 vars in 1141 bytes} [Tue Oct 4 14:16:34 2022] POST /identity/v3/services => generated 242 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:16:34.884368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9543c9-ee6c-405a-bd80-1751667822aa None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:34.953464 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20eb87f-20c4-4749-bddc-da790536644a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:34.954498 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20eb87f-20c4-4749-bddc-da790536644a None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:34.954945 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20eb87f-20c4-4749-bddc-da790536644a None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:34.955422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20eb87f-20c4-4749-bddc-da790536644a None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:34.956375 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20eb87f-20c4-4749-bddc-da790536644a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:34.956944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20eb87f-20c4-4749-bddc-da790536644a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:34.958650 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20eb87f-20c4-4749-bddc-da790536644a None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:34.966527 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 499/1009] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Oct 4 14:16:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:34.974683 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33a78a-18d6-43c4-bde1-43c4efc7a4bd None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:34.997182 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:35.119275 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33a78a-18d6-43c4-bde1-43c4efc7a4bd None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:35.174629 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f39a48-b704-4db7-9fd9-c24f73beb6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:35.175468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f39a48-b704-4db7-9fd9-c24f73beb6fa None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:35.175938 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f39a48-b704-4db7-9fd9-c24f73beb6fa None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:35.176356 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f39a48-b704-4db7-9fd9-c24f73beb6fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:35.177274 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f39a48-b704-4db7-9fd9-c24f73beb6fa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:35.179279 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f39a48-b704-4db7-9fd9-c24f73beb6fa None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:35.205998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 511/1010] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:16:34 2022] POST /identity/v3/endpoints => generated 325 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:16:36.392274 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652abd0c-d621-45e1-98f6-308f8ab06d76 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:36.393068 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652abd0c-d621-45e1-98f6-308f8ab06d76 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:36.393068 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652abd0c-d621-45e1-98f6-308f8ab06d76 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:36.394318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 500/1011] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:16:36.401164 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f361e93-6e2a-4ea5-8dfe-2f32f5c025f0 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:36.401934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f361e93-6e2a-4ea5-8dfe-2f32f5c025f0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:36.401934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f361e93-6e2a-4ea5-8dfe-2f32f5c025f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:36.431762 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-3f361e93-6e2a-4ea5-8dfe-2f32f5c025f0 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:36.433823 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3f361e93-6e2a-4ea5-8dfe-2f32f5c025f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:36.583924 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:36.599986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 512/1012] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:36 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:16:36.901164 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652abd0c-d621-45e1-98f6-308f8ab06d76 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:37.055245 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652abd0c-d621-45e1-98f6-308f8ab06d76 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:37.100923 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:37.123494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c18bb4-19cd-4b6e-b78b-02ab34e5b886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:37.124624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c18bb4-19cd-4b6e-b78b-02ab34e5b886 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:37.125125 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c18bb4-19cd-4b6e-b78b-02ab34e5b886 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:37.125602 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c18bb4-19cd-4b6e-b78b-02ab34e5b886 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:37.126681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c18bb4-19cd-4b6e-b78b-02ab34e5b886 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:37.128840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c18bb4-19cd-4b6e-b78b-02ab34e5b886 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:37.147338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-40c18bb4-19cd-4b6e-b78b-02ab34e5b886 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 14:16:37.147338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:37.147338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:16:37.147338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:16:37.147338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:16:37.147338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:16:37.147338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:16:37.147338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:37.147338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 14:16:37.147338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:37.147338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:16:37.147338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:37.147338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:37.147338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:37.147338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:37.147338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:37.147338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:37.152353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:37.152353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:37.152353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:37.152353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:37.152353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:37.152353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:37.152353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:16:37.152353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:16:37.152353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:16:37.152353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:16:37.152353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:37.152353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:37.152353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:37.152353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:37.152353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:37.152353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:37.154820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:37.154820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:37.154820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:37.154820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:37.154820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:37.154820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:37.154820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:37.154820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:37.154820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:37.154820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:37.154820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:16:37.154820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:37.154820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 14:16:37.154820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:37.154820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 501/1013] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:16:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:37.161691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f361e93-6e2a-4ea5-8dfe-2f32f5c025f0 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:37.318880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f361e93-6e2a-4ea5-8dfe-2f32f5c025f0 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:37.381599 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fbe13-06cd-4bdd-afe8-e6d5a2647946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:37.382563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fbe13-06cd-4bdd-afe8-e6d5a2647946 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:37.382974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fbe13-06cd-4bdd-afe8-e6d5a2647946 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:37.383399 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fbe13-06cd-4bdd-afe8-e6d5a2647946 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:37.384494 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555fbe13-06cd-4bdd-afe8-e6d5a2647946 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:37.384994 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555fbe13-06cd-4bdd-afe8-e6d5a2647946 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:37.388624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555fbe13-06cd-4bdd-afe8-e6d5a2647946 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:37.404447 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 513/1014] 10.222.0.62 () {56 vars in 1112 bytes} [Tue Oct 4 14:16:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:37.408092 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c18bb4-19cd-4b6e-b78b-02ab34e5b886 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:37.589854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c18bb4-19cd-4b6e-b78b-02ab34e5b886 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:37.653845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d8014-53c3-48b7-8e46-1ada251e7829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:37.655221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d8014-53c3-48b7-8e46-1ada251e7829 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:37.655643 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d8014-53c3-48b7-8e46-1ada251e7829 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:37.656156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d8014-53c3-48b7-8e46-1ada251e7829 None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:37.657369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d8014-53c3-48b7-8e46-1ada251e7829 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:37.657901 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d8014-53c3-48b7-8e46-1ada251e7829 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:37.660612 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d8014-53c3-48b7-8e46-1ada251e7829 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:37.675786 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 502/1015] 10.222.0.62 () {56 vars in 1112 bytes} [Tue Oct 4 14:16:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:37.682207 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fbe13-06cd-4bdd-afe8-e6d5a2647946 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:37.810024 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:37.883801 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4f23d-b036-4e58-9161-0e0125c9a1c5 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:37.884292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4f23d-b036-4e58-9161-0e0125c9a1c5 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:37.884643 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4f23d-b036-4e58-9161-0e0125c9a1c5 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:37.885440 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fbe13-06cd-4bdd-afe8-e6d5a2647946 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:37.887130 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 503/1016] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:16:37.893773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee65c0e-32e1-4e69-8452-3a0e475c6a4c None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:37.894060 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee65c0e-32e1-4e69-8452-3a0e475c6a4c None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:37.894340 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee65c0e-32e1-4e69-8452-3a0e475c6a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:37.926216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-0ee65c0e-32e1-4e69-8452-3a0e475c6a4c None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:37.928410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-0ee65c0e-32e1-4e69-8452-3a0e475c6a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:37.962110 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38debecf-a8d8-4d07-86f3-83c6eeeaae07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:37.963144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38debecf-a8d8-4d07-86f3-83c6eeeaae07 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:37.963618 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38debecf-a8d8-4d07-86f3-83c6eeeaae07 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:37.964136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38debecf-a8d8-4d07-86f3-83c6eeeaae07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:37.965979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38debecf-a8d8-4d07-86f3-83c6eeeaae07 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:37.968754 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38debecf-a8d8-4d07-86f3-83c6eeeaae07 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:37.989242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:38.007184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 514/1017] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:16:37 2022] POST /identity/v3/endpoints => generated 334 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:16:38.023582 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede93237-c621-47cd-9f4a-a9a8a9070995 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:38.024066 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede93237-c621-47cd-9f4a-a9a8a9070995 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:38.024531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede93237-c621-47cd-9f4a-a9a8a9070995 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:38.027156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 515/1018] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:16:38.035183 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcfafa-a73d-47c5-a756-dcc13a857bbe None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:38.035498 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcfafa-a73d-47c5-a756-dcc13a857bbe None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:38.035748 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcfafa-a73d-47c5-a756-dcc13a857bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:38.043008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 504/1019] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 14:16:38.057535 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-7afcfafa-a73d-47c5-a756-dcc13a857bbe None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:38.059177 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7afcfafa-a73d-47c5-a756-dcc13a857bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:38.199326 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 516/1020] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 14:16:38.353385 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee65c0e-32e1-4e69-8452-3a0e475c6a4c None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:38.487383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee65c0e-32e1-4e69-8452-3a0e475c6a4c None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:38.536376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c8ffb-e699-4072-8d8b-d48079efea68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:38.537206 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c8ffb-e699-4072-8d8b-d48079efea68 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:38.537609 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c8ffb-e699-4072-8d8b-d48079efea68 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:38.538069 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c8ffb-e699-4072-8d8b-d48079efea68 None admin] PATH_INFO: `/v3/services/image` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:38.538839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c8ffb-e699-4072-8d8b-d48079efea68 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:38.540450 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c8ffb-e699-4072-8d8b-d48079efea68 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:38.553422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-ab8c8ffb-e699-4072-8d8b-d48079efea68 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 14:16:38.553422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:38.553422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:16:38.553422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:16:38.553422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:16:38.553422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:16:38.553422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:16:38.553422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:38.553422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 14:16:38.553422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:38.553422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:16:38.553422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:38.553422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:38.553422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:38.553422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:38.553422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:38.553422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:38.555485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:38.555485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:38.555485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:38.555485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:38.555485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:38.555485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:38.555485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:16:38.555485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:16:38.555485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:16:38.555485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:16:38.555485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:38.555485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:38.555485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:38.555485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:38.555485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:38.555485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:38.563904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:38.563904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:38.563904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:38.563904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:38.563904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:38.563904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:38.563904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:38.563904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:38.563904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:38.563904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:38.563904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:16:38.563904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:38.563904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 14:16:38.563904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:38.563904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 505/1021] 10.222.0.62 () {56 vars in 1105 bytes} [Tue Oct 4 14:16:38 2022] GET /identity/v3/services/image => generated 86 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:38.567113 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afcfafa-a73d-47c5-a756-dcc13a857bbe None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:38.567979 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c8ffb-e699-4072-8d8b-d48079efea68 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:38.624106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:38.672866 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:38.720702 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c8ffb-e699-4072-8d8b-d48079efea68 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:38.740253 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afcfafa-a73d-47c5-a756-dcc13a857bbe None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:38.781360 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39755f2-a37c-4deb-9190-4093b995ec81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:38.782529 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39755f2-a37c-4deb-9190-4093b995ec81 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:38.783019 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39755f2-a37c-4deb-9190-4093b995ec81 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:38.783502 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39755f2-a37c-4deb-9190-4093b995ec81 None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:38.784685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39755f2-a37c-4deb-9190-4093b995ec81 None admin] RBAC: Adding query filter params (name=image) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:38.785224 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39755f2-a37c-4deb-9190-4093b995ec81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:38.787380 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03292e0e-7d53-4bc9-bf66-d14fe83eec08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:38.787826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39755f2-a37c-4deb-9190-4093b995ec81 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:38.788560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03292e0e-7d53-4bc9-bf66-d14fe83eec08 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:38.789032 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03292e0e-7d53-4bc9-bf66-d14fe83eec08 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:38.789585 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03292e0e-7d53-4bc9-bf66-d14fe83eec08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:38.791128 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03292e0e-7d53-4bc9-bf66-d14fe83eec08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:38.792682 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03292e0e-7d53-4bc9-bf66-d14fe83eec08 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:38.795767 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 517/1022] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:38.801574 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 506/1023] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:38.808874 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03292e0e-7d53-4bc9-bf66-d14fe83eec08 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:38.810046 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39755f2-a37c-4deb-9190-4093b995ec81 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:38.945151 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39755f2-a37c-4deb-9190-4093b995ec81 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:38.954607 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:38.997418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c5091-cf33-4896-bc89-88ac5b8cd318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:38.997993 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c5091-cf33-4896-bc89-88ac5b8cd318 None admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:38.998269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c5091-cf33-4896-bc89-88ac5b8cd318 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:38.998535 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c5091-cf33-4896-bc89-88ac5b8cd318 None admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:38.999221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c5091-cf33-4896-bc89-88ac5b8cd318 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:39.000833 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c5091-cf33-4896-bc89-88ac5b8cd318 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:39.002085 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03292e0e-7d53-4bc9-bf66-d14fe83eec08 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:39.039404 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:39.051814 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 507/1024] 10.222.0.62 () {60 vars in 1141 bytes} [Tue Oct 4 14:16:38 2022] POST /identity/v3/projects => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:16:39.076154 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25a9ea-c15e-4ef9-a2b8-94527d02139b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:39.077134 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25a9ea-c15e-4ef9-a2b8-94527d02139b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:39.077590 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25a9ea-c15e-4ef9-a2b8-94527d02139b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:39.078041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25a9ea-c15e-4ef9-a2b8-94527d02139b None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:39.079180 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25a9ea-c15e-4ef9-a2b8-94527d02139b None admin] RBAC: Adding query filter params (type=image) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:39.079686 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25a9ea-c15e-4ef9-a2b8-94527d02139b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:39.082257 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25a9ea-c15e-4ef9-a2b8-94527d02139b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:39.091778 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 518/1025] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:39.099946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c5091-cf33-4896-bc89-88ac5b8cd318 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:39.310880 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c5091-cf33-4896-bc89-88ac5b8cd318 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:39.375502 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0cc5e-e561-45cc-b66e-eafec4a0d633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:39.376570 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0cc5e-e561-45cc-b66e-eafec4a0d633 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:39.377033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0cc5e-e561-45cc-b66e-eafec4a0d633 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:39.377488 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0cc5e-e561-45cc-b66e-eafec4a0d633 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:39.378792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0cc5e-e561-45cc-b66e-eafec4a0d633 None admin] RBAC: Adding query filter params (interface=public, service_id=7c8d0fd6387c44699702c7dd8c1b6106, region_id=RegionOne) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:39.379323 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0cc5e-e561-45cc-b66e-eafec4a0d633 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:39.382068 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0cc5e-e561-45cc-b66e-eafec4a0d633 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:39.393797 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 508/1026] 10.222.0.62 () {56 vars in 1251 bytes} [Tue Oct 4 14:16:39 2022] GET /identity/v3/endpoints?service_id=7c8d0fd6387c44699702c7dd8c1b6106&interface=public®ion_id=RegionOne => generated 194 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:39.410099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25a9ea-c15e-4ef9-a2b8-94527d02139b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:39.580761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25a9ea-c15e-4ef9-a2b8-94527d02139b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:39.626667 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594d282-6ee4-4f10-87e2-026c5cdc3fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:39.627555 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594d282-6ee4-4f10-87e2-026c5cdc3fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:39.628054 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594d282-6ee4-4f10-87e2-026c5cdc3fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:39.628519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594d282-6ee4-4f10-87e2-026c5cdc3fd9 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:39.629419 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594d282-6ee4-4f10-87e2-026c5cdc3fd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:39.631002 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594d282-6ee4-4f10-87e2-026c5cdc3fd9 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:39.647837 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 519/1027] 10.222.0.62 () {56 vars in 1087 bytes} [Tue Oct 4 14:16:39 2022] GET /identity/v3/services => generated 1957 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:16:41.246178 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e23b79-6a7c-41b0-a4e6-b0f80095ad68 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:41.247531 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e23b79-6a7c-41b0-a4e6-b0f80095ad68 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:41.247661 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e23b79-6a7c-41b0-a4e6-b0f80095ad68 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:41.250675 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 509/1028] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:16:41.259547 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c329ac-e0dc-45bc-9478-7750f6e6c36d None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:41.260393 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c329ac-e0dc-45bc-9478-7750f6e6c36d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:41.260531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c329ac-e0dc-45bc-9478-7750f6e6c36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:41.294445 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-a1c329ac-e0dc-45bc-9478-7750f6e6c36d None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:41.296080 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a1c329ac-e0dc-45bc-9478-7750f6e6c36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:41.351673 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:41.385236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 520/1029] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:16:41.684001 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e23b79-6a7c-41b0-a4e6-b0f80095ad68 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:41.734644 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:41.852665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e23b79-6a7c-41b0-a4e6-b0f80095ad68 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:41.903246 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623adf5c-5a64-4fcb-82d4-ba2218dc804d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:41.904198 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623adf5c-5a64-4fcb-82d4-ba2218dc804d None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:41.904491 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623adf5c-5a64-4fcb-82d4-ba2218dc804d None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:41.904768 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623adf5c-5a64-4fcb-82d4-ba2218dc804d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:41.918333 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623adf5c-5a64-4fcb-82d4-ba2218dc804d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:16:41.923806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-623adf5c-5a64-4fcb-82d4-ba2218dc804d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 14:16:41.923806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:41.923806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:41.923806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:41.923806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:41.923806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:41.923806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:41.923806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:41.923806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:41.923806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:41.923806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:41.923806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:41.923806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:16:41.923806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:16:41.923806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:16:41.923806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:16:41.924842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:16:41.924842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:16:41.924842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:16:41.924842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:16:41.924842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:41.924842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:41.924842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:41.924842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:41.924842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:41.924842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:41.924842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:41.924842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:41.924842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:41.924842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:41.924842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:41.924842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:41.925747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:41.925747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:41.925747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:41.925747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:41.925747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:16:41.925747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:16:41.925747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:16:41.925747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:16:41.925747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:16:41.925747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:16:41.925747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 14:16:41.925747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:41.930366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 510/1030] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Oct 4 14:16:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:41.931745 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c329ac-e0dc-45bc-9478-7750f6e6c36d None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:41.961910 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5993f01-85d6-4357-bbeb-eba63a3c2189 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:41.962172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5993f01-85d6-4357-bbeb-eba63a3c2189 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:41.962546 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5993f01-85d6-4357-bbeb-eba63a3c2189 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:41.964738 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 511/1031] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:16:41.972907 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c4f70-6c1f-4373-a172-bbb9a93dd4a0 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:41.973163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c4f70-6c1f-4373-a172-bbb9a93dd4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:41.973610 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c4f70-6c1f-4373-a172-bbb9a93dd4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:41.997477 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-d69c4f70-6c1f-4373-a172-bbb9a93dd4a0 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:41.999160 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d69c4f70-6c1f-4373-a172-bbb9a93dd4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:42.104006 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 512/1032] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 14:16:42.115536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c329ac-e0dc-45bc-9478-7750f6e6c36d None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:42.201442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559dc729-77ac-4b92-b8da-bc0f7cbd7bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:42.202412 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dc729-77ac-4b92-b8da-bc0f7cbd7bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:42.202838 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dc729-77ac-4b92-b8da-bc0f7cbd7bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:42.203330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dc729-77ac-4b92-b8da-bc0f7cbd7bc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:42.204635 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559dc729-77ac-4b92-b8da-bc0f7cbd7bc5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:42.204635 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559dc729-77ac-4b92-b8da-bc0f7cbd7bc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:42.206374 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559dc729-77ac-4b92-b8da-bc0f7cbd7bc5 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:42.227226 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 521/1033] 10.222.0.62 () {56 vars in 1115 bytes} [Tue Oct 4 14:16:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:42.231187 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c4f70-6c1f-4373-a172-bbb9a93dd4a0 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:42.262546 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:42.375185 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c4f70-6c1f-4373-a172-bbb9a93dd4a0 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:42.422840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e1735-ac9c-4f0a-b3c8-6e226389a56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:42.423730 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e1735-ac9c-4f0a-b3c8-6e226389a56b None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:42.424155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e1735-ac9c-4f0a-b3c8-6e226389a56b None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:42.424611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e1735-ac9c-4f0a-b3c8-6e226389a56b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:42.439149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e1735-ac9c-4f0a-b3c8-6e226389a56b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:42.440923 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e1735-ac9c-4f0a-b3c8-6e226389a56b None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:42.458894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-b26e1735-ac9c-4f0a-b3c8-6e226389a56b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:42.458894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:42.458894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:42.458894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:42.458894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:42.458894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:42.458894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:42.458894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:42.458894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:42.458894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:42.458894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:42.458894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:42.458894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:16:42.458894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:16:42.458894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:16:42.458894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:16:42.461146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:42.461146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:42.461146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:42.461146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:42.461146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:42.461146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:42.461146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:42.461146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:42.461146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:42.461146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:42.461146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:42.461146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:42.461146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:42.461146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:42.461146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:42.461146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:42.461146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:16:42.463812 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:16:42.463812 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:42.463812 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:42.468120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 513/1034] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:16:42.469442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559dc729-77ac-4b92-b8da-bc0f7cbd7bc5 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:42.480281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e1735-ac9c-4f0a-b3c8-6e226389a56b None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:42.530165 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:42.632652 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:42.662904 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559dc729-77ac-4b92-b8da-bc0f7cbd7bc5 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:42.689771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e1735-ac9c-4f0a-b3c8-6e226389a56b None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:42.709294 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b1731-ff6f-440e-8e1f-2b80a780501d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:42.709940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b1731-ff6f-440e-8e1f-2b80a780501d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:42.710227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b1731-ff6f-440e-8e1f-2b80a780501d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:42.710488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b1731-ff6f-440e-8e1f-2b80a780501d None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:42.711145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b1731-ff6f-440e-8e1f-2b80a780501d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:42.711449 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b1731-ff6f-440e-8e1f-2b80a780501d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:42.712905 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b1731-ff6f-440e-8e1f-2b80a780501d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:42.728868 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 522/1035] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:42.734826 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b1731-ff6f-440e-8e1f-2b80a780501d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:42.737087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bca906-3d3d-4c6f-a82a-230f7531de53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:42.738025 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bca906-3d3d-4c6f-a82a-230f7531de53 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:42.738339 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bca906-3d3d-4c6f-a82a-230f7531de53 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:42.739537 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bca906-3d3d-4c6f-a82a-230f7531de53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:42.740912 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bca906-3d3d-4c6f-a82a-230f7531de53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:42.742463 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bca906-3d3d-4c6f-a82a-230f7531de53 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:42.745269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 514/1036] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:42.752208 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bca906-3d3d-4c6f-a82a-230f7531de53 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:42.891422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:42.898463 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bca906-3d3d-4c6f-a82a-230f7531de53 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:42.903899 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b1731-ff6f-440e-8e1f-2b80a780501d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:42.952120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:42.962439 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd103480-68cf-4772-b1f1-af790d256816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:42.963078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd103480-68cf-4772-b1f1-af790d256816 None admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:42.963355 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd103480-68cf-4772-b1f1-af790d256816 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:42.963676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd103480-68cf-4772-b1f1-af790d256816 None admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:42.964385 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd103480-68cf-4772-b1f1-af790d256816 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:42.967286 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd103480-68cf-4772-b1f1-af790d256816 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:43.008868 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 515/1037] 10.222.0.62 () {60 vars in 1132 bytes} [Tue Oct 4 14:16:42 2022] POST /identity/v3/users => generated 285 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:16:43.009148 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bf55c-9a82-499b-b59b-d3830b60c3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:43.009148 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bf55c-9a82-499b-b59b-d3830b60c3ca None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:43.009148 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bf55c-9a82-499b-b59b-d3830b60c3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:43.009148 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bf55c-9a82-499b-b59b-d3830b60c3ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:43.018177 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29bf55c-9a82-499b-b59b-d3830b60c3ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:43.019915 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29bf55c-9a82-499b-b59b-d3830b60c3ca None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:43.035029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-a29bf55c-9a82-499b-b59b-d3830b60c3ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 14:16:43.035029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:43.035029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:43.035029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:43.035029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:43.035029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:43.035029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:43.035029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:43.035029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:43.035029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:43.035029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:43.035029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:43.035029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:16:43.035029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:16:43.035029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:16:43.035029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:16:43.044984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:43.044984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:43.044984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:16:43.044984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:16:43.044984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:16:43.044984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:16:43.044984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:43.044984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:43.044984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:43.044984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:43.044984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:43.044984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:43.044984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:43.044984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:43.044984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:43.044984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:43.044984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:43.044984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:43.047129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:43.047129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:43.047129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:16:43.047129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:16:43.047129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:16:43.047129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:16:43.047129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:16:43.047129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:16:43.047129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 14:16:43.047129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:43.047129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 523/1038] 10.222.0.62 () {56 vars in 1093 bytes} [Tue Oct 4 14:16:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:16:43.051917 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd103480-68cf-4772-b1f1-af790d256816 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:43.083666 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a06ee9-dbcf-4ce8-b5c0-9b584388a5ab None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:43.084140 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a06ee9-dbcf-4ce8-b5c0-9b584388a5ab None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:43.084560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a06ee9-dbcf-4ce8-b5c0-9b584388a5ab None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:43.086819 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 524/1039] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:16:43.095463 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5454d-f691-4af5-a534-6b6bac3b1a37 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:43.095952 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5454d-f691-4af5-a534-6b6bac3b1a37 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:43.096376 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5454d-f691-4af5-a534-6b6bac3b1a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:43.125185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-3dd5454d-f691-4af5-a534-6b6bac3b1a37 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:43.126251 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3dd5454d-f691-4af5-a534-6b6bac3b1a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:43.239838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd103480-68cf-4772-b1f1-af790d256816 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:43.244757 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 525/1040] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 14:16:43.314454 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edff9e-b4dd-4e9b-8f4f-88c42decc525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:43.315571 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edff9e-b4dd-4e9b-8f4f-88c42decc525 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:43.316106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edff9e-b4dd-4e9b-8f4f-88c42decc525 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:43.316709 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edff9e-b4dd-4e9b-8f4f-88c42decc525 None admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:43.318111 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edff9e-b4dd-4e9b-8f4f-88c42decc525 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:43.318660 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edff9e-b4dd-4e9b-8f4f-88c42decc525 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:43.321717 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edff9e-b4dd-4e9b-8f4f-88c42decc525 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:43.366592 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 516/1041] 10.222.0.62 () {56 vars in 1133 bytes} [Tue Oct 4 14:16:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:43.375598 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5454d-f691-4af5-a534-6b6bac3b1a37 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:43.546885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:43.570624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edff9e-b4dd-4e9b-8f4f-88c42decc525 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:43.582324 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5454d-f691-4af5-a534-6b6bac3b1a37 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:43.633690 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:43.650051 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdf482-23ed-486e-be08-f58de004f7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:43.650964 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdf482-23ed-486e-be08-f58de004f7c7 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:43.651488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdf482-23ed-486e-be08-f58de004f7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:43.651973 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdf482-23ed-486e-be08-f58de004f7c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:43.727328 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edff9e-b4dd-4e9b-8f4f-88c42decc525 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:43.794639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0402df8-b202-40cc-b824-0dc6073aee8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:43.795665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0402df8-b202-40cc-b824-0dc6073aee8e None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:43.796174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0402df8-b202-40cc-b824-0dc6073aee8e None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:43.796646 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0402df8-b202-40cc-b824-0dc6073aee8e None admin] PATH_INFO: `/v3/services/image` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:43.797714 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bdf482-23ed-486e-be08-f58de004f7c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:43.797826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0402df8-b202-40cc-b824-0dc6073aee8e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:43.800256 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0402df8-b202-40cc-b824-0dc6073aee8e None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:43.800396 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bdf482-23ed-486e-be08-f58de004f7c7 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:43.817829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-f0402df8-b202-40cc-b824-0dc6073aee8e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 14:16:43.817829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:43.817829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:16:43.817829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:16:43.817829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:16:43.817829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:16:43.817829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:16:43.817829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:43.817829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 14:16:43.817829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:43.817829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:16:43.817829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:43.817829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:43.817829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:43.817829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:43.817829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:43.817829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:43.818906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:43.818906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:43.818906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:43.818906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:43.818906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:43.818906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:43.818906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:16:43.818906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:16:43.818906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:16:43.818906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:16:43.818906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:43.818906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:43.818906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:43.818906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:43.818906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:43.818906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:43.820203 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:43.820203 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:43.820203 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:43.820203 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:43.820203 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:43.820203 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:43.820203 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:43.820203 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:43.820203 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:43.820203 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:43.820203 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:16:43.820203 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:16:43.820203 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 14:16:43.820203 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:43.824198 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 517/1042] 10.222.0.62 () {56 vars in 1105 bytes} [Tue Oct 4 14:16:43 2022] GET /identity/v3/services/image => generated 86 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:16:43.829674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0402df8-b202-40cc-b824-0dc6073aee8e None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:43.954505 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:43.985435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 526/1043] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:16:43 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 14:16:43.988328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdf482-23ed-486e-be08-f58de004f7c7 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:44.014968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0402df8-b202-40cc-b824-0dc6073aee8e None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:44.033692 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:44.079140 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa3340-900e-47cf-b7c8-37fe2b6293c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:44.080008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa3340-900e-47cf-b7c8-37fe2b6293c2 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:44.080328 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa3340-900e-47cf-b7c8-37fe2b6293c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:44.080649 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa3340-900e-47cf-b7c8-37fe2b6293c2 None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:44.081598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa3340-900e-47cf-b7c8-37fe2b6293c2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:44.082076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa3340-900e-47cf-b7c8-37fe2b6293c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:44.084946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa3340-900e-47cf-b7c8-37fe2b6293c2 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:44.094231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 518/1044] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:44.100225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa3340-900e-47cf-b7c8-37fe2b6293c2 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:44.161999 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdf482-23ed-486e-be08-f58de004f7c7 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:44.227042 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd2d9d-c2e3-4a53-bcc4-005b228d7600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:44.227690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd2d9d-c2e3-4a53-bcc4-005b228d7600 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:44.228004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd2d9d-c2e3-4a53-bcc4-005b228d7600 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:44.228303 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd2d9d-c2e3-4a53-bcc4-005b228d7600 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:44.242988 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd2d9d-c2e3-4a53-bcc4-005b228d7600 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:44.244494 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd2d9d-c2e3-4a53-bcc4-005b228d7600 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:44.271233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-67cd2d9d-c2e3-4a53-bcc4-005b228d7600 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:44.271233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:44.271233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:44.271233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:44.271233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:44.271233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:44.271233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:44.271233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:44.271233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:44.271233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:44.271233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:44.271233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:44.271233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:16:44.271233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:16:44.271233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:16:44.271233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:16:44.272406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:44.272406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:44.272406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:44.272406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:44.272406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:44.272406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:44.272406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:44.272406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:44.272406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:44.272406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:44.272406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:44.272406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:44.272406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:44.272406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:44.272406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:44.272406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:44.272406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:16:44.273290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:16:44.273290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:44.273290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:44.279674 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 527/1045] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:44.282304 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd2d9d-c2e3-4a53-bcc4-005b228d7600 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:44.300812 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa3340-900e-47cf-b7c8-37fe2b6293c2 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:44.352924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838d57a-ed58-4d11-8613-55e63a6488ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:44.353937 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838d57a-ed58-4d11-8613-55e63a6488ea None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:44.354279 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838d57a-ed58-4d11-8613-55e63a6488ea None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:44.354915 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838d57a-ed58-4d11-8613-55e63a6488ea None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:44.356261 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838d57a-ed58-4d11-8613-55e63a6488ea None admin] RBAC: Adding query filter params (type=image) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:44.356631 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838d57a-ed58-4d11-8613-55e63a6488ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:44.358812 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838d57a-ed58-4d11-8613-55e63a6488ea None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:44.370035 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 519/1046] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:44.373284 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838d57a-ed58-4d11-8613-55e63a6488ea None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:44.377029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:44.438667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:44.480410 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd2d9d-c2e3-4a53-bcc4-005b228d7600 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:44.530782 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eea706-abfe-424e-bc56-cd4b39eb4632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:44.531412 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eea706-abfe-424e-bc56-cd4b39eb4632 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:44.531687 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eea706-abfe-424e-bc56-cd4b39eb4632 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:44.531988 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eea706-abfe-424e-bc56-cd4b39eb4632 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:44.532650 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eea706-abfe-424e-bc56-cd4b39eb4632 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:44.532947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eea706-abfe-424e-bc56-cd4b39eb4632 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:44.534349 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eea706-abfe-424e-bc56-cd4b39eb4632 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:44.554656 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 528/1047] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:44.560067 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eea706-abfe-424e-bc56-cd4b39eb4632 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:44.561206 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838d57a-ed58-4d11-8613-55e63a6488ea None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:44.626257 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b49df6-1540-4c68-99c1-b943ef39b745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:44.627402 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b49df6-1540-4c68-99c1-b943ef39b745 None admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:44.627932 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b49df6-1540-4c68-99c1-b943ef39b745 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:44.628400 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b49df6-1540-4c68-99c1-b943ef39b745 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:44.629645 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b49df6-1540-4c68-99c1-b943ef39b745 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:44.632554 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b49df6-1540-4c68-99c1-b943ef39b745 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:44.668167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 520/1048] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:16:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:16:44.766134 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:44.771561 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eea706-abfe-424e-bc56-cd4b39eb4632 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:44.841288 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bae63d-0468-44fe-806b-1b6397ca0110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:44.842089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bae63d-0468-44fe-806b-1b6397ca0110 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:44.842392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bae63d-0468-44fe-806b-1b6397ca0110 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:44.842688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bae63d-0468-44fe-806b-1b6397ca0110 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:44.851681 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bae63d-0468-44fe-806b-1b6397ca0110 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:44.853284 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bae63d-0468-44fe-806b-1b6397ca0110 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:44.868036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-50bae63d-0468-44fe-806b-1b6397ca0110 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:16:44.868036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:44.868036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:44.868036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:44.868036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:44.868036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:44.868036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:44.868036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:44.868036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:44.868036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:44.868036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:44.868036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:44.868036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:16:44.868036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:16:44.868036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:16:44.869844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:16:44.869844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:44.869844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:44.869844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:44.869844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:44.869844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:44.869844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:44.869844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:44.869844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:44.869844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:44.869844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:44.869844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:44.869844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:44.869844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:44.869844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:44.869844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:44.869844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:44.880783 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:16:44.880783 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:16:44.880783 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:16:44.880783 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:16:44.880783 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:16:44.880783 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:16:44.880783 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:16:44.880783 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:44.880783 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 529/1049] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:16:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:44.888648 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b49df6-1540-4c68-99c1-b943ef39b745 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:45.009744 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:45.022276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b49df6-1540-4c68-99c1-b943ef39b745 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:45.066872 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da02703-616d-40bd-9a2b-1a26ebd09df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:45.067678 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da02703-616d-40bd-9a2b-1a26ebd09df4 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:45.068157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da02703-616d-40bd-9a2b-1a26ebd09df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:45.068557 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da02703-616d-40bd-9a2b-1a26ebd09df4 None admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:45.069493 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da02703-616d-40bd-9a2b-1a26ebd09df4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:45.069998 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da02703-616d-40bd-9a2b-1a26ebd09df4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:45.071773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da02703-616d-40bd-9a2b-1a26ebd09df4 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:45.091761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 521/1050] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:16:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:45.098601 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bae63d-0468-44fe-806b-1b6397ca0110 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:45.228997 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bae63d-0468-44fe-806b-1b6397ca0110 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:45.290837 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79638b6-7393-4117-bf4b-efebbd184f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:45.291468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79638b6-7393-4117-bf4b-efebbd184f5e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:45.291775 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79638b6-7393-4117-bf4b-efebbd184f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:45.292050 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79638b6-7393-4117-bf4b-efebbd184f5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:45.292799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79638b6-7393-4117-bf4b-efebbd184f5e None admin] RBAC: Adding query filter params (role.id=d07f12353933422cbbf32385916d2bfa, scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba, user.id=151e7b9c7a7b46d58dc2f563d05775e2) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:45.293176 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79638b6-7393-4117-bf4b-efebbd184f5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:45.295524 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79638b6-7393-4117-bf4b-efebbd184f5e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:45.302538 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 530/1051] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:16:45 2022] GET /identity/v3/role_assignments?user.id=151e7b9c7a7b46d58dc2f563d05775e2&scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba&role.id=d07f12353933422cbbf32385916d2bfa => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:45.867226 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc182acb-0e8e-4d67-b7f1-e1e96b6a0d58 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:45.867996 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc182acb-0e8e-4d67-b7f1-e1e96b6a0d58 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:45.867996 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc182acb-0e8e-4d67-b7f1-e1e96b6a0d58 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:45.869141 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 522/1052] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:16:45.876309 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6129b-08bc-4ef0-b2bd-257a5f8f1749 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:45.877229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6129b-08bc-4ef0-b2bd-257a5f8f1749 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:45.877229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6129b-08bc-4ef0-b2bd-257a5f8f1749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:45.897342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-8da6129b-08bc-4ef0-b2bd-257a5f8f1749 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:45.898577 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8da6129b-08bc-4ef0-b2bd-257a5f8f1749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:45.920050 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:45.998497 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 531/1053] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:16:46.286399 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc182acb-0e8e-4d67-b7f1-e1e96b6a0d58 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:46.459632 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc182acb-0e8e-4d67-b7f1-e1e96b6a0d58 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:46.530620 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9583cc-f546-4d71-91f4-0a3d141bb5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:46.532244 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9583cc-f546-4d71-91f4-0a3d141bb5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:46.533050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9583cc-f546-4d71-91f4-0a3d141bb5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:46.533832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9583cc-f546-4d71-91f4-0a3d141bb5f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:46.555153 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9583cc-f546-4d71-91f4-0a3d141bb5f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:16:46.565958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-9e9583cc-f546-4d71-91f4-0a3d141bb5f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:16:46.565958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:46.565958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:46.565958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:46.565958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:46.565958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:46.565958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:46.565958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:46.565958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:46.565958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:46.565958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:46.565958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:46.565958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:16:46.565958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:16:46.565958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:16:46.565958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:16:46.567874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:16:46.567874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:16:46.567874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:16:46.567874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:16:46.567874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:46.567874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:46.567874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:46.567874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:46.567874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:46.567874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:46.567874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:46.567874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:46.567874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:46.567874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:46.567874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:46.567874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:46.570420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:46.570420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:46.570420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:46.570420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:46.570420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:16:46.570420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:16:46.570420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:16:46.570420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:16:46.570420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:16:46.570420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:16:46.570420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:16:46.570420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:46.570420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 523/1054] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:16:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:46.575116 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6129b-08bc-4ef0-b2bd-257a5f8f1749 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:46.711246 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6129b-08bc-4ef0-b2bd-257a5f8f1749 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:46.760386 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee15a1d-d9bd-4e94-ae52-2046ec1eee39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:46.761016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee15a1d-d9bd-4e94-ae52-2046ec1eee39 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:46.761290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee15a1d-d9bd-4e94-ae52-2046ec1eee39 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:46.761561 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee15a1d-d9bd-4e94-ae52-2046ec1eee39 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:46.763459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee15a1d-d9bd-4e94-ae52-2046ec1eee39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:46.763459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee15a1d-d9bd-4e94-ae52-2046ec1eee39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:46.764880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee15a1d-d9bd-4e94-ae52-2046ec1eee39 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:46.775185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 532/1055] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:16:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:46.782852 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9583cc-f546-4d71-91f4-0a3d141bb5f0 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:46.815431 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:46.946346 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9583cc-f546-4d71-91f4-0a3d141bb5f0 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:46.991452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9aaa5-11a3-4ea5-a5e8-9aa12cea0572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:46.992146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9aaa5-11a3-4ea5-a5e8-9aa12cea0572 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:46.992425 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9aaa5-11a3-4ea5-a5e8-9aa12cea0572 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:46.992696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9aaa5-11a3-4ea5-a5e8-9aa12cea0572 None admin] PATH_INFO: `/v3/users/95d43ba60a334750adf35b3c8c306b9e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:47.008890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9aaa5-11a3-4ea5-a5e8-9aa12cea0572 None admin] RBAC: Authorizing `identity:get_user(user_id=95d43ba60a334750adf35b3c8c306b9e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:47.010358 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9aaa5-11a3-4ea5-a5e8-9aa12cea0572 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:47.013059 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 524/1056] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:16:46 2022] GET /identity/v3/users/95d43ba60a334750adf35b3c8c306b9e => generated 285 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:47.018973 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee15a1d-d9bd-4e94-ae52-2046ec1eee39 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:47.036597 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:47.143041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee15a1d-d9bd-4e94-ae52-2046ec1eee39 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:47.185697 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605d792-ab16-46c3-8d1b-c5a440de433d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:47.186337 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605d792-ab16-46c3-8d1b-c5a440de433d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:47.186616 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605d792-ab16-46c3-8d1b-c5a440de433d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:47.186902 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605d792-ab16-46c3-8d1b-c5a440de433d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:47.274242 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605d792-ab16-46c3-8d1b-c5a440de433d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:47.275781 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605d792-ab16-46c3-8d1b-c5a440de433d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:47.293707 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:47.471887 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 533/1057] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:16:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 14:16:47.477800 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9aaa5-11a3-4ea5-a5e8-9aa12cea0572 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:47.636030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:47.703008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9aaa5-11a3-4ea5-a5e8-9aa12cea0572 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:47.753819 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4c5e1-458a-4db7-9d50-cc44acead9f7 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:47.754291 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4c5e1-458a-4db7-9d50-cc44acead9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:47.754730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4c5e1-458a-4db7-9d50-cc44acead9f7 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:47.757189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 534/1058] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:16:47.764083 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b88130-2a3b-4ee9-b5fd-d4fcdff6ae52 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:47.764520 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b88130-2a3b-4ee9-b5fd-d4fcdff6ae52 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:47.764970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b88130-2a3b-4ee9-b5fd-d4fcdff6ae52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:47.778204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311b6f8-c926-4915-b944-bffa2def8625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:47.779051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311b6f8-c926-4915-b944-bffa2def8625 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:47.779489 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311b6f8-c926-4915-b944-bffa2def8625 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:47.779921 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311b6f8-c926-4915-b944-bffa2def8625 None admin] PATH_INFO: `/v3/projects/94ccbb3812134d72b2906f283b38b9b0` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:47.781377 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8311b6f8-c926-4915-b944-bffa2def8625 None admin] RBAC: Authorizing `identity:get_project(project_id=94ccbb3812134d72b2906f283b38b9b0)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:47.782987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8311b6f8-c926-4915-b944-bffa2def8625 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:47.785222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 525/1059] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:16:47 2022] GET /identity/v3/projects/94ccbb3812134d72b2906f283b38b9b0 => generated 311 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:47.791980 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311b6f8-c926-4915-b944-bffa2def8625 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:47.799024 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-13b88130-2a3b-4ee9-b5fd-d4fcdff6ae52 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:47.801034 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-13b88130-2a3b-4ee9-b5fd-d4fcdff6ae52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:47.936125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 535/1060] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 14:16:47.946459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311b6f8-c926-4915-b944-bffa2def8625 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:47.991013 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114dfd89-61ec-4333-9850-4b535c7a97f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:47.991635 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dfd89-61ec-4333-9850-4b535c7a97f4 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:47.991938 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dfd89-61ec-4333-9850-4b535c7a97f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:47.992221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dfd89-61ec-4333-9850-4b535c7a97f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:47.992950 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114dfd89-61ec-4333-9850-4b535c7a97f4 None admin] RBAC: Adding query filter params (role.id=a16b6daeda5b4a67992f3c12514ca90e, scope.project.id=94ccbb3812134d72b2906f283b38b9b0, user.id=95d43ba60a334750adf35b3c8c306b9e) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:47.993252 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114dfd89-61ec-4333-9850-4b535c7a97f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:47.994734 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114dfd89-61ec-4333-9850-4b535c7a97f4 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:48.008143 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 526/1061] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:16:47 2022] GET /identity/v3/role_assignments?user.id=95d43ba60a334750adf35b3c8c306b9e&scope.project.id=94ccbb3812134d72b2906f283b38b9b0&role.id=a16b6daeda5b4a67992f3c12514ca90e => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:48.185476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a20f15-e489-468a-818d-118b9311c6f5 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:48.186111 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a20f15-e489-468a-818d-118b9311c6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:48.186111 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a20f15-e489-468a-818d-118b9311c6f5 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:48.187797 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 536/1062] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:16:48.193871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec7b00-c9ab-4ef6-87ab-f32e560241b6 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:48.194170 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec7b00-c9ab-4ef6-87ab-f32e560241b6 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:48.194492 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec7b00-c9ab-4ef6-87ab-f32e560241b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:48.203264 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:48.222311 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-0fec7b00-c9ab-4ef6-87ab-f32e560241b6 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:48.224275 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-0fec7b00-c9ab-4ef6-87ab-f32e560241b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:48.342137 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a20f15-e489-468a-818d-118b9311c6f5 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:48.354397 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 527/1063] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 14:16:48.400005 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:48.477136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a20f15-e489-468a-818d-118b9311c6f5 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:48.520364 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3dd31-f610-4cd7-bb95-9051d29883da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:48.521349 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3dd31-f610-4cd7-bb95-9051d29883da None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:48.521846 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3dd31-f610-4cd7-bb95-9051d29883da None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:48.522422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3dd31-f610-4cd7-bb95-9051d29883da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:48.624173 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3dd31-f610-4cd7-bb95-9051d29883da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:48.625578 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3dd31-f610-4cd7-bb95-9051d29883da None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:48.678685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:48.791554 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 537/1064] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:16:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 14:16:48.797148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec7b00-c9ab-4ef6-87ab-f32e560241b6 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:48.799630 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3dd31-f610-4cd7-bb95-9051d29883da None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:48.925568 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec7b00-c9ab-4ef6-87ab-f32e560241b6 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:48.952263 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3dd31-f610-4cd7-bb95-9051d29883da None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:48.974876 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ecc03-679b-4649-aee6-23c46d7a59a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:48.975747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ecc03-679b-4649-aee6-23c46d7a59a7 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:48.975984 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ecc03-679b-4649-aee6-23c46d7a59a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:48.976324 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ecc03-679b-4649-aee6-23c46d7a59a7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:48.978556 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:48.991278 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ecc03-679b-4649-aee6-23c46d7a59a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:16:48.997687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-ef3ecc03-679b-4649-aee6-23c46d7a59a7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 14:16:48.997687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:48.997687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:48.997687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:48.997687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:48.997687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:48.997687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:48.997687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:48.997687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:48.997687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:48.997687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:48.997687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:48.997687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:16:48.997687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:16:48.997687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:16:48.997687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:16:48.998705 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:16:48.998705 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:16:48.998705 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:16:48.998705 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:16:48.998705 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:48.998705 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:48.998705 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:48.998705 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:48.998705 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:48.998705 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:48.998705 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:48.998705 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:48.998705 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:48.998705 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:48.998705 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:48.998705 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:48.999560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:48.999560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:48.999560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:48.999560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:48.999560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:16:48.999560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:16:48.999560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:16:48.999560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:16:48.999560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:16:48.999560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:16:48.999560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 14:16:48.999560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:48.999560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 528/1065] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Oct 4 14:16:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:49.005148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ecc03-679b-4649-aee6-23c46d7a59a7 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:49.006501 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e77a76-7dd6-424b-930b-6ff074cd596d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:49.007568 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e77a76-7dd6-424b-930b-6ff074cd596d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:49.008109 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e77a76-7dd6-424b-930b-6ff074cd596d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:49.008900 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e77a76-7dd6-424b-930b-6ff074cd596d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:49.026439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e77a76-7dd6-424b-930b-6ff074cd596d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:49.028798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e77a76-7dd6-424b-930b-6ff074cd596d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:49.031360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:49.050906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-d0e77a76-7dd6-424b-930b-6ff074cd596d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:49.050906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:49.050906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:49.050906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:49.050906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:49.050906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:49.050906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:49.050906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:49.050906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:49.050906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:49.050906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:49.050906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:49.050906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:16:49.050906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:16:49.050906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:16:49.050906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:16:49.051993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:49.051993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:49.051993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:49.051993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:49.051993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:49.051993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:49.051993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:49.051993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:49.051993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:49.051993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:49.051993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:49.051993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:49.051993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:49.051993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:49.051993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:49.051993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:49.051993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:16:49.053121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:16:49.053121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:49.053121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:49.053121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 538/1066] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:49.067079 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e77a76-7dd6-424b-930b-6ff074cd596d None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:49.162127 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ecc03-679b-4649-aee6-23c46d7a59a7 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:49.212613 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2cdab-0c31-432b-ba0d-ab78b7077ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:49.213172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2cdab-0c31-432b-ba0d-ab78b7077ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:49.213453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2cdab-0c31-432b-ba0d-ab78b7077ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:49.213726 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2cdab-0c31-432b-ba0d-ab78b7077ea5 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:49.214434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2cdab-0c31-432b-ba0d-ab78b7077ea5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:49.214816 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2cdab-0c31-432b-ba0d-ab78b7077ea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:49.216311 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2cdab-0c31-432b-ba0d-ab78b7077ea5 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:49.226451 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 529/1067] 10.222.0.62 () {56 vars in 1115 bytes} [Tue Oct 4 14:16:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:49.232425 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2cdab-0c31-432b-ba0d-ab78b7077ea5 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:49.240842 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e77a76-7dd6-424b-930b-6ff074cd596d None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:49.286863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1ed63-3026-42bf-9b14-b07dea6271b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:49.287983 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1ed63-3026-42bf-9b14-b07dea6271b7 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:49.288560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1ed63-3026-42bf-9b14-b07dea6271b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:49.288833 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1ed63-3026-42bf-9b14-b07dea6271b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:49.289510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1ed63-3026-42bf-9b14-b07dea6271b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:49.289806 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1ed63-3026-42bf-9b14-b07dea6271b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:49.291212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1ed63-3026-42bf-9b14-b07dea6271b7 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:49.299497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:49.319754 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 539/1068] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:49.361367 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2cdab-0c31-432b-ba0d-ab78b7077ea5 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:49.405402 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc627e-3d10-450d-9e9b-76995a727a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:49.406060 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc627e-3d10-450d-9e9b-76995a727a64 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:49.406337 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc627e-3d10-450d-9e9b-76995a727a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:49.406672 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc627e-3d10-450d-9e9b-76995a727a64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:49.425789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc627e-3d10-450d-9e9b-76995a727a64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:49.427279 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc627e-3d10-450d-9e9b-76995a727a64 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:49.446386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-3afc627e-3d10-450d-9e9b-76995a727a64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:49.446386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:49.446386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:49.446386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:49.446386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:49.446386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:49.446386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:49.446386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:49.446386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:49.446386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:49.446386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:49.446386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:49.446386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:16:49.446386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:16:49.446386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:16:49.446386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:16:49.452318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:49.452318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:49.452318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:49.452318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:49.452318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:49.452318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:49.452318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:49.452318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:49.452318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:49.452318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:49.452318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:49.452318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:49.452318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:49.452318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:49.452318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:49.452318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:49.452318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:16:49.453214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:16:49.453214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:49.453214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:49.453214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 530/1069] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:16:49.456643 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1ed63-3026-42bf-9b14-b07dea6271b7 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:49.541676 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:49.604790 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1ed63-3026-42bf-9b14-b07dea6271b7 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:49.648477 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89d2b7-4cb4-48b9-80bf-f732d74ffe72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:49.649105 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89d2b7-4cb4-48b9-80bf-f732d74ffe72 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:49.649382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89d2b7-4cb4-48b9-80bf-f732d74ffe72 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:49.649650 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89d2b7-4cb4-48b9-80bf-f732d74ffe72 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:49.650300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89d2b7-4cb4-48b9-80bf-f732d74ffe72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:49.650594 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89d2b7-4cb4-48b9-80bf-f732d74ffe72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:49.652018 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89d2b7-4cb4-48b9-80bf-f732d74ffe72 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:49.673402 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 540/1070] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:49.679390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc627e-3d10-450d-9e9b-76995a727a64 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:49.800256 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc627e-3d10-450d-9e9b-76995a727a64 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:49.811664 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:49.841319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074b5bf-a97e-4525-b3e1-d350958f2e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:49.841961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074b5bf-a97e-4525-b3e1-d350958f2e9e None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:49.842253 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074b5bf-a97e-4525-b3e1-d350958f2e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:49.842516 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074b5bf-a97e-4525-b3e1-d350958f2e9e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:49.851256 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074b5bf-a97e-4525-b3e1-d350958f2e9e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:49.852821 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074b5bf-a97e-4525-b3e1-d350958f2e9e None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:49.865370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-1074b5bf-a97e-4525-b3e1-d350958f2e9e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 14:16:49.865370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:49.865370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:49.865370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:49.865370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:49.865370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:49.865370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:49.865370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:49.865370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:49.865370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:49.865370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:49.865370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:49.865370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:16:49.865370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:16:49.865370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:16:49.865370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:16:49.866405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:49.866405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:49.866405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:16:49.866405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:16:49.866405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:16:49.866405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:16:49.866405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:49.866405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:49.866405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:49.866405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:49.866405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:49.866405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:49.866405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:49.866405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:49.866405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:49.866405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:49.866405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:49.866405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:49.867391 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:49.867391 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:49.867391 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:16:49.867391 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:16:49.867391 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:16:49.867391 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:16:49.867391 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:16:49.867391 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:16:49.867391 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 14:16:49.867391 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:49.867391 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 531/1071] 10.222.0.62 () {56 vars in 1093 bytes} [Tue Oct 4 14:16:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:49.873652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89d2b7-4cb4-48b9-80bf-f732d74ffe72 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:49.985281 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89d2b7-4cb4-48b9-80bf-f732d74ffe72 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:50.000898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:50.027375 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2306151-c1c3-479b-b77e-f0e7a964d112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:50.028241 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2306151-c1c3-479b-b77e-f0e7a964d112 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:50.028527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2306151-c1c3-479b-b77e-f0e7a964d112 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:50.028805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2306151-c1c3-479b-b77e-f0e7a964d112 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:50.029570 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2306151-c1c3-479b-b77e-f0e7a964d112 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:50.029869 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2306151-c1c3-479b-b77e-f0e7a964d112 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:50.031329 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2306151-c1c3-479b-b77e-f0e7a964d112 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:50.052926 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 541/1072] 10.222.0.62 () {56 vars in 1133 bytes} [Tue Oct 4 14:16:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:50.059680 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074b5bf-a97e-4525-b3e1-d350958f2e9e None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:50.197983 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074b5bf-a97e-4525-b3e1-d350958f2e9e None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:50.242795 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f176e3-a89e-4f50-908c-fdd63e20e656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:50.243603 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f176e3-a89e-4f50-908c-fdd63e20e656 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:50.243986 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f176e3-a89e-4f50-908c-fdd63e20e656 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:50.244319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f176e3-a89e-4f50-908c-fdd63e20e656 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:50.258073 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f176e3-a89e-4f50-908c-fdd63e20e656 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:50.259569 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f176e3-a89e-4f50-908c-fdd63e20e656 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:50.279085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-03f176e3-a89e-4f50-908c-fdd63e20e656 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:50.279085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:50.279085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:50.279085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:50.279085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:50.279085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:50.279085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:50.279085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:50.279085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:50.279085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:50.279085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:50.279085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:50.279085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:16:50.279085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:16:50.279085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:16:50.279085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:16:50.281292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:50.281292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:50.281292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:50.281292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:50.281292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:50.281292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:50.281292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:50.281292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:50.281292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:50.281292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:50.281292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:50.281292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:50.281292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:50.281292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:50.281292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:50.281292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:50.281292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:16:50.283103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:16:50.283103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:50.283103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:50.283103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 532/1073] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:50.288176 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2306151-c1c3-479b-b77e-f0e7a964d112 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:50.485162 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2306151-c1c3-479b-b77e-f0e7a964d112 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:50.532631 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0838412-8ba5-46e1-aae8-20d945017686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:50.533404 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0838412-8ba5-46e1-aae8-20d945017686 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:50.533765 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0838412-8ba5-46e1-aae8-20d945017686 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:50.534154 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0838412-8ba5-46e1-aae8-20d945017686 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:50.534910 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0838412-8ba5-46e1-aae8-20d945017686 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:50.535277 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0838412-8ba5-46e1-aae8-20d945017686 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:50.536876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0838412-8ba5-46e1-aae8-20d945017686 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:50.555821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 542/1074] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:50.563325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f176e3-a89e-4f50-908c-fdd63e20e656 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:50.590785 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:50.728050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f176e3-a89e-4f50-908c-fdd63e20e656 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:50.795045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee8b6d-48eb-40fd-955a-ce01b525f74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:50.796069 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee8b6d-48eb-40fd-955a-ce01b525f74c None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:50.796552 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee8b6d-48eb-40fd-955a-ce01b525f74c None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:50.797029 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee8b6d-48eb-40fd-955a-ce01b525f74c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:50.810236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee8b6d-48eb-40fd-955a-ce01b525f74c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:50.813378 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee8b6d-48eb-40fd-955a-ce01b525f74c None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:50.837948 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-84ee8b6d-48eb-40fd-955a-ce01b525f74c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:16:50.837948 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:50.837948 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:50.837948 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:50.837948 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:50.837948 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:50.837948 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:50.837948 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:50.837948 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:50.837948 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:50.837948 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:50.837948 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:50.837948 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:16:50.837948 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:16:50.837948 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:16:50.839056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:16:50.839056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:50.839056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:50.839056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:50.839056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:50.839056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:50.839056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:50.839056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:50.839056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:50.839056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:50.839056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:50.839056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:50.839056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:50.839056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:50.839056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:50.839056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:50.839056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:50.840546 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:16:50.840546 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:16:50.840546 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:16:50.840546 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:16:50.840546 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:16:50.840546 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:16:50.840546 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:16:50.840546 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:50.841841 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 533/1075] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:16:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:50.848567 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0838412-8ba5-46e1-aae8-20d945017686 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:50.912878 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:50.948236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6338562-3d40-43b6-8e46-3b70dd31ae4f None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:50.948660 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6338562-3d40-43b6-8e46-3b70dd31ae4f None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:50.949086 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6338562-3d40-43b6-8e46-3b70dd31ae4f None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:50.951665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 534/1076] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:16:50.957512 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c1b93-f5d1-4f5f-99cf-6805f60d30ea None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:50.957797 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c1b93-f5d1-4f5f-99cf-6805f60d30ea None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:50.958057 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c1b93-f5d1-4f5f-99cf-6805f60d30ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:50.977935 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-e78c1b93-f5d1-4f5f-99cf-6805f60d30ea None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:50.979271 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e78c1b93-f5d1-4f5f-99cf-6805f60d30ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:51.049594 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0838412-8ba5-46e1-aae8-20d945017686 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:51.059411 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 535/1077] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 14:16:51.113240 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a81a76-bf33-41dd-a69c-bd940f83f502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:51.114281 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a81a76-bf33-41dd-a69c-bd940f83f502 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:51.114779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a81a76-bf33-41dd-a69c-bd940f83f502 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:51.115229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a81a76-bf33-41dd-a69c-bd940f83f502 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:51.116530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a81a76-bf33-41dd-a69c-bd940f83f502 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:51.117049 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a81a76-bf33-41dd-a69c-bd940f83f502 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:51.119596 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a81a76-bf33-41dd-a69c-bd940f83f502 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:51.145677 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 543/1078] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:16:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:51.152944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c1b93-f5d1-4f5f-99cf-6805f60d30ea None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:51.174313 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:51.298476 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c1b93-f5d1-4f5f-99cf-6805f60d30ea None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:51.336469 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a81a76-bf33-41dd-a69c-bd940f83f502 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:51.360949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d5c08-0c6e-4ac4-9fc3-aafe6cc46a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:51.361993 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d5c08-0c6e-4ac4-9fc3-aafe6cc46a05 None admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:51.362426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d5c08-0c6e-4ac4-9fc3-aafe6cc46a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:51.362864 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d5c08-0c6e-4ac4-9fc3-aafe6cc46a05 None admin] PATH_INFO: `/v3/projects/fd73ece314ef4f2eabb34e2a88d610ba/users/151e7b9c7a7b46d58dc2f563d05775e2/roles/d07f12353933422cbbf32385916d2bfa` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:51.366182 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d5c08-0c6e-4ac4-9fc3-aafe6cc46a05 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd73ece314ef4f2eabb34e2a88d610ba, user_id=151e7b9c7a7b46d58dc2f563d05775e2, role_id=d07f12353933422cbbf32385916d2bfa)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:51.368676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d5c08-0c6e-4ac4-9fc3-aafe6cc46a05 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:51.390413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 536/1079] 10.222.0.62 () {58 vars in 1439 bytes} [Tue Oct 4 14:16:51 2022] PUT /identity/v3/projects/fd73ece314ef4f2eabb34e2a88d610ba/users/151e7b9c7a7b46d58dc2f563d05775e2/roles/d07f12353933422cbbf32385916d2bfa => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:16:51.457484 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:51.470263 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a81a76-bf33-41dd-a69c-bd940f83f502 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:51.515779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3a599-6f52-420d-a89e-80fc17d9ad90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:51.516450 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3a599-6f52-420d-a89e-80fc17d9ad90 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:51.516731 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3a599-6f52-420d-a89e-80fc17d9ad90 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:51.517005 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3a599-6f52-420d-a89e-80fc17d9ad90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:51.533276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3a599-6f52-420d-a89e-80fc17d9ad90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:16:51.538360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-11f3a599-6f52-420d-a89e-80fc17d9ad90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:16:51.538360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:51.538360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:51.538360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:51.538360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:51.538360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:51.538360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:51.538360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:51.538360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:51.538360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:51.538360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:51.538360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:51.538360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:16:51.538360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:16:51.538360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:16:51.538360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:16:51.539441 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:16:51.539441 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:16:51.539441 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:16:51.539441 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:16:51.539441 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:51.539441 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:51.539441 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:51.539441 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:51.539441 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:51.539441 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:51.539441 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:51.539441 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:51.539441 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:51.539441 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:51.539441 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:51.539441 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:51.540563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:51.540563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:51.540563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:51.540563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:51.540563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:16:51.540563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:16:51.540563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:16:51.540563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:16:51.540563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:16:51.540563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:16:51.540563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:16:51.540563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:51.540563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 544/1080] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:16:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:16:51.547465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d5c08-0c6e-4ac4-9fc3-aafe6cc46a05 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:51.645963 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:51.707436 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d5c08-0c6e-4ac4-9fc3-aafe6cc46a05 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:51.776992 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a3d94-435c-441f-bdb2-af047c2eb155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:51.778068 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a3d94-435c-441f-bdb2-af047c2eb155 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:51.778554 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a3d94-435c-441f-bdb2-af047c2eb155 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:51.779004 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a3d94-435c-441f-bdb2-af047c2eb155 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:51.780223 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a3d94-435c-441f-bdb2-af047c2eb155 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:51.780740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a3d94-435c-441f-bdb2-af047c2eb155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:51.783291 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a3d94-435c-441f-bdb2-af047c2eb155 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:51.806601 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 537/1081] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:16:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:51.809116 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3a599-6f52-420d-a89e-80fc17d9ad90 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:52.002869 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3a599-6f52-420d-a89e-80fc17d9ad90 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:52.054571 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc150d-8ff9-45f1-8c9e-cd6b94a26819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:52.055659 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc150d-8ff9-45f1-8c9e-cd6b94a26819 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:52.056182 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc150d-8ff9-45f1-8c9e-cd6b94a26819 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:52.056675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc150d-8ff9-45f1-8c9e-cd6b94a26819 None admin] PATH_INFO: `/v3/users/95d43ba60a334750adf35b3c8c306b9e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:52.058745 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc150d-8ff9-45f1-8c9e-cd6b94a26819 None admin] RBAC: Authorizing `identity:get_user(user_id=95d43ba60a334750adf35b3c8c306b9e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:52.061317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc150d-8ff9-45f1-8c9e-cd6b94a26819 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:52.064114 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 545/1082] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:16:51 2022] GET /identity/v3/users/95d43ba60a334750adf35b3c8c306b9e => generated 285 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:52.070597 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a3d94-435c-441f-bdb2-af047c2eb155 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:52.210145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a3d94-435c-441f-bdb2-af047c2eb155 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:52.246488 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:52.253383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f777cc5-aba3-4e5b-bb3e-f94c6e9fa4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:52.254005 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f777cc5-aba3-4e5b-bb3e-f94c6e9fa4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:52.254277 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f777cc5-aba3-4e5b-bb3e-f94c6e9fa4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:52.254616 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f777cc5-aba3-4e5b-bb3e-f94c6e9fa4a4 None admin] PATH_INFO: `/v3/projects/94ccbb3812134d72b2906f283b38b9b0` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:52.255856 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f777cc5-aba3-4e5b-bb3e-f94c6e9fa4a4 None admin] RBAC: Authorizing `identity:get_project(project_id=94ccbb3812134d72b2906f283b38b9b0)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:52.257319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f777cc5-aba3-4e5b-bb3e-f94c6e9fa4a4 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:52.259121 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 538/1083] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:16:52 2022] GET /identity/v3/projects/94ccbb3812134d72b2906f283b38b9b0 => generated 311 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:52.265863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc150d-8ff9-45f1-8c9e-cd6b94a26819 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:52.298053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:52.452750 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc150d-8ff9-45f1-8c9e-cd6b94a26819 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:52.525137 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8fd78-8ce3-4a1b-ae8d-98c1f4d621ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:52.526457 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8fd78-8ce3-4a1b-ae8d-98c1f4d621ba None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:52.526945 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8fd78-8ce3-4a1b-ae8d-98c1f4d621ba None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:52.527486 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8fd78-8ce3-4a1b-ae8d-98c1f4d621ba None admin] PATH_INFO: `/v3/projects/94ccbb3812134d72b2906f283b38b9b0/users/95d43ba60a334750adf35b3c8c306b9e/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:52.531756 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8fd78-8ce3-4a1b-ae8d-98c1f4d621ba None admin] RBAC: Authorizing `identity:create_grant(project_id=94ccbb3812134d72b2906f283b38b9b0, user_id=95d43ba60a334750adf35b3c8c306b9e, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:52.534708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8fd78-8ce3-4a1b-ae8d-98c1f4d621ba None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:52.560629 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 546/1084] 10.222.0.62 () {58 vars in 1439 bytes} [Tue Oct 4 14:16:52 2022] PUT /identity/v3/projects/94ccbb3812134d72b2906f283b38b9b0/users/95d43ba60a334750adf35b3c8c306b9e/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:16:53.934947 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a848dd-c206-4cb8-addf-13f029b8e751 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:53.935571 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a848dd-c206-4cb8-addf-13f029b8e751 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:53.935852 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a848dd-c206-4cb8-addf-13f029b8e751 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:53.938911 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 539/1085] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:16:53.945291 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe560b-07cc-4914-bd8e-c29306374066 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:53.946145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe560b-07cc-4914-bd8e-c29306374066 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:53.946145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe560b-07cc-4914-bd8e-c29306374066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:53.969362 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-74fe560b-07cc-4914-bd8e-c29306374066 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:53.970584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-74fe560b-07cc-4914-bd8e-c29306374066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:54.060153 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 547/1086] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 14:16:54.352338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a848dd-c206-4cb8-addf-13f029b8e751 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:54.490431 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a848dd-c206-4cb8-addf-13f029b8e751 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:54.533600 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d39737-3de9-403a-b184-81e48a63ca53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:54.534243 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d39737-3de9-403a-b184-81e48a63ca53 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:54.534518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d39737-3de9-403a-b184-81e48a63ca53 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:54.534785 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d39737-3de9-403a-b184-81e48a63ca53 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:54.547825 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d39737-3de9-403a-b184-81e48a63ca53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:16:54.555294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-04d39737-3de9-403a-b184-81e48a63ca53 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 14:16:54.555294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:54.555294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:54.555294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:54.555294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:54.555294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:54.555294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:54.555294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:54.555294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:54.555294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:54.555294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:54.555294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:54.555294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:16:54.555294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:16:54.555294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:16:54.555294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:16:54.557548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:16:54.557548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:16:54.557548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:16:54.557548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:16:54.557548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:54.557548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:54.557548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:54.557548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:54.557548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:54.557548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:54.557548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:54.557548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:54.557548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:54.557548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:54.557548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:54.557548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:54.560854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:54.560854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:54.560854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:54.560854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:54.560854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:16:54.560854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:16:54.560854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:16:54.560854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:16:54.560854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:16:54.560854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:16:54.560854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 14:16:54.560854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:54.560854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 540/1087] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Oct 4 14:16:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:16:54.564811 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe560b-07cc-4914-bd8e-c29306374066 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:54.579044 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:54.699700 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe560b-07cc-4914-bd8e-c29306374066 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:54.743278 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97610070-637d-41dd-80f9-63cf66ae1767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:54.744054 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97610070-637d-41dd-80f9-63cf66ae1767 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:54.744397 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97610070-637d-41dd-80f9-63cf66ae1767 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:54.744757 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97610070-637d-41dd-80f9-63cf66ae1767 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:54.745546 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97610070-637d-41dd-80f9-63cf66ae1767 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:54.746700 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97610070-637d-41dd-80f9-63cf66ae1767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:54.748725 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97610070-637d-41dd-80f9-63cf66ae1767 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:54.759213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 548/1088] 10.222.0.62 () {56 vars in 1115 bytes} [Tue Oct 4 14:16:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:54.768406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d39737-3de9-403a-b184-81e48a63ca53 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:54.861476 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:54.923823 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d39737-3de9-403a-b184-81e48a63ca53 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:54.931919 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa7ce-7e5d-41ad-a1dc-5a4fb8ba4a6c None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:54.932349 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa7ce-7e5d-41ad-a1dc-5a4fb8ba4a6c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:54.932628 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa7ce-7e5d-41ad-a1dc-5a4fb8ba4a6c None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:54.934851 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 549/1089] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:16:54.943862 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a694835-0e5c-4f46-b764-ddd0d372fb55 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:54.944338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a694835-0e5c-4f46-b764-ddd0d372fb55 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:54.944805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a694835-0e5c-4f46-b764-ddd0d372fb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:54.969691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-6a694835-0e5c-4f46-b764-ddd0d372fb55 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:54.970804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6a694835-0e5c-4f46-b764-ddd0d372fb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:54.971739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e5c53-0eb5-4ba3-8656-516c7bf361a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:54.972658 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e5c53-0eb5-4ba3-8656-516c7bf361a3 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:54.973111 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e5c53-0eb5-4ba3-8656-516c7bf361a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:54.973446 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e5c53-0eb5-4ba3-8656-516c7bf361a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:54.991248 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e5c53-0eb5-4ba3-8656-516c7bf361a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:54.993438 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e5c53-0eb5-4ba3-8656-516c7bf361a3 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:55.011051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-579e5c53-0eb5-4ba3-8656-516c7bf361a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:55.011051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:55.011051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:55.011051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:55.011051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:55.011051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:55.011051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:55.011051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:55.011051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:55.011051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:55.011051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:55.011051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:55.011051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:16:55.011051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:16:55.011051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:16:55.011051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:16:55.013184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:55.013184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:55.013184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:55.013184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:55.013184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:55.013184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:55.013184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:55.013184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:55.013184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:55.013184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:55.013184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:55.013184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:55.013184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:55.013184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:55.013184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:55.013184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:55.013184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:16:55.015542 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:16:55.015542 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:55.015542 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:55.017629 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 541/1090] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:16:55.018608 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e5c53-0eb5-4ba3-8656-516c7bf361a3 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:55.063468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 550/1091] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:16:55.143259 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e5c53-0eb5-4ba3-8656-516c7bf361a3 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:55.158541 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:55.184925 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304863b6-cdd4-41d9-b17c-7cc3297cad14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:55.185541 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304863b6-cdd4-41d9-b17c-7cc3297cad14 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:55.185814 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304863b6-cdd4-41d9-b17c-7cc3297cad14 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:55.186082 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304863b6-cdd4-41d9-b17c-7cc3297cad14 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:55.186733 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304863b6-cdd4-41d9-b17c-7cc3297cad14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:55.187030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304863b6-cdd4-41d9-b17c-7cc3297cad14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:55.188724 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304863b6-cdd4-41d9-b17c-7cc3297cad14 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:55.205394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 542/1092] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:16:55.211360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a694835-0e5c-4f46-b764-ddd0d372fb55 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:55.215185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:55.346403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304863b6-cdd4-41d9-b17c-7cc3297cad14 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:55.379697 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a694835-0e5c-4f46-b764-ddd0d372fb55 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:55.430005 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26255a-809b-417f-ac7c-b558a5d537da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:55.430781 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26255a-809b-417f-ac7c-b558a5d537da None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:55.431162 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26255a-809b-417f-ac7c-b558a5d537da None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:55.431529 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26255a-809b-417f-ac7c-b558a5d537da None admin] PATH_INFO: `/v3/users/nova` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:55.441344 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26255a-809b-417f-ac7c-b558a5d537da None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:55.442835 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26255a-809b-417f-ac7c-b558a5d537da None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:55.459802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-3b26255a-809b-417f-ac7c-b558a5d537da None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 14:16:55.459802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:55.459802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:55.459802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:55.459802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:55.459802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:55.459802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:55.459802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:55.459802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:55.459802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:55.459802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:55.459802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:55.459802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:16:55.459802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:16:55.459802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:16:55.459802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:16:55.462057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:55.462057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:55.462057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:16:55.462057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:16:55.462057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:16:55.462057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:16:55.462057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:55.462057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:55.462057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:55.462057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:55.462057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:55.462057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:55.462057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:55.462057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:55.462057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:55.462057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:55.462057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:55.462057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:55.464186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:55.464186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:55.464186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:16:55.464186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:16:55.464186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:16:55.464186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:16:55.464186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:16:55.464186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:16:55.464186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 14:16:55.464186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:55.464186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 551/1093] 10.222.0.62 () {56 vars in 1093 bytes} [Tue Oct 4 14:16:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:16:55.471050 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26255a-809b-417f-ac7c-b558a5d537da None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:55.493800 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304863b6-cdd4-41d9-b17c-7cc3297cad14 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:55.543211 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bba13d-7ff7-42e1-b291-e1b422611d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:55.544644 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bba13d-7ff7-42e1-b291-e1b422611d22 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:55.544923 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bba13d-7ff7-42e1-b291-e1b422611d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:55.545198 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bba13d-7ff7-42e1-b291-e1b422611d22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:55.547620 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:55.562398 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bba13d-7ff7-42e1-b291-e1b422611d22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:16:55.567700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-21bba13d-7ff7-42e1-b291-e1b422611d22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:16:55.567700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:55.567700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:55.567700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:55.567700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:55.567700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:55.567700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:55.567700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:55.567700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:55.567700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:55.567700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:55.567700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:55.567700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:16:55.567700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:16:55.567700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:16:55.567700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:16:55.569260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:16:55.569260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:16:55.569260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:16:55.569260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:16:55.569260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:55.569260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:55.569260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:55.569260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:55.569260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:55.569260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:55.569260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:55.569260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:55.569260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:55.569260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:55.569260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:55.569260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:55.570509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:55.570509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:55.570509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:55.570509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:55.570509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:16:55.570509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:16:55.570509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:16:55.570509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:16:55.570509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:16:55.570509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:16:55.570509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:16:55.570509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:16:55.570509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 543/1094] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:16:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:16:55.578799 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bba13d-7ff7-42e1-b291-e1b422611d22 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:55.602083 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26255a-809b-417f-ac7c-b558a5d537da None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:55.629065 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:55.651729 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3ed6c-e2d9-4dc6-8851-e76d70e9bd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:55.653167 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3ed6c-e2d9-4dc6-8851-e76d70e9bd5b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:55.653460 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3ed6c-e2d9-4dc6-8851-e76d70e9bd5b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:55.653733 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3ed6c-e2d9-4dc6-8851-e76d70e9bd5b None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:55.654615 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3ed6c-e2d9-4dc6-8851-e76d70e9bd5b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:55.655135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3ed6c-e2d9-4dc6-8851-e76d70e9bd5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:55.657738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3ed6c-e2d9-4dc6-8851-e76d70e9bd5b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:55.681156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 552/1095] 10.222.0.62 () {56 vars in 1133 bytes} [Tue Oct 4 14:16:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:55.688161 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3ed6c-e2d9-4dc6-8851-e76d70e9bd5b None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:55.730686 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bba13d-7ff7-42e1-b291-e1b422611d22 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:55.779653 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a594022-df34-4baa-9f60-11e1fb8058ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:55.780668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a594022-df34-4baa-9f60-11e1fb8058ac None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:55.781111 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a594022-df34-4baa-9f60-11e1fb8058ac None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:55.781617 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a594022-df34-4baa-9f60-11e1fb8058ac None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:55.782737 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a594022-df34-4baa-9f60-11e1fb8058ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:55.783222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a594022-df34-4baa-9f60-11e1fb8058ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:55.785282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a594022-df34-4baa-9f60-11e1fb8058ac None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:55.801101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 544/1096] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:16:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:55.806510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a594022-df34-4baa-9f60-11e1fb8058ac None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:55.835454 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3ed6c-e2d9-4dc6-8851-e76d70e9bd5b None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:55.864709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:55.882060 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fe8fd-efae-4b75-9f24-c2993466066e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:55.882728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fe8fd-efae-4b75-9f24-c2993466066e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:55.883005 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fe8fd-efae-4b75-9f24-c2993466066e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:55.883273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fe8fd-efae-4b75-9f24-c2993466066e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:55.956964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:55.963462 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fe8fd-efae-4b75-9f24-c2993466066e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:55.966689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fe8fd-efae-4b75-9f24-c2993466066e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:55.966841 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a594022-df34-4baa-9f60-11e1fb8058ac None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:56.018720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911b291-70ba-41f3-a130-f221b65c7ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:56.019633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911b291-70ba-41f3-a130-f221b65c7ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:56.020128 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911b291-70ba-41f3-a130-f221b65c7ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:56.020468 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911b291-70ba-41f3-a130-f221b65c7ed0 None admin] PATH_INFO: `/v3/users/95d43ba60a334750adf35b3c8c306b9e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:56.021730 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911b291-70ba-41f3-a130-f221b65c7ed0 None admin] RBAC: Authorizing `identity:get_user(user_id=95d43ba60a334750adf35b3c8c306b9e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:56.023197 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911b291-70ba-41f3-a130-f221b65c7ed0 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:56.024934 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 545/1097] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:16:55 2022] GET /identity/v3/users/95d43ba60a334750adf35b3c8c306b9e => generated 285 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:56.033101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911b291-70ba-41f3-a130-f221b65c7ed0 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:56.126093 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 553/1098] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:16:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 14:16:56.127287 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fe8fd-efae-4b75-9f24-c2993466066e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:56.153144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:56.163541 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911b291-70ba-41f3-a130-f221b65c7ed0 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:56.218398 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d38f8-8618-4617-9256-113a8c0cc0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:56.219135 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d38f8-8618-4617-9256-113a8c0cc0f1 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:56.219524 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d38f8-8618-4617-9256-113a8c0cc0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:56.219951 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d38f8-8618-4617-9256-113a8c0cc0f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:56.258578 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:56.260774 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fe8fd-efae-4b75-9f24-c2993466066e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:56.305584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687f78e-a46a-40d7-b046-bbe9910c2b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:56.306231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687f78e-a46a-40d7-b046-bbe9910c2b69 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:56.306502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687f78e-a46a-40d7-b046-bbe9910c2b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:56.306769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687f78e-a46a-40d7-b046-bbe9910c2b69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:56.310285 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d38f8-8618-4617-9256-113a8c0cc0f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:56.312058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d38f8-8618-4617-9256-113a8c0cc0f1 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:56.320012 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687f78e-a46a-40d7-b046-bbe9910c2b69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:56.322200 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687f78e-a46a-40d7-b046-bbe9910c2b69 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:56.343053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-3687f78e-a46a-40d7-b046-bbe9910c2b69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:56.343053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:56.343053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:56.343053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:56.343053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:56.343053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:56.343053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:56.343053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:56.343053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:56.343053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:56.343053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:56.343053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:56.343053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:16:56.343053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:16:56.343053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:16:56.343053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:16:56.345262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:56.345262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:56.345262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:56.345262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:56.345262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:56.345262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:56.345262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:56.345262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:56.345262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:56.345262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:56.345262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:56.345262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:56.345262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:56.345262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:56.345262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:56.345262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:56.345262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:16:56.347492 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:16:56.347492 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:16:56.347492 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:56.347492 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 554/1099] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:16:56.352148 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687f78e-a46a-40d7-b046-bbe9910c2b69 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:56.441024 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:56.457998 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 546/1100] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:16:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 14:16:56.464336 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d38f8-8618-4617-9256-113a8c0cc0f1 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:56.484452 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687f78e-a46a-40d7-b046-bbe9910c2b69 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:56.534673 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11533957-8383-43ef-8785-dff23cb66d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:56.535375 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11533957-8383-43ef-8785-dff23cb66d26 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:56.535656 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11533957-8383-43ef-8785-dff23cb66d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:56.536390 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11533957-8383-43ef-8785-dff23cb66d26 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:56.536611 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11533957-8383-43ef-8785-dff23cb66d26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:56.536916 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11533957-8383-43ef-8785-dff23cb66d26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:56.538308 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11533957-8383-43ef-8785-dff23cb66d26 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:56.551906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 555/1101] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:56.557578 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11533957-8383-43ef-8785-dff23cb66d26 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:56.570748 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:56.616623 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d38f8-8618-4617-9256-113a8c0cc0f1 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:56.672713 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d239d7-a6fe-4903-bee1-db01f3870a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:56.673366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d239d7-a6fe-4903-bee1-db01f3870a0f None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:56.674538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d239d7-a6fe-4903-bee1-db01f3870a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:56.674824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d239d7-a6fe-4903-bee1-db01f3870a0f None admin] PATH_INFO: `/v3/projects/94ccbb3812134d72b2906f283b38b9b0` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:56.676154 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d239d7-a6fe-4903-bee1-db01f3870a0f None admin] RBAC: Authorizing `identity:get_project(project_id=94ccbb3812134d72b2906f283b38b9b0)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:56.677862 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d239d7-a6fe-4903-bee1-db01f3870a0f None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:56.679840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 547/1102] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:16:56 2022] GET /identity/v3/projects/94ccbb3812134d72b2906f283b38b9b0 => generated 311 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:56.688709 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d239d7-a6fe-4903-bee1-db01f3870a0f None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:56.703301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11533957-8383-43ef-8785-dff23cb66d26 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:56.740267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:56.751659 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8cb6e-4046-4157-8608-778d1f1bf97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:56.752712 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8cb6e-4046-4157-8608-778d1f1bf97c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:56.753023 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8cb6e-4046-4157-8608-778d1f1bf97c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:56.753389 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8cb6e-4046-4157-8608-778d1f1bf97c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:56.765194 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8cb6e-4046-4157-8608-778d1f1bf97c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:56.767452 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8cb6e-4046-4157-8608-778d1f1bf97c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:56.783020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-ccf8cb6e-4046-4157-8608-778d1f1bf97c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:16:56.783020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:16:56.783020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:16:56.783020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:16:56.783020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:16:56.783020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:16:56.783020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:16:56.783020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:16:56.783020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:16:56.783020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:16:56.783020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:16:56.783020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:16:56.783020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:16:56.783020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:16:56.783020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:16:56.784178 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:16:56.784178 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:16:56.784178 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:16:56.784178 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:16:56.784178 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:16:56.784178 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:16:56.784178 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:16:56.784178 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:16:56.784178 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:16:56.784178 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:16:56.784178 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:16:56.784178 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:16:56.784178 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:16:56.784178 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:16:56.784178 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:16:56.784178 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:16:56.784178 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:16:56.785099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:16:56.785099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:16:56.785099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:16:56.785099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:16:56.785099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:16:56.785099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:16:56.785099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:16:56.785099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:16:56.785099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 556/1103] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:16:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:16:56.794901 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8cb6e-4046-4157-8608-778d1f1bf97c None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:56.814748 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d239d7-a6fe-4903-bee1-db01f3870a0f None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:56.859255 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:56.868683 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5d5fe-fc45-4fcb-a992-1f79889dd5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:56.869713 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5d5fe-fc45-4fcb-a992-1f79889dd5cd None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:56.870192 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5d5fe-fc45-4fcb-a992-1f79889dd5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:56.871064 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5d5fe-fc45-4fcb-a992-1f79889dd5cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:56.872090 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5d5fe-fc45-4fcb-a992-1f79889dd5cd None admin] RBAC: Adding query filter params (role.id=a16b6daeda5b4a67992f3c12514ca90e, scope.project.id=94ccbb3812134d72b2906f283b38b9b0, user.id=95d43ba60a334750adf35b3c8c306b9e) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:56.872619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5d5fe-fc45-4fcb-a992-1f79889dd5cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:56.875388 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5d5fe-fc45-4fcb-a992-1f79889dd5cd None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:56.886420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 548/1104] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:16:56 2022] GET /identity/v3/role_assignments?user.id=95d43ba60a334750adf35b3c8c306b9e&scope.project.id=94ccbb3812134d72b2906f283b38b9b0&role.id=a16b6daeda5b4a67992f3c12514ca90e => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:56.934596 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8cb6e-4046-4157-8608-778d1f1bf97c None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:56.984626 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33445706-051f-4e03-be8a-8fbfe1d7ec00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:56.985255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33445706-051f-4e03-be8a-8fbfe1d7ec00 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:56.985549 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33445706-051f-4e03-be8a-8fbfe1d7ec00 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:56.985790 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33445706-051f-4e03-be8a-8fbfe1d7ec00 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:56.986494 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33445706-051f-4e03-be8a-8fbfe1d7ec00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:56.986790 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33445706-051f-4e03-be8a-8fbfe1d7ec00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:56.988291 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33445706-051f-4e03-be8a-8fbfe1d7ec00 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:57.004443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 557/1105] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:16:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:57.012617 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5d5fe-fc45-4fcb-a992-1f79889dd5cd None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:57.145131 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5d5fe-fc45-4fcb-a992-1f79889dd5cd None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:16:57.186521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ce377-dc72-4661-9623-57059f25fc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:16:57.187216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ce377-dc72-4661-9623-57059f25fc7d None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:57.187524 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ce377-dc72-4661-9623-57059f25fc7d None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:57.187877 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ce377-dc72-4661-9623-57059f25fc7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:57.188910 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ce377-dc72-4661-9623-57059f25fc7d None admin] RBAC: Adding query filter params (role.id=d07f12353933422cbbf32385916d2bfa, scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba, user.id=151e7b9c7a7b46d58dc2f563d05775e2) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:16:57.189265 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ce377-dc72-4661-9623-57059f25fc7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:16:57.190757 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ce377-dc72-4661-9623-57059f25fc7d None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:16:57.197781 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 549/1106] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:16:57 2022] GET /identity/v3/role_assignments?user.id=151e7b9c7a7b46d58dc2f563d05775e2&scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba&role.id=d07f12353933422cbbf32385916d2bfa => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:16:59.406765 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf512b4-1ef9-44e3-864e-2c4736c72d24 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:59.407391 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf512b4-1ef9-44e3-864e-2c4736c72d24 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:59.407391 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf512b4-1ef9-44e3-864e-2c4736c72d24 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:59.408844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 558/1107] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:16:59.415223 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6814f-21b2-4db6-8cf6-df2e889d262c None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:16:59.415826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6814f-21b2-4db6-8cf6-df2e889d262c None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:16:59.416066 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6814f-21b2-4db6-8cf6-df2e889d262c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:16:59.439010 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-c8c6814f-21b2-4db6-8cf6-df2e889d262c None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:16:59.440299 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-c8c6814f-21b2-4db6-8cf6-df2e889d262c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:16:59.531738 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:59.556591 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 550/1108] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:16:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:16:59.844314 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf512b4-1ef9-44e3-864e-2c4736c72d24 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:16:59.912507 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:16:59.970819 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf512b4-1ef9-44e3-864e-2c4736c72d24 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:00.011169 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcdbaf-fa1e-4a4f-bfcc-3359671955da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:00.013127 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcdbaf-fa1e-4a4f-bfcc-3359671955da None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:00.013506 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcdbaf-fa1e-4a4f-bfcc-3359671955da None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:00.013778 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcdbaf-fa1e-4a4f-bfcc-3359671955da None admin] PATH_INFO: `/v3/domains/default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:00.015059 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bcdbaf-fa1e-4a4f-bfcc-3359671955da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:00.016604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bcdbaf-fa1e-4a4f-bfcc-3359671955da None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:00.018333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 559/1109] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:16:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:17:00.027840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6814f-21b2-4db6-8cf6-df2e889d262c None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:00.142678 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6814f-21b2-4db6-8cf6-df2e889d262c None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:00.182227 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249a69f-40a2-44c0-9750-52105f4b7480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:00.182851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249a69f-40a2-44c0-9750-52105f4b7480 None admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:00.183189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249a69f-40a2-44c0-9750-52105f4b7480 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:00.184063 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249a69f-40a2-44c0-9750-52105f4b7480 None admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:00.184904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249a69f-40a2-44c0-9750-52105f4b7480 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:00.186416 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249a69f-40a2-44c0-9750-52105f4b7480 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:00.211802 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 551/1110] 10.222.0.62 () {60 vars in 1132 bytes} [Tue Oct 4 14:17:00 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:17:02.656023 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98beb3c3-ef33-4506-a679-a10455900138 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:02.656880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98beb3c3-ef33-4506-a679-a10455900138 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:02.656880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98beb3c3-ef33-4506-a679-a10455900138 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:02.657908 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 560/1111] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:17:02.664241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2ec64-a056-42a6-8ee2-478c89f4f797 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:02.664993 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2ec64-a056-42a6-8ee2-478c89f4f797 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:02.664993 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2ec64-a056-42a6-8ee2-478c89f4f797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:02.688288 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-e3a2ec64-a056-42a6-8ee2-478c89f4f797 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:17:02.689530 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e3a2ec64-a056-42a6-8ee2-478c89f4f797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:17:02.742881 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:02.779540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 552/1112] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:17:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:17:03.069622 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98beb3c3-ef33-4506-a679-a10455900138 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:03.186592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98beb3c3-ef33-4506-a679-a10455900138 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:03.212345 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:03.230313 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbedc6-a57f-4d20-a46c-cea8daa5ddb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:03.231243 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbedc6-a57f-4d20-a46c-cea8daa5ddb1 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:03.231575 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbedc6-a57f-4d20-a46c-cea8daa5ddb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:03.231973 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbedc6-a57f-4d20-a46c-cea8daa5ddb1 None admin] PATH_INFO: `/v3/roles/c3d8f302f6714108ac91c25b8a32d36b` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:03.233685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbedc6-a57f-4d20-a46c-cea8daa5ddb1 None admin] RBAC: Authorizing `identity:get_role(role_id=c3d8f302f6714108ac91c25b8a32d36b)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:03.235155 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbedc6-a57f-4d20-a46c-cea8daa5ddb1 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:03.236667 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 561/1113] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:17:03 2022] GET /identity/v3/roles/c3d8f302f6714108ac91c25b8a32d36b => generated 223 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:03.242883 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2ec64-a056-42a6-8ee2-478c89f4f797 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:03.357506 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2ec64-a056-42a6-8ee2-478c89f4f797 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:03.398834 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4424c7-459c-47a2-b3f4-3a004fa27804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:03.399488 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4424c7-459c-47a2-b3f4-3a004fa27804 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:03.399801 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4424c7-459c-47a2-b3f4-3a004fa27804 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:03.400078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4424c7-459c-47a2-b3f4-3a004fa27804 None admin] PATH_INFO: `/v3/users/a5762848fc394c9c9626b911e3353b9d` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:03.418234 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4424c7-459c-47a2-b3f4-3a004fa27804 None admin] RBAC: Authorizing `identity:get_user(user_id=a5762848fc394c9c9626b911e3353b9d)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:03.419945 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4424c7-459c-47a2-b3f4-3a004fa27804 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:03.421764 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 553/1114] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:17:03 2022] GET /identity/v3/users/a5762848fc394c9c9626b911e3353b9d => generated 286 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:03.428372 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbedc6-a57f-4d20-a46c-cea8daa5ddb1 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:03.548895 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbedc6-a57f-4d20-a46c-cea8daa5ddb1 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:03.599462 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fb034-4e47-43f8-9581-d470f33f51f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:03.600132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fb034-4e47-43f8-9581-d470f33f51f1 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:03.601569 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fb034-4e47-43f8-9581-d470f33f51f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:03.601890 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fb034-4e47-43f8-9581-d470f33f51f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:03.689096 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:03.704677 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318fb034-4e47-43f8-9581-d470f33f51f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:03.706237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318fb034-4e47-43f8-9581-d470f33f51f1 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:03.862726 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 562/1115] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:17:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 14:17:03.870280 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4424c7-459c-47a2-b3f4-3a004fa27804 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:03.920459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:04.015571 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4424c7-459c-47a2-b3f4-3a004fa27804 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:04.065565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cd335-5de5-4501-9f52-74ba5567c38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:04.066271 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cd335-5de5-4501-9f52-74ba5567c38a None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:04.066594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cd335-5de5-4501-9f52-74ba5567c38a None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:04.066912 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cd335-5de5-4501-9f52-74ba5567c38a None admin] PATH_INFO: `/v3/projects/94ccbb3812134d72b2906f283b38b9b0` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:04.068257 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cd335-5de5-4501-9f52-74ba5567c38a None admin] RBAC: Authorizing `identity:get_project(project_id=94ccbb3812134d72b2906f283b38b9b0)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:04.070010 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cd335-5de5-4501-9f52-74ba5567c38a None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:04.072734 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 554/1116] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:17:03 2022] GET /identity/v3/projects/94ccbb3812134d72b2906f283b38b9b0 => generated 311 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:04.080173 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fb034-4e47-43f8-9581-d470f33f51f1 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:04.200934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:04.219289 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fb034-4e47-43f8-9581-d470f33f51f1 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:04.266781 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62598a7c-87e3-449c-b428-4c81880201b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:04.267433 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62598a7c-87e3-449c-b428-4c81880201b9 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:04.267800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62598a7c-87e3-449c-b428-4c81880201b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:04.268138 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62598a7c-87e3-449c-b428-4c81880201b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:04.268987 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62598a7c-87e3-449c-b428-4c81880201b9 None admin] RBAC: Adding query filter params (role.id=c3d8f302f6714108ac91c25b8a32d36b, scope.project.id=94ccbb3812134d72b2906f283b38b9b0, user.id=a5762848fc394c9c9626b911e3353b9d) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:17:04.269317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62598a7c-87e3-449c-b428-4c81880201b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:04.270997 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62598a7c-87e3-449c-b428-4c81880201b9 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:04.278296 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 563/1117] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:17:04 2022] GET /identity/v3/role_assignments?user.id=a5762848fc394c9c9626b911e3353b9d&scope.project.id=94ccbb3812134d72b2906f283b38b9b0&role.id=c3d8f302f6714108ac91c25b8a32d36b => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:06.830515 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5be79-c58b-49f3-9ff3-284b9cf91ee5 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:06.831050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5be79-c58b-49f3-9ff3-284b9cf91ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:06.831050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5be79-c58b-49f3-9ff3-284b9cf91ee5 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:06.832392 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 555/1118] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:17:06.838352 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929dc97-b36d-43a1-9095-b623a43df354 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:06.838914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929dc97-b36d-43a1-9095-b623a43df354 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:06.838914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929dc97-b36d-43a1-9095-b623a43df354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:06.861309 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-d929dc97-b36d-43a1-9095-b623a43df354 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:17:06.862523 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d929dc97-b36d-43a1-9095-b623a43df354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:17:06.942657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 564/1119] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:17:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:17:07.222156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5be79-c58b-49f3-9ff3-284b9cf91ee5 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:07.335703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:07.341442 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5be79-c58b-49f3-9ff3-284b9cf91ee5 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:07.398795 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02edcb7-c56d-41ad-bbde-c00ccff1413a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:07.399434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02edcb7-c56d-41ad-bbde-c00ccff1413a None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:07.399740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02edcb7-c56d-41ad-bbde-c00ccff1413a None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:07.400005 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02edcb7-c56d-41ad-bbde-c00ccff1413a None admin] PATH_INFO: `/v3/roles/c3d8f302f6714108ac91c25b8a32d36b` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:07.401419 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02edcb7-c56d-41ad-bbde-c00ccff1413a None admin] RBAC: Authorizing `identity:get_role(role_id=c3d8f302f6714108ac91c25b8a32d36b)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:07.403678 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02edcb7-c56d-41ad-bbde-c00ccff1413a None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:07.405080 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 556/1120] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:17:07 2022] GET /identity/v3/roles/c3d8f302f6714108ac91c25b8a32d36b => generated 223 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:17:07.411464 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929dc97-b36d-43a1-9095-b623a43df354 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:07.509322 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:07.536755 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929dc97-b36d-43a1-9095-b623a43df354 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:07.578158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09937c5-99c9-4d76-89df-5233d5c58267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:07.578808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09937c5-99c9-4d76-89df-5233d5c58267 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:07.579080 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09937c5-99c9-4d76-89df-5233d5c58267 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:07.579342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09937c5-99c9-4d76-89df-5233d5c58267 None admin] PATH_INFO: `/v3/users/a5762848fc394c9c9626b911e3353b9d` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:07.580545 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09937c5-99c9-4d76-89df-5233d5c58267 None admin] RBAC: Authorizing `identity:get_user(user_id=a5762848fc394c9c9626b911e3353b9d)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:07.582374 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09937c5-99c9-4d76-89df-5233d5c58267 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:07.584187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 565/1121] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:17:07 2022] GET /identity/v3/users/a5762848fc394c9c9626b911e3353b9d => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:17:07.591958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02edcb7-c56d-41ad-bbde-c00ccff1413a None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:07.706544 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02edcb7-c56d-41ad-bbde-c00ccff1413a None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:07.744032 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8634c-1985-4321-94db-df0dc01bb974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:07.744815 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8634c-1985-4321-94db-df0dc01bb974 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:07.745173 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8634c-1985-4321-94db-df0dc01bb974 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:07.745548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8634c-1985-4321-94db-df0dc01bb974 None admin] PATH_INFO: `/v3/projects/94ccbb3812134d72b2906f283b38b9b0` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:07.746863 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8634c-1985-4321-94db-df0dc01bb974 None admin] RBAC: Authorizing `identity:get_project(project_id=94ccbb3812134d72b2906f283b38b9b0)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:07.748457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8634c-1985-4321-94db-df0dc01bb974 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:07.750254 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 557/1122] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:17:07 2022] GET /identity/v3/projects/94ccbb3812134d72b2906f283b38b9b0 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:07.756812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09937c5-99c9-4d76-89df-5233d5c58267 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:07.875305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09937c5-99c9-4d76-89df-5233d5c58267 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:07.916055 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c29da-c3e2-4959-81d9-25e91fb46d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:07.916796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c29da-c3e2-4959-81d9-25e91fb46d73 None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:07.917160 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c29da-c3e2-4959-81d9-25e91fb46d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:07.917419 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c29da-c3e2-4959-81d9-25e91fb46d73 None admin] PATH_INFO: `/v3/projects/94ccbb3812134d72b2906f283b38b9b0/users/a5762848fc394c9c9626b911e3353b9d/roles/c3d8f302f6714108ac91c25b8a32d36b` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:07.920645 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c29da-c3e2-4959-81d9-25e91fb46d73 None admin] RBAC: Authorizing `identity:create_grant(project_id=94ccbb3812134d72b2906f283b38b9b0, user_id=a5762848fc394c9c9626b911e3353b9d, role_id=c3d8f302f6714108ac91c25b8a32d36b)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:07.922219 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c29da-c3e2-4959-81d9-25e91fb46d73 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:07.940779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 566/1123] 10.222.0.62 () {58 vars in 1439 bytes} [Tue Oct 4 14:17:07 2022] PUT /identity/v3/projects/94ccbb3812134d72b2906f283b38b9b0/users/a5762848fc394c9c9626b911e3353b9d/roles/c3d8f302f6714108ac91c25b8a32d36b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:17:10.293799 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c638a3-e154-47a3-8abf-3762090e1d12 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:10.294387 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c638a3-e154-47a3-8abf-3762090e1d12 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:10.294387 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c638a3-e154-47a3-8abf-3762090e1d12 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:10.295677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 558/1124] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:17:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:17:10.301590 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0a198-acf6-4b20-9b61-6f601a2e4ed1 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:10.302208 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0a198-acf6-4b20-9b61-6f601a2e4ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:10.302208 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0a198-acf6-4b20-9b61-6f601a2e4ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:10.321502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-2bc0a198-acf6-4b20-9b61-6f601a2e4ed1 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:17:10.322723 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2bc0a198-acf6-4b20-9b61-6f601a2e4ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:17:10.326528 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:10.407465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 567/1125] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:17:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:17:10.689855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c638a3-e154-47a3-8abf-3762090e1d12 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:10.732189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:10.818709 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c638a3-e154-47a3-8abf-3762090e1d12 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:10.858305 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49ec53-a212-41a1-838f-9a24d4266d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:10.859005 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49ec53-a212-41a1-838f-9a24d4266d58 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:10.859340 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49ec53-a212-41a1-838f-9a24d4266d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:10.859654 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49ec53-a212-41a1-838f-9a24d4266d58 None admin] PATH_INFO: `/v3/roles/c3d8f302f6714108ac91c25b8a32d36b` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:10.861459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49ec53-a212-41a1-838f-9a24d4266d58 None admin] RBAC: Authorizing `identity:get_role(role_id=c3d8f302f6714108ac91c25b8a32d36b)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:10.862922 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49ec53-a212-41a1-838f-9a24d4266d58 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:10.864493 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 559/1126] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:17:10 2022] GET /identity/v3/roles/c3d8f302f6714108ac91c25b8a32d36b => generated 223 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:10.871775 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0a198-acf6-4b20-9b61-6f601a2e4ed1 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:10.991086 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0a198-acf6-4b20-9b61-6f601a2e4ed1 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:11.035560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d043948-e7b5-4aba-a9ed-f39ac48ef5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:11.036648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d043948-e7b5-4aba-a9ed-f39ac48ef5a9 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:11.037060 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d043948-e7b5-4aba-a9ed-f39ac48ef5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:11.037486 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d043948-e7b5-4aba-a9ed-f39ac48ef5a9 None admin] PATH_INFO: `/v3/users/a5762848fc394c9c9626b911e3353b9d` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:11.039484 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d043948-e7b5-4aba-a9ed-f39ac48ef5a9 None admin] RBAC: Authorizing `identity:get_user(user_id=a5762848fc394c9c9626b911e3353b9d)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:11.041862 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d043948-e7b5-4aba-a9ed-f39ac48ef5a9 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:11.045158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 568/1127] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:17:10 2022] GET /identity/v3/users/a5762848fc394c9c9626b911e3353b9d => generated 286 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:17:11.055104 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49ec53-a212-41a1-838f-9a24d4266d58 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:11.242408 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49ec53-a212-41a1-838f-9a24d4266d58 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:11.247938 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:11.310940 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4a7f6-47bf-4b60-adf0-42d195d7b7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:11.312021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4a7f6-47bf-4b60-adf0-42d195d7b7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:11.312505 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4a7f6-47bf-4b60-adf0-42d195d7b7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:11.313238 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4a7f6-47bf-4b60-adf0-42d195d7b7e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:11.415372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4a7f6-47bf-4b60-adf0-42d195d7b7e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:11.417570 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4a7f6-47bf-4b60-adf0-42d195d7b7e2 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:11.545103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 560/1128] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:17:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 14:17:11.552671 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d043948-e7b5-4aba-a9ed-f39ac48ef5a9 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:11.566281 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:11.671191 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d043948-e7b5-4aba-a9ed-f39ac48ef5a9 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:11.709378 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aacbf9-9db4-4cfb-ba3b-9348ef89af4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:11.710028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aacbf9-9db4-4cfb-ba3b-9348ef89af4f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:11.710306 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aacbf9-9db4-4cfb-ba3b-9348ef89af4f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:11.710574 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aacbf9-9db4-4cfb-ba3b-9348ef89af4f None admin] PATH_INFO: `/v3/projects/94ccbb3812134d72b2906f283b38b9b0` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:11.711819 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aacbf9-9db4-4cfb-ba3b-9348ef89af4f None admin] RBAC: Authorizing `identity:get_project(project_id=94ccbb3812134d72b2906f283b38b9b0)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:11.713276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aacbf9-9db4-4cfb-ba3b-9348ef89af4f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:11.716076 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 569/1129] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:17:11 2022] GET /identity/v3/projects/94ccbb3812134d72b2906f283b38b9b0 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:11.722772 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4a7f6-47bf-4b60-adf0-42d195d7b7e2 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:11.726053 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:11.842376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4a7f6-47bf-4b60-adf0-42d195d7b7e2 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:11.883406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01876631-9342-4abd-8636-1d1dd7751431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:11.884123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01876631-9342-4abd-8636-1d1dd7751431 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:11.884436 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01876631-9342-4abd-8636-1d1dd7751431 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:11.884727 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01876631-9342-4abd-8636-1d1dd7751431 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:11.885510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01876631-9342-4abd-8636-1d1dd7751431 None admin] RBAC: Adding query filter params (role.id=c3d8f302f6714108ac91c25b8a32d36b, scope.project.id=94ccbb3812134d72b2906f283b38b9b0, user.id=a5762848fc394c9c9626b911e3353b9d) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:17:11.886584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01876631-9342-4abd-8636-1d1dd7751431 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:11.888490 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01876631-9342-4abd-8636-1d1dd7751431 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:11.895638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 561/1130] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:17:11 2022] GET /identity/v3/role_assignments?user.id=a5762848fc394c9c9626b911e3353b9d&scope.project.id=94ccbb3812134d72b2906f283b38b9b0&role.id=c3d8f302f6714108ac91c25b8a32d36b => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:17:14.249283 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efbc62-33a3-46de-b528-1a6a8994969a None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:14.249911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efbc62-33a3-46de-b528-1a6a8994969a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:14.249911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efbc62-33a3-46de-b528-1a6a8994969a None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:14.251179 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 570/1131] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:17:14.257147 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b1961-2d0c-4fc0-b579-05acf368e176 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:14.257725 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b1961-2d0c-4fc0-b579-05acf368e176 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:14.257725 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b1961-2d0c-4fc0-b579-05acf368e176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:14.279128 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-134b1961-2d0c-4fc0-b579-05acf368e176 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:17:14.280391 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-134b1961-2d0c-4fc0-b579-05acf368e176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:17:14.351419 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:14.358901 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 562/1132] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:17:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:17:14.680675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efbc62-33a3-46de-b528-1a6a8994969a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:14.774443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:14.802892 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efbc62-33a3-46de-b528-1a6a8994969a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:14.845744 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f92c0-0559-49a4-a072-0432a95df378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:14.846613 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f92c0-0559-49a4-a072-0432a95df378 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:14.847028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f92c0-0559-49a4-a072-0432a95df378 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:14.847432 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f92c0-0559-49a4-a072-0432a95df378 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:14.849261 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f92c0-0559-49a4-a072-0432a95df378 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:14.851564 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f92c0-0559-49a4-a072-0432a95df378 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:14.854172 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 571/1133] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:17:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:17:14.864595 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b1961-2d0c-4fc0-b579-05acf368e176 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:15.006841 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b1961-2d0c-4fc0-b579-05acf368e176 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:15.047822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e21a2f-8f8e-4d65-8125-7f42e0a21251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:15.048449 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e21a2f-8f8e-4d65-8125-7f42e0a21251 None admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:15.048727 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e21a2f-8f8e-4d65-8125-7f42e0a21251 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:15.048996 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e21a2f-8f8e-4d65-8125-7f42e0a21251 None admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:15.049654 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e21a2f-8f8e-4d65-8125-7f42e0a21251 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:15.051112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e21a2f-8f8e-4d65-8125-7f42e0a21251 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:15.082875 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 563/1134] 10.222.0.62 () {60 vars in 1141 bytes} [Tue Oct 4 14:17:14 2022] POST /identity/v3/projects => generated 311 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:17:17.481122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652207c2-dd14-489c-8aee-6fd12d7d5330 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:17.481694 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652207c2-dd14-489c-8aee-6fd12d7d5330 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:17.481694 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652207c2-dd14-489c-8aee-6fd12d7d5330 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:17.483145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 572/1135] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:17:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:17:17.489764 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96813fc8-4735-4d02-8ced-07e1dab39091 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:17.490356 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96813fc8-4735-4d02-8ced-07e1dab39091 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:17.490356 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96813fc8-4735-4d02-8ced-07e1dab39091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:17.511056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-96813fc8-4735-4d02-8ced-07e1dab39091 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:17:17.512516 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-96813fc8-4735-4d02-8ced-07e1dab39091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:17:17.567621 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:17.593208 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 564/1136] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:17:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 14:17:17.872173 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652207c2-dd14-489c-8aee-6fd12d7d5330 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:17.995239 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652207c2-dd14-489c-8aee-6fd12d7d5330 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:18.036154 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120cedb-c630-42ae-963d-68919ff22369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:18.036806 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120cedb-c630-42ae-963d-68919ff22369 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:18.037083 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120cedb-c630-42ae-963d-68919ff22369 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:18.037355 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120cedb-c630-42ae-963d-68919ff22369 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:18.038540 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120cedb-c630-42ae-963d-68919ff22369 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:18.040027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120cedb-c630-42ae-963d-68919ff22369 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:18.041659 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 573/1137] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:17:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:18.048143 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96813fc8-4735-4d02-8ced-07e1dab39091 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:18.163072 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96813fc8-4735-4d02-8ced-07e1dab39091 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:18.200141 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149943ad-277d-45bd-abac-c88ab8ab84ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:18.200762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149943ad-277d-45bd-abac-c88ab8ab84ab None admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:18.201042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149943ad-277d-45bd-abac-c88ab8ab84ab None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:18.201310 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149943ad-277d-45bd-abac-c88ab8ab84ab None admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:18.201986 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149943ad-277d-45bd-abac-c88ab8ab84ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:18.203450 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149943ad-277d-45bd-abac-c88ab8ab84ab None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:18.228461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 565/1138] 10.222.0.62 () {60 vars in 1132 bytes} [Tue Oct 4 14:17:18 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:17:20.656097 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1926228-ab13-441b-a248-27048ed6585a None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:20.656952 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1926228-ab13-441b-a248-27048ed6585a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:20.656952 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1926228-ab13-441b-a248-27048ed6585a None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:20.658594 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 574/1139] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:17:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:17:20.667483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec97a8-54dd-4767-90a2-cf93d94529d2 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:20.668893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec97a8-54dd-4767-90a2-cf93d94529d2 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:20.669374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec97a8-54dd-4767-90a2-cf93d94529d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:20.701060 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-4cec97a8-54dd-4767-90a2-cf93d94529d2 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:17:20.703140 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-4cec97a8-54dd-4767-90a2-cf93d94529d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:17:20.757309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:20.828906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 566/1140] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:17:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:17:21.126462 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1926228-ab13-441b-a248-27048ed6585a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:21.143643 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:21.251839 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1926228-ab13-441b-a248-27048ed6585a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:21.292845 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63f003-b36e-40f8-8ef5-eb3dacf8cda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:21.293489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63f003-b36e-40f8-8ef5-eb3dacf8cda2 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:21.293762 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63f003-b36e-40f8-8ef5-eb3dacf8cda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:21.294026 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63f003-b36e-40f8-8ef5-eb3dacf8cda2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:21.305312 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba63f003-b36e-40f8-8ef5-eb3dacf8cda2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:17:21.310820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-ba63f003-b36e-40f8-8ef5-eb3dacf8cda2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:17:21.310820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:17:21.310820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:17:21.310820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:17:21.310820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:17:21.310820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:17:21.310820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:17:21.310820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:17:21.310820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:17:21.310820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:17:21.310820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:17:21.310820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:17:21.310820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:17:21.310820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:17:21.310820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:17:21.310820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:17:21.312695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:17:21.312695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:17:21.312695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:17:21.312695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:17:21.312695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:17:21.312695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:17:21.312695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:17:21.312695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:17:21.312695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:17:21.312695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:17:21.312695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:17:21.312695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:17:21.312695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:17:21.312695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:17:21.312695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:17:21.312695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:17:21.314624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:17:21.314624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:17:21.314624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:17:21.314624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:17:21.314624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:17:21.314624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:17:21.314624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:17:21.314624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:17:21.314624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:17:21.314624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:17:21.314624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:17:21.314624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:17:21.314624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 575/1141] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:17:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:17:21.323381 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec97a8-54dd-4767-90a2-cf93d94529d2 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:21.477850 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec97a8-54dd-4767-90a2-cf93d94529d2 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:21.519289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aa70c-0d22-4cf2-99d1-3eb3af97cc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:21.520051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aa70c-0d22-4cf2-99d1-3eb3af97cc59 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:21.520384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aa70c-0d22-4cf2-99d1-3eb3af97cc59 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:21.520779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aa70c-0d22-4cf2-99d1-3eb3af97cc59 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:21.521645 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776aa70c-0d22-4cf2-99d1-3eb3af97cc59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:17:21.521999 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776aa70c-0d22-4cf2-99d1-3eb3af97cc59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:21.523505 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776aa70c-0d22-4cf2-99d1-3eb3af97cc59 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:21.535034 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 567/1142] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:17:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:21.542772 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63f003-b36e-40f8-8ef5-eb3dacf8cda2 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:21.633883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:21.672112 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63f003-b36e-40f8-8ef5-eb3dacf8cda2 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:21.715449 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27186f39-9d3e-468c-84c4-c7250ecb5bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:21.716157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27186f39-9d3e-468c-84c4-c7250ecb5bdf None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:21.716520 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27186f39-9d3e-468c-84c4-c7250ecb5bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:21.716801 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27186f39-9d3e-468c-84c4-c7250ecb5bdf None admin] PATH_INFO: `/v3/users/0ffc9b862b91446a917b16e73401bcae` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:21.734557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27186f39-9d3e-468c-84c4-c7250ecb5bdf None admin] RBAC: Authorizing `identity:get_user(user_id=0ffc9b862b91446a917b16e73401bcae)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:21.736009 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27186f39-9d3e-468c-84c4-c7250ecb5bdf None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:21.737819 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 576/1143] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:17:21 2022] GET /identity/v3/users/0ffc9b862b91446a917b16e73401bcae => generated 286 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:17:21.745093 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aa70c-0d22-4cf2-99d1-3eb3af97cc59 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:21.779316 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:21.864971 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aa70c-0d22-4cf2-99d1-3eb3af97cc59 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:21.904689 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950e7a5-e2e0-42be-85be-c8ec9adaccbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:21.905297 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950e7a5-e2e0-42be-85be-c8ec9adaccbc None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:21.905576 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950e7a5-e2e0-42be-85be-c8ec9adaccbc None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:21.905848 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950e7a5-e2e0-42be-85be-c8ec9adaccbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:21.989870 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950e7a5-e2e0-42be-85be-c8ec9adaccbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:21.991265 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950e7a5-e2e0-42be-85be-c8ec9adaccbc None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:22.025027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:22.109133 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 568/1144] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:17:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 14:17:22.115595 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27186f39-9d3e-468c-84c4-c7250ecb5bdf None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:22.235771 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27186f39-9d3e-468c-84c4-c7250ecb5bdf None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:22.273641 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:22.280856 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf671c-2eab-4065-966c-83118bbc834b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:22.281567 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf671c-2eab-4065-966c-83118bbc834b None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:22.281886 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf671c-2eab-4065-966c-83118bbc834b None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:22.282198 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf671c-2eab-4065-966c-83118bbc834b None admin] PATH_INFO: `/v3/projects/33fa53fa81554846851b5624e6c568b8` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:22.283452 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf671c-2eab-4065-966c-83118bbc834b None admin] RBAC: Authorizing `identity:get_project(project_id=33fa53fa81554846851b5624e6c568b8)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:22.285015 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf671c-2eab-4065-966c-83118bbc834b None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:22.286782 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 577/1145] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:17:22 2022] GET /identity/v3/projects/33fa53fa81554846851b5624e6c568b8 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:17:22.294350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950e7a5-e2e0-42be-85be-c8ec9adaccbc None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:22.459330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950e7a5-e2e0-42be-85be-c8ec9adaccbc None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:22.492976 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:22.502250 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774a442-499d-47fb-9602-8fc40fd5d603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:22.502996 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774a442-499d-47fb-9602-8fc40fd5d603 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:22.503322 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774a442-499d-47fb-9602-8fc40fd5d603 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:22.503637 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774a442-499d-47fb-9602-8fc40fd5d603 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:22.504487 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774a442-499d-47fb-9602-8fc40fd5d603 None admin] RBAC: Adding query filter params (role.id=a16b6daeda5b4a67992f3c12514ca90e, scope.project.id=33fa53fa81554846851b5624e6c568b8, user.id=0ffc9b862b91446a917b16e73401bcae) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:17:22.504841 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774a442-499d-47fb-9602-8fc40fd5d603 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:22.506334 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774a442-499d-47fb-9602-8fc40fd5d603 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:22.512817 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 569/1146] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:17:22 2022] GET /identity/v3/role_assignments?user.id=0ffc9b862b91446a917b16e73401bcae&scope.project.id=33fa53fa81554846851b5624e6c568b8&role.id=a16b6daeda5b4a67992f3c12514ca90e => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:24.827788 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4339c8-5b39-4710-9023-7c6c3a51d26a None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:24.828409 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4339c8-5b39-4710-9023-7c6c3a51d26a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:24.828409 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4339c8-5b39-4710-9023-7c6c3a51d26a None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:24.829571 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 578/1147] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:17:24.835530 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7b9b9-a398-4e29-8f4f-47f68bbf69f7 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:24.836091 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7b9b9-a398-4e29-8f4f-47f68bbf69f7 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:24.836499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7b9b9-a398-4e29-8f4f-47f68bbf69f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:24.860315 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-90d7b9b9-a398-4e29-8f4f-47f68bbf69f7 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:17:24.861952 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-90d7b9b9-a398-4e29-8f4f-47f68bbf69f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:17:24.939610 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 570/1148] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:17:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:17:25.365892 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4339c8-5b39-4710-9023-7c6c3a51d26a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:25.473885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4339c8-5b39-4710-9023-7c6c3a51d26a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:25.511138 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81f688-72af-43b0-bb59-aa815b11d0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:25.511804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81f688-72af-43b0-bb59-aa815b11d0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:25.512076 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81f688-72af-43b0-bb59-aa815b11d0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:25.512338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81f688-72af-43b0-bb59-aa815b11d0b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:25.523818 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81f688-72af-43b0-bb59-aa815b11d0b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:17:25.529342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-fa81f688-72af-43b0-bb59-aa815b11d0b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:17:25.529342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:17:25.529342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:17:25.529342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:17:25.529342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:17:25.529342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:17:25.529342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:17:25.529342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:17:25.529342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:17:25.529342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:17:25.529342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:17:25.529342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:17:25.529342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:17:25.529342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:17:25.529342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:17:25.529342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:17:25.530565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:17:25.530565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:17:25.530565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:17:25.530565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:17:25.530565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:17:25.530565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:17:25.530565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:17:25.530565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:17:25.530565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:17:25.530565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:17:25.530565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:17:25.530565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:17:25.530565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:17:25.530565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:17:25.530565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:17:25.530565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:17:25.531609 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:17:25.531609 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:17:25.531609 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:17:25.531609 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:17:25.531609 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:17:25.531609 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:17:25.531609 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:17:25.531609 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:17:25.531609 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:17:25.531609 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:17:25.531609 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:17:25.531609 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:17:25.531609 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 579/1149] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:17:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:17:25.537252 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7b9b9-a398-4e29-8f4f-47f68bbf69f7 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:25.647780 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7b9b9-a398-4e29-8f4f-47f68bbf69f7 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:25.673730 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:25.686981 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd439cd-ae0f-489e-ad48-ab3b29270390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:25.687600 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd439cd-ae0f-489e-ad48-ab3b29270390 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:25.688169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd439cd-ae0f-489e-ad48-ab3b29270390 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:25.688436 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd439cd-ae0f-489e-ad48-ab3b29270390 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:25.689105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd439cd-ae0f-489e-ad48-ab3b29270390 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:17:25.689402 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd439cd-ae0f-489e-ad48-ab3b29270390 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:25.690784 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd439cd-ae0f-489e-ad48-ab3b29270390 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:25.700586 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 571/1150] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:17:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:25.707469 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81f688-72af-43b0-bb59-aa815b11d0b0 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:25.780194 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:25.829135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81f688-72af-43b0-bb59-aa815b11d0b0 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:25.867994 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba494983-6b7e-477b-b3a7-4ba5b8e4e430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:25.868771 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba494983-6b7e-477b-b3a7-4ba5b8e4e430 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:25.869122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba494983-6b7e-477b-b3a7-4ba5b8e4e430 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:25.869399 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba494983-6b7e-477b-b3a7-4ba5b8e4e430 None admin] PATH_INFO: `/v3/users/0ffc9b862b91446a917b16e73401bcae` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:25.871404 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba494983-6b7e-477b-b3a7-4ba5b8e4e430 None admin] RBAC: Authorizing `identity:get_user(user_id=0ffc9b862b91446a917b16e73401bcae)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:25.872978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba494983-6b7e-477b-b3a7-4ba5b8e4e430 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:25.874651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 580/1151] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:17:25 2022] GET /identity/v3/users/0ffc9b862b91446a917b16e73401bcae => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:25.883748 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd439cd-ae0f-489e-ad48-ab3b29270390 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:26.002439 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd439cd-ae0f-489e-ad48-ab3b29270390 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:26.043123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e9bce-1831-4058-a7a3-b6397eba24bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:26.043806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e9bce-1831-4058-a7a3-b6397eba24bd None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:26.044107 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e9bce-1831-4058-a7a3-b6397eba24bd None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:26.044398 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e9bce-1831-4058-a7a3-b6397eba24bd None admin] PATH_INFO: `/v3/projects/33fa53fa81554846851b5624e6c568b8` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:26.045799 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e9bce-1831-4058-a7a3-b6397eba24bd None admin] RBAC: Authorizing `identity:get_project(project_id=33fa53fa81554846851b5624e6c568b8)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:26.049330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e9bce-1831-4058-a7a3-b6397eba24bd None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:26.049330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 572/1152] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:17:25 2022] GET /identity/v3/projects/33fa53fa81554846851b5624e6c568b8 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:26.055617 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba494983-6b7e-477b-b3a7-4ba5b8e4e430 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:26.180184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba494983-6b7e-477b-b3a7-4ba5b8e4e430 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:26.211483 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:26.221595 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d4af0-04ff-46fa-8793-e11a3d212dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:26.222280 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d4af0-04ff-46fa-8793-e11a3d212dc8 None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:26.222559 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d4af0-04ff-46fa-8793-e11a3d212dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:26.222827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d4af0-04ff-46fa-8793-e11a3d212dc8 None admin] PATH_INFO: `/v3/projects/33fa53fa81554846851b5624e6c568b8/users/0ffc9b862b91446a917b16e73401bcae/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:26.224876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d4af0-04ff-46fa-8793-e11a3d212dc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=33fa53fa81554846851b5624e6c568b8, user_id=0ffc9b862b91446a917b16e73401bcae, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:26.226339 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d4af0-04ff-46fa-8793-e11a3d212dc8 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:26.242133 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 581/1153] 10.222.0.62 () {58 vars in 1439 bytes} [Tue Oct 4 14:17:26 2022] PUT /identity/v3/projects/33fa53fa81554846851b5624e6c568b8/users/0ffc9b862b91446a917b16e73401bcae/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:17:28.539667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06037e04-fe22-45f2-b50c-6d553704543f None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:28.540455 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06037e04-fe22-45f2-b50c-6d553704543f None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:28.540455 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06037e04-fe22-45f2-b50c-6d553704543f None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:28.541959 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 573/1154] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:17:28.548754 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63287180-5ecf-45d1-b0e0-6ae885c3a603 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:28.549385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63287180-5ecf-45d1-b0e0-6ae885c3a603 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:28.549385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63287180-5ecf-45d1-b0e0-6ae885c3a603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:28.571107 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-63287180-5ecf-45d1-b0e0-6ae885c3a603 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:17:28.572377 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-63287180-5ecf-45d1-b0e0-6ae885c3a603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:17:28.651727 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 582/1155] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:17:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:17:28.930146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06037e04-fe22-45f2-b50c-6d553704543f None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:28.994067 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:29.044270 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06037e04-fe22-45f2-b50c-6d553704543f None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:29.081843 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab081f-08ed-44d2-be3f-bf152facc4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:29.082477 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab081f-08ed-44d2-be3f-bf152facc4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:29.082758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab081f-08ed-44d2-be3f-bf152facc4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:29.083025 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab081f-08ed-44d2-be3f-bf152facc4b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:29.095326 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab081f-08ed-44d2-be3f-bf152facc4b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:17:29.100247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-b0ab081f-08ed-44d2-be3f-bf152facc4b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:17:29.100247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:17:29.100247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:17:29.100247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:17:29.100247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:17:29.100247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:17:29.100247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:17:29.100247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:17:29.100247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:17:29.100247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:17:29.100247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:17:29.100247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:17:29.100247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:17:29.100247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:17:29.100247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:17:29.100247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:17:29.102228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:17:29.102228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:17:29.102228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:17:29.102228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:17:29.102228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:17:29.102228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:17:29.102228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:17:29.102228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:17:29.102228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:17:29.102228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:17:29.102228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:17:29.102228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:17:29.102228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:17:29.102228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:17:29.102228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:17:29.102228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:17:29.104573 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:17:29.104573 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:17:29.104573 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:17:29.104573 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:17:29.104573 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:17:29.104573 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:17:29.104573 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:17:29.104573 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:17:29.104573 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:17:29.104573 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:17:29.104573 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:17:29.104573 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:17:29.104573 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 574/1156] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:17:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:17:29.111220 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63287180-5ecf-45d1-b0e0-6ae885c3a603 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:29.229503 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63287180-5ecf-45d1-b0e0-6ae885c3a603 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:29.248111 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:29.271321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57ac43-ecf9-4f1c-9ee0-e75cc24108b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:29.271993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57ac43-ecf9-4f1c-9ee0-e75cc24108b3 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:29.272270 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57ac43-ecf9-4f1c-9ee0-e75cc24108b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:29.272533 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57ac43-ecf9-4f1c-9ee0-e75cc24108b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:29.273209 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57ac43-ecf9-4f1c-9ee0-e75cc24108b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:17:29.273508 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57ac43-ecf9-4f1c-9ee0-e75cc24108b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:29.274922 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57ac43-ecf9-4f1c-9ee0-e75cc24108b3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:29.284905 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 583/1157] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:17:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:29.291137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab081f-08ed-44d2-be3f-bf152facc4b3 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:29.409603 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab081f-08ed-44d2-be3f-bf152facc4b3 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:29.427216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:29.455739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96b2b8-d029-443f-b817-b351f29b1c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:29.456556 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96b2b8-d029-443f-b817-b351f29b1c3d None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:29.456685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96b2b8-d029-443f-b817-b351f29b1c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:29.456887 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96b2b8-d029-443f-b817-b351f29b1c3d None admin] PATH_INFO: `/v3/users/0ffc9b862b91446a917b16e73401bcae` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:29.458073 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96b2b8-d029-443f-b817-b351f29b1c3d None admin] RBAC: Authorizing `identity:get_user(user_id=0ffc9b862b91446a917b16e73401bcae)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:29.459704 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96b2b8-d029-443f-b817-b351f29b1c3d None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:29.461669 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 575/1158] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:17:29 2022] GET /identity/v3/users/0ffc9b862b91446a917b16e73401bcae => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:29.468652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57ac43-ecf9-4f1c-9ee0-e75cc24108b3 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:29.600823 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57ac43-ecf9-4f1c-9ee0-e75cc24108b3 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:29.640124 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a31ae8-e58d-4b41-91e8-00e7a9050115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:29.640756 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a31ae8-e58d-4b41-91e8-00e7a9050115 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:29.641030 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a31ae8-e58d-4b41-91e8-00e7a9050115 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:29.641306 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a31ae8-e58d-4b41-91e8-00e7a9050115 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:29.694918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:29.721252 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a31ae8-e58d-4b41-91e8-00e7a9050115 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:29.722736 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a31ae8-e58d-4b41-91e8-00e7a9050115 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:29.855953 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 584/1159] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:17:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 14:17:29.862155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96b2b8-d029-443f-b817-b351f29b1c3d None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:29.980317 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96b2b8-d029-443f-b817-b351f29b1c3d None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:30.019824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad05493-0b64-4613-841f-4876038bd95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:30.020469 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad05493-0b64-4613-841f-4876038bd95a None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:30.020748 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad05493-0b64-4613-841f-4876038bd95a None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:30.021021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad05493-0b64-4613-841f-4876038bd95a None admin] PATH_INFO: `/v3/projects/33fa53fa81554846851b5624e6c568b8` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:30.022190 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad05493-0b64-4613-841f-4876038bd95a None admin] RBAC: Authorizing `identity:get_project(project_id=33fa53fa81554846851b5624e6c568b8)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:30.023647 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad05493-0b64-4613-841f-4876038bd95a None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:30.025410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 576/1160] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:17:29 2022] GET /identity/v3/projects/33fa53fa81554846851b5624e6c568b8 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:17:30.033525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a31ae8-e58d-4b41-91e8-00e7a9050115 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:30.174586 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:30.202930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a31ae8-e58d-4b41-91e8-00e7a9050115 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:30.252005 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130d8a0-0d22-432a-b514-7772988e062d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:30.252644 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130d8a0-0d22-432a-b514-7772988e062d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:30.252922 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130d8a0-0d22-432a-b514-7772988e062d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:30.253190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130d8a0-0d22-432a-b514-7772988e062d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:30.253938 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130d8a0-0d22-432a-b514-7772988e062d None admin] RBAC: Adding query filter params (role.id=a16b6daeda5b4a67992f3c12514ca90e, scope.project.id=33fa53fa81554846851b5624e6c568b8, user.id=0ffc9b862b91446a917b16e73401bcae) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:17:30.254243 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130d8a0-0d22-432a-b514-7772988e062d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:30.255747 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130d8a0-0d22-432a-b514-7772988e062d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:30.263010 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 585/1161] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:17:30 2022] GET /identity/v3/role_assignments?user.id=0ffc9b862b91446a917b16e73401bcae&scope.project.id=33fa53fa81554846851b5624e6c568b8&role.id=a16b6daeda5b4a67992f3c12514ca90e => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:32.618277 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d507170-b955-4449-837b-0ad2fc7c8bfd None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:32.618838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d507170-b955-4449-837b-0ad2fc7c8bfd None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:32.618838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d507170-b955-4449-837b-0ad2fc7c8bfd None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:32.620996 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 577/1162] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:17:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:17:32.626598 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef2568-731b-4616-8325-064b0f5fea79 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:32.627087 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef2568-731b-4616-8325-064b0f5fea79 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:32.627193 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef2568-731b-4616-8325-064b0f5fea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:32.646072 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e4ef2568-731b-4616-8325-064b0f5fea79 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:17:32.647274 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e4ef2568-731b-4616-8325-064b0f5fea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:17:32.734896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 586/1163] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:17:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:17:33.007118 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d507170-b955-4449-837b-0ad2fc7c8bfd None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:33.074915 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:33.139427 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d507170-b955-4449-837b-0ad2fc7c8bfd None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:33.181666 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6d0a0-a3d8-44da-89e5-c724997c436f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:33.181666 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6d0a0-a3d8-44da-89e5-c724997c436f None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:33.183093 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6d0a0-a3d8-44da-89e5-c724997c436f None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:33.183586 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6d0a0-a3d8-44da-89e5-c724997c436f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:33.267781 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6d0a0-a3d8-44da-89e5-c724997c436f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:33.269272 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6d0a0-a3d8-44da-89e5-c724997c436f None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:33.324514 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:33.383414 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 578/1164] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:17:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 14:17:33.392818 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef2568-731b-4616-8325-064b0f5fea79 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:33.475645 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:33.511771 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef2568-731b-4616-8325-064b0f5fea79 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:33.554332 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4dde29-cabe-4e93-bcf3-36c18c0b901c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:33.555508 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dde29-cabe-4e93-bcf3-36c18c0b901c None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:33.555686 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dde29-cabe-4e93-bcf3-36c18c0b901c None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:33.556066 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dde29-cabe-4e93-bcf3-36c18c0b901c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:33.564444 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4dde29-cabe-4e93-bcf3-36c18c0b901c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:33.565962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4dde29-cabe-4e93-bcf3-36c18c0b901c None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:33.578581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-9a4dde29-cabe-4e93-bcf3-36c18c0b901c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 04 14:17:33.578581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:17:33.578581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 14:17:33.578581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 14:17:33.578581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:17:33.578581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:17:33.578581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:17:33.578581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:17:33.578581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 04 14:17:33.578581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:17:33.578581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:17:33.578581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:17:33.578581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:17:33.578581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:17:33.578581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:17:33.578581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:17:33.578581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:17:33.580864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:17:33.580864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:17:33.580864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:17:33.580864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:17:33.580864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:17:33.580864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:17:33.580864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:17:33.580864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:17:33.580864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:17:33.580864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:17:33.580864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:17:33.580864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:17:33.580864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:17:33.580864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:17:33.580864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:17:33.580864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:17:33.582471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:17:33.582471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:17:33.582471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:17:33.582471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:17:33.582471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:17:33.582471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:17:33.582471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:17:33.582471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:17:33.582471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:17:33.582471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:17:33.582471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 14:17:33.582471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:17:33.582471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 04 14:17:33.582471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:17:33.582471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 587/1165] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Oct 4 14:17:33 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:17:33.587834 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6d0a0-a3d8-44da-89e5-c724997c436f None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:33.706368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6d0a0-a3d8-44da-89e5-c724997c436f None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:33.748299 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1275f-f205-450b-a529-c0bc58188fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:33.748980 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1275f-f205-450b-a529-c0bc58188fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:33.749298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1275f-f205-450b-a529-c0bc58188fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:33.749621 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1275f-f205-450b-a529-c0bc58188fe4 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:33.750338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1275f-f205-450b-a529-c0bc58188fe4 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:17:33.750681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1275f-f205-450b-a529-c0bc58188fe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:33.752170 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1275f-f205-450b-a529-c0bc58188fe4 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:33.761087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 579/1166] 10.222.0.62 () {56 vars in 1115 bytes} [Tue Oct 4 14:17:33 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:36.026887 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40637058-7849-4e42-88e2-82cf9d6d3109 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:36.027442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40637058-7849-4e42-88e2-82cf9d6d3109 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:36.027442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40637058-7849-4e42-88e2-82cf9d6d3109 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:36.029118 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 588/1167] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:17:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:17:36.037239 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adce34a-3172-4088-8098-631bb503d297 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:36.037755 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adce34a-3172-4088-8098-631bb503d297 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:36.037755 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adce34a-3172-4088-8098-631bb503d297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:36.058204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-9adce34a-3172-4088-8098-631bb503d297 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:17:36.059490 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-9adce34a-3172-4088-8098-631bb503d297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:17:36.068365 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:36.132838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 580/1168] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:17:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:17:36.407582 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40637058-7849-4e42-88e2-82cf9d6d3109 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:36.524716 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40637058-7849-4e42-88e2-82cf9d6d3109 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:36.558624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:36.565392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99d223-325c-435c-8d8b-287327e10de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:36.566012 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99d223-325c-435c-8d8b-287327e10de0 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:36.566290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99d223-325c-435c-8d8b-287327e10de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:36.566560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99d223-325c-435c-8d8b-287327e10de0 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:36.567251 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99d223-325c-435c-8d8b-287327e10de0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:36.568661 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99d223-325c-435c-8d8b-287327e10de0 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:36.586337 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 589/1169] 10.222.0.62 () {60 vars in 1138 bytes} [Tue Oct 4 14:17:36 2022] POST /identity/v3/domains => generated 267 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:17:38.995976 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e44977-6566-421b-a478-51c5c3970e7b None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:38.996580 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e44977-6566-421b-a478-51c5c3970e7b None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:38.996580 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e44977-6566-421b-a478-51c5c3970e7b None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:38.997989 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 581/1170] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:17:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:17:39.004294 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45ec93-d002-4f37-9b03-bf85a7055971 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:39.005081 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45ec93-d002-4f37-9b03-bf85a7055971 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:39.005081 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45ec93-d002-4f37-9b03-bf85a7055971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:39.026959 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ce45ec93-d002-4f37-9b03-bf85a7055971 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:17:39.028733 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ce45ec93-d002-4f37-9b03-bf85a7055971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:17:39.105802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 590/1171] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:17:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:17:39.384553 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e44977-6566-421b-a478-51c5c3970e7b None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:39.510174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e44977-6566-421b-a478-51c5c3970e7b None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:39.552424 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d386ee9-6626-447e-9280-6472fe0af138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:39.553093 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d386ee9-6626-447e-9280-6472fe0af138 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:39.553363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d386ee9-6626-447e-9280-6472fe0af138 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:39.553711 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d386ee9-6626-447e-9280-6472fe0af138 None admin] PATH_INFO: `/v3/domains/28d153c608d64273a6b5be1e0c0d4a96` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:39.567377 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d386ee9-6626-447e-9280-6472fe0af138 None admin] RBAC: Authorizing `identity:get_domain(domain_id=28d153c608d64273a6b5be1e0c0d4a96)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:39.569045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d386ee9-6626-447e-9280-6472fe0af138 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:39.570778 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 582/1172] 10.222.0.62 () {56 vars in 1183 bytes} [Tue Oct 4 14:17:39 2022] GET /identity/v3/domains/28d153c608d64273a6b5be1e0c0d4a96 => generated 267 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:39.577028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45ec93-d002-4f37-9b03-bf85a7055971 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:39.696516 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45ec93-d002-4f37-9b03-bf85a7055971 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:39.725069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:39.739186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a31b1-ffb1-47fd-9049-5a636c538447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:39.739834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a31b1-ffb1-47fd-9049-5a636c538447 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:39.740111 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a31b1-ffb1-47fd-9049-5a636c538447 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:39.740377 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a31b1-ffb1-47fd-9049-5a636c538447 None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:39.741050 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a31b1-ffb1-47fd-9049-5a636c538447 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:39.742518 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a31b1-ffb1-47fd-9049-5a636c538447 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:39.773856 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 591/1173] 10.222.0.62 () {60 vars in 1141 bytes} [Tue Oct 4 14:17:39 2022] POST /identity/v3/projects => generated 361 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:17:42.107763 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee951ae4-836f-4072-bb32-75459d35d7a2 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:42.108368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee951ae4-836f-4072-bb32-75459d35d7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:42.108368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee951ae4-836f-4072-bb32-75459d35d7a2 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:42.109671 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 583/1174] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:17:42.118337 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45022662-3858-4757-a314-9c6da1794dc5 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:42.118961 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45022662-3858-4757-a314-9c6da1794dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:42.118961 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45022662-3858-4757-a314-9c6da1794dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:42.139140 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-45022662-3858-4757-a314-9c6da1794dc5 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:17:42.140395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-45022662-3858-4757-a314-9c6da1794dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:17:42.217454 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 592/1175] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:17:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:17:42.550729 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee951ae4-836f-4072-bb32-75459d35d7a2 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:42.555780 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:42.682588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee951ae4-836f-4072-bb32-75459d35d7a2 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:42.744896 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d295e78-81c8-4565-a147-a931ff3cfe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:42.745770 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d295e78-81c8-4565-a147-a931ff3cfe0e None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:42.746054 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d295e78-81c8-4565-a147-a931ff3cfe0e None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:42.746332 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d295e78-81c8-4565-a147-a931ff3cfe0e None admin] PATH_INFO: `/v3/domains/28d153c608d64273a6b5be1e0c0d4a96` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:42.747687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d295e78-81c8-4565-a147-a931ff3cfe0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=28d153c608d64273a6b5be1e0c0d4a96)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:42.749218 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d295e78-81c8-4565-a147-a931ff3cfe0e None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:42.750930 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 584/1176] 10.222.0.62 () {56 vars in 1183 bytes} [Tue Oct 4 14:17:42 2022] GET /identity/v3/domains/28d153c608d64273a6b5be1e0c0d4a96 => generated 267 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:42.757423 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45022662-3858-4757-a314-9c6da1794dc5 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:42.880353 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45022662-3858-4757-a314-9c6da1794dc5 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:42.883105 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:42.927377 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94265e8-f3a5-471d-a84e-91b4cbdea127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:42.928079 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94265e8-f3a5-471d-a84e-91b4cbdea127 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:42.928389 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94265e8-f3a5-471d-a84e-91b4cbdea127 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:42.928661 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94265e8-f3a5-471d-a84e-91b4cbdea127 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:42.929372 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94265e8-f3a5-471d-a84e-91b4cbdea127 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:42.930848 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94265e8-f3a5-471d-a84e-91b4cbdea127 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:42.957782 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 593/1177] 10.222.0.62 () {60 vars in 1132 bytes} [Tue Oct 4 14:17:42 2022] POST /identity/v3/users => generated 311 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:17:45.429837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125ab8e-bdcc-41df-b330-ae4151089c1f None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:45.430473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125ab8e-bdcc-41df-b330-ae4151089c1f None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:45.430473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125ab8e-bdcc-41df-b330-ae4151089c1f None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:45.432393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 585/1178] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:17:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:17:45.439127 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4293a-26dd-4c3d-bcd9-6e6df1d5ad1a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:45.439681 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4293a-26dd-4c3d-bcd9-6e6df1d5ad1a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:45.439858 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4293a-26dd-4c3d-bcd9-6e6df1d5ad1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:45.460706 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c4a4293a-26dd-4c3d-bcd9-6e6df1d5ad1a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:17:45.461932 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c4a4293a-26dd-4c3d-bcd9-6e6df1d5ad1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:17:45.548998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 594/1179] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:17:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:17:45.846414 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125ab8e-bdcc-41df-b330-ae4151089c1f None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:45.927844 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:45.967916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125ab8e-bdcc-41df-b330-ae4151089c1f None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:46.008152 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d48ad5-b64e-43e0-9f6a-01c3a7ab9f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:46.008798 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d48ad5-b64e-43e0-9f6a-01c3a7ab9f56 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:46.009068 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d48ad5-b64e-43e0-9f6a-01c3a7ab9f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:46.009352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d48ad5-b64e-43e0-9f6a-01c3a7ab9f56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:46.022819 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d48ad5-b64e-43e0-9f6a-01c3a7ab9f56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:17:46.028461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-b7d48ad5-b64e-43e0-9f6a-01c3a7ab9f56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:17:46.028461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:17:46.028461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:17:46.028461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:17:46.028461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:17:46.028461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:17:46.028461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:17:46.028461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:17:46.028461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:17:46.028461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:17:46.028461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:17:46.028461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:17:46.028461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:17:46.028461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:17:46.028461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:17:46.028461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:17:46.029651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:17:46.029651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:17:46.029651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:17:46.029651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:17:46.029651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:17:46.029651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:17:46.029651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:17:46.029651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:17:46.029651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:17:46.029651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:17:46.029651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:17:46.029651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:17:46.029651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:17:46.029651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:17:46.029651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:17:46.029651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:17:46.030619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:17:46.030619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:17:46.030619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:17:46.030619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:17:46.030619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:17:46.030619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:17:46.030619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:17:46.030619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:17:46.030619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:17:46.030619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:17:46.030619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:17:46.030619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:17:46.031892 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 586/1180] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:17:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:17:46.036017 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4293a-26dd-4c3d-bcd9-6e6df1d5ad1a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:46.143979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:46.161633 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4293a-26dd-4c3d-bcd9-6e6df1d5ad1a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:46.221703 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c207f1-fe1d-4ea4-8323-a64b2d589065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:46.222729 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c207f1-fe1d-4ea4-8323-a64b2d589065 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:46.223226 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c207f1-fe1d-4ea4-8323-a64b2d589065 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:46.223739 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c207f1-fe1d-4ea4-8323-a64b2d589065 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:46.224916 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c207f1-fe1d-4ea4-8323-a64b2d589065 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:17:46.225455 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c207f1-fe1d-4ea4-8323-a64b2d589065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:46.228013 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c207f1-fe1d-4ea4-8323-a64b2d589065 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:46.245120 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 595/1181] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:17:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:46.251518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d48ad5-b64e-43e0-9f6a-01c3a7ab9f56 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:46.381422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d48ad5-b64e-43e0-9f6a-01c3a7ab9f56 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:46.415093 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:46.424448 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b7aa4-7ca0-4a00-83c3-dd81f07cba69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:46.425228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b7aa4-7ca0-4a00-83c3-dd81f07cba69 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:46.425610 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b7aa4-7ca0-4a00-83c3-dd81f07cba69 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:46.425986 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b7aa4-7ca0-4a00-83c3-dd81f07cba69 None admin] PATH_INFO: `/v3/users/26a2944feeea43ee8b15fc6d840eb925` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:46.442836 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b7aa4-7ca0-4a00-83c3-dd81f07cba69 None admin] RBAC: Authorizing `identity:get_user(user_id=26a2944feeea43ee8b15fc6d840eb925)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:46.444813 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b7aa4-7ca0-4a00-83c3-dd81f07cba69 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:46.446673 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 587/1182] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:17:46 2022] GET /identity/v3/users/26a2944feeea43ee8b15fc6d840eb925 => generated 311 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:46.452938 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c207f1-fe1d-4ea4-8323-a64b2d589065 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:46.589033 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c207f1-fe1d-4ea4-8323-a64b2d589065 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:46.627975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c2b3d-6174-44a8-b00b-e9e0f0f8aa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:46.628589 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c2b3d-6174-44a8-b00b-e9e0f0f8aa07 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:46.628865 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c2b3d-6174-44a8-b00b-e9e0f0f8aa07 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:46.629134 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c2b3d-6174-44a8-b00b-e9e0f0f8aa07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:46.653743 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:46.706026 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c2b3d-6174-44a8-b00b-e9e0f0f8aa07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:46.708999 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c2b3d-6174-44a8-b00b-e9e0f0f8aa07 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:46.828001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 596/1183] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:17:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 14:17:46.836434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b7aa4-7ca0-4a00-83c3-dd81f07cba69 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:46.946182 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b7aa4-7ca0-4a00-83c3-dd81f07cba69 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:46.986805 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842949bc-5289-40e4-a54a-b4e0bb244711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:46.987441 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842949bc-5289-40e4-a54a-b4e0bb244711 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:46.987743 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842949bc-5289-40e4-a54a-b4e0bb244711 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:46.988019 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842949bc-5289-40e4-a54a-b4e0bb244711 None admin] PATH_INFO: `/v3/projects/439faa3146be474fb55c983fb0a43de3` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:46.989149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842949bc-5289-40e4-a54a-b4e0bb244711 None admin] RBAC: Authorizing `identity:get_project(project_id=439faa3146be474fb55c983fb0a43de3)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:46.990590 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842949bc-5289-40e4-a54a-b4e0bb244711 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:46.992289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 588/1184] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:17:46 2022] GET /identity/v3/projects/439faa3146be474fb55c983fb0a43de3 => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:46.999375 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c2b3d-6174-44a8-b00b-e9e0f0f8aa07 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:47.059790 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:47.115383 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c2b3d-6174-44a8-b00b-e9e0f0f8aa07 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:47.157984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9891b17-3620-496c-a892-74f0653dbdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:47.158608 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9891b17-3620-496c-a892-74f0653dbdbd None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:47.158884 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9891b17-3620-496c-a892-74f0653dbdbd None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:47.159152 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9891b17-3620-496c-a892-74f0653dbdbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:47.159930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9891b17-3620-496c-a892-74f0653dbdbd None admin] RBAC: Adding query filter params (role.id=a16b6daeda5b4a67992f3c12514ca90e, scope.project.id=439faa3146be474fb55c983fb0a43de3, user.id=26a2944feeea43ee8b15fc6d840eb925) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:17:47.160238 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9891b17-3620-496c-a892-74f0653dbdbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:47.161687 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9891b17-3620-496c-a892-74f0653dbdbd None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:47.168441 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 597/1185] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:17:46 2022] GET /identity/v3/role_assignments?user.id=26a2944feeea43ee8b15fc6d840eb925&scope.project.id=439faa3146be474fb55c983fb0a43de3&role.id=a16b6daeda5b4a67992f3c12514ca90e => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:49.371390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4ca14-9e04-4934-96b8-998d550a87aa None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:49.371992 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4ca14-9e04-4934-96b8-998d550a87aa None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:49.371992 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4ca14-9e04-4934-96b8-998d550a87aa None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:49.373313 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 589/1186] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:17:49.379362 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db77729-4b4f-4b5e-8a47-5dd56e1e0b72 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:49.379981 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db77729-4b4f-4b5e-8a47-5dd56e1e0b72 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:49.379981 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db77729-4b4f-4b5e-8a47-5dd56e1e0b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:49.398602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-9db77729-4b4f-4b5e-8a47-5dd56e1e0b72 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:17:49.400336 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9db77729-4b4f-4b5e-8a47-5dd56e1e0b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:17:49.474699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 598/1187] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:17:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 14:17:49.749789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4ca14-9e04-4934-96b8-998d550a87aa None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:49.822723 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:49.873974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4ca14-9e04-4934-96b8-998d550a87aa None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:49.914028 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef19ae8-c57c-4996-9fab-a233791e0a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:49.914724 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef19ae8-c57c-4996-9fab-a233791e0a2f None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:49.915041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef19ae8-c57c-4996-9fab-a233791e0a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:49.915352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef19ae8-c57c-4996-9fab-a233791e0a2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:49.928295 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef19ae8-c57c-4996-9fab-a233791e0a2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:17:49.933840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-eef19ae8-c57c-4996-9fab-a233791e0a2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:17:49.933840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:17:49.933840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:17:49.933840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:17:49.933840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:17:49.933840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:17:49.933840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:17:49.933840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:17:49.933840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:17:49.933840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:17:49.933840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:17:49.933840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:17:49.933840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:17:49.933840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:17:49.933840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:17:49.933840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:17:49.935679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:17:49.935679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:17:49.935679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:17:49.935679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:17:49.935679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:17:49.935679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:17:49.935679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:17:49.935679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:17:49.935679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:17:49.935679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:17:49.935679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:17:49.935679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:17:49.935679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:17:49.935679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:17:49.935679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:17:49.935679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:17:49.936882 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:17:49.936882 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:17:49.936882 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:17:49.936882 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:17:49.936882 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:17:49.936882 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:17:49.936882 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:17:49.936882 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:17:49.936882 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:17:49.936882 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:17:49.936882 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:17:49.936882 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:17:49.936882 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 590/1188] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:17:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:17:49.942571 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db77729-4b4f-4b5e-8a47-5dd56e1e0b72 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:49.997301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:50.059012 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db77729-4b4f-4b5e-8a47-5dd56e1e0b72 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:50.099737 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09e74a-a4e2-418a-b63c-ded56bc36716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:50.100445 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09e74a-a4e2-418a-b63c-ded56bc36716 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:50.100770 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09e74a-a4e2-418a-b63c-ded56bc36716 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:50.101139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09e74a-a4e2-418a-b63c-ded56bc36716 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:50.101878 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09e74a-a4e2-418a-b63c-ded56bc36716 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:17:50.102225 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09e74a-a4e2-418a-b63c-ded56bc36716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:50.105030 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09e74a-a4e2-418a-b63c-ded56bc36716 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:50.114524 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 599/1189] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:17:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:50.121607 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef19ae8-c57c-4996-9fab-a233791e0a2f None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:50.305570 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef19ae8-c57c-4996-9fab-a233791e0a2f None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:50.339993 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:50.374076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0ac2f-f29f-49e3-aef9-9c3e24bc49b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:50.375147 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0ac2f-f29f-49e3-aef9-9c3e24bc49b5 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:50.375635 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0ac2f-f29f-49e3-aef9-9c3e24bc49b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:50.376117 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0ac2f-f29f-49e3-aef9-9c3e24bc49b5 None admin] PATH_INFO: `/v3/users/26a2944feeea43ee8b15fc6d840eb925` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:50.378184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0ac2f-f29f-49e3-aef9-9c3e24bc49b5 None admin] RBAC: Authorizing `identity:get_user(user_id=26a2944feeea43ee8b15fc6d840eb925)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:50.380955 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0ac2f-f29f-49e3-aef9-9c3e24bc49b5 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:50.384081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 591/1190] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:17:50 2022] GET /identity/v3/users/26a2944feeea43ee8b15fc6d840eb925 => generated 311 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:50.391298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09e74a-a4e2-418a-b63c-ded56bc36716 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:50.533114 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09e74a-a4e2-418a-b63c-ded56bc36716 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:50.552495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:50.598068 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919c270-1da3-4828-9151-62f2c751e225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:50.599047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919c270-1da3-4828-9151-62f2c751e225 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:50.599542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919c270-1da3-4828-9151-62f2c751e225 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:50.600073 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919c270-1da3-4828-9151-62f2c751e225 None admin] PATH_INFO: `/v3/projects/439faa3146be474fb55c983fb0a43de3` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:50.602118 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919c270-1da3-4828-9151-62f2c751e225 None admin] RBAC: Authorizing `identity:get_project(project_id=439faa3146be474fb55c983fb0a43de3)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:50.605473 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919c270-1da3-4828-9151-62f2c751e225 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:50.608763 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 600/1191] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:17:50 2022] GET /identity/v3/projects/439faa3146be474fb55c983fb0a43de3 => generated 361 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:50.615281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0ac2f-f29f-49e3-aef9-9c3e24bc49b5 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:50.724456 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0ac2f-f29f-49e3-aef9-9c3e24bc49b5 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:50.763998 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15d1cb-4ffa-488d-9ab2-0e1877bcde28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:50.764679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15d1cb-4ffa-488d-9ab2-0e1877bcde28 None admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:50.764958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15d1cb-4ffa-488d-9ab2-0e1877bcde28 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:50.765231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15d1cb-4ffa-488d-9ab2-0e1877bcde28 None admin] PATH_INFO: `/v3/projects/439faa3146be474fb55c983fb0a43de3/users/26a2944feeea43ee8b15fc6d840eb925/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:50.767221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15d1cb-4ffa-488d-9ab2-0e1877bcde28 None admin] RBAC: Authorizing `identity:create_grant(project_id=439faa3146be474fb55c983fb0a43de3, user_id=26a2944feeea43ee8b15fc6d840eb925, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:50.768703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15d1cb-4ffa-488d-9ab2-0e1877bcde28 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:50.783584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 592/1192] 10.222.0.62 () {58 vars in 1439 bytes} [Tue Oct 4 14:17:50 2022] PUT /identity/v3/projects/439faa3146be474fb55c983fb0a43de3/users/26a2944feeea43ee8b15fc6d840eb925/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:17:53.179773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81594bc-c923-4bdf-abf5-b2027d56872d None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:53.180363 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81594bc-c923-4bdf-abf5-b2027d56872d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:53.180363 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81594bc-c923-4bdf-abf5-b2027d56872d None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:53.181881 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 601/1193] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:17:53.188307 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd5983-67ed-4b25-abe6-484dfdd6c8c9 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:53.188842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd5983-67ed-4b25-abe6-484dfdd6c8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:53.188842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd5983-67ed-4b25-abe6-484dfdd6c8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:53.208318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-47bd5983-67ed-4b25-abe6-484dfdd6c8c9 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:17:53.209564 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-47bd5983-67ed-4b25-abe6-484dfdd6c8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:17:53.262701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:53.298352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 593/1194] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:17:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 14:17:53.585281 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81594bc-c923-4bdf-abf5-b2027d56872d None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:53.705382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81594bc-c923-4bdf-abf5-b2027d56872d None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:53.752629 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02e22e-6df6-4918-85d2-208a0ceae184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:53.753284 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02e22e-6df6-4918-85d2-208a0ceae184 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:53.753556 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02e22e-6df6-4918-85d2-208a0ceae184 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:53.753821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02e22e-6df6-4918-85d2-208a0ceae184 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:53.767036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02e22e-6df6-4918-85d2-208a0ceae184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:17:53.772035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-6e02e22e-6df6-4918-85d2-208a0ceae184 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:17:53.772035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:17:53.772035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:17:53.772035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:17:53.772035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:17:53.772035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:17:53.772035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:17:53.772035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:17:53.772035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:17:53.772035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:17:53.772035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:17:53.772035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:17:53.772035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:17:53.772035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:17:53.772035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:17:53.772035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:17:53.773655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:17:53.773655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:17:53.773655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:17:53.773655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:17:53.773655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:17:53.773655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:17:53.773655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:17:53.773655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:17:53.773655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:17:53.773655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:17:53.773655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:17:53.773655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:17:53.773655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:17:53.773655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:17:53.773655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:17:53.773655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:17:53.774565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:17:53.774565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:17:53.774565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:17:53.774565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:17:53.774565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:17:53.774565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:17:53.774565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:17:53.774565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:17:53.774565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:17:53.774565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:17:53.774565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:17:53.774565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:17:53.774565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 602/1195] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:17:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:17:53.780091 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd5983-67ed-4b25-abe6-484dfdd6c8c9 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:53.894893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd5983-67ed-4b25-abe6-484dfdd6c8c9 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:53.935511 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cbeb1-ae28-4e78-9789-1e5e07e31d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:53.936166 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cbeb1-ae28-4e78-9789-1e5e07e31d26 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:53.936450 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cbeb1-ae28-4e78-9789-1e5e07e31d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:53.936719 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cbeb1-ae28-4e78-9789-1e5e07e31d26 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:53.937403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cbeb1-ae28-4e78-9789-1e5e07e31d26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:17:53.937707 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cbeb1-ae28-4e78-9789-1e5e07e31d26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:53.939377 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cbeb1-ae28-4e78-9789-1e5e07e31d26 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:53.950568 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 594/1196] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:17:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:17:53.956910 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02e22e-6df6-4918-85d2-208a0ceae184 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:53.995886 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:54.064817 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02e22e-6df6-4918-85d2-208a0ceae184 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:54.101620 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccce7be-4931-4eac-8079-8ca179fbeef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:54.102320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccce7be-4931-4eac-8079-8ca179fbeef0 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:54.102638 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccce7be-4931-4eac-8079-8ca179fbeef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:54.103444 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccce7be-4931-4eac-8079-8ca179fbeef0 None admin] PATH_INFO: `/v3/users/26a2944feeea43ee8b15fc6d840eb925` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:54.104720 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccce7be-4931-4eac-8079-8ca179fbeef0 None admin] RBAC: Authorizing `identity:get_user(user_id=26a2944feeea43ee8b15fc6d840eb925)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:54.106211 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccce7be-4931-4eac-8079-8ca179fbeef0 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:54.108061 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 603/1197] 10.222.0.62 () {56 vars in 1177 bytes} [Tue Oct 4 14:17:53 2022] GET /identity/v3/users/26a2944feeea43ee8b15fc6d840eb925 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:17:54.113998 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cbeb1-ae28-4e78-9789-1e5e07e31d26 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:54.154541 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:54.232648 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cbeb1-ae28-4e78-9789-1e5e07e31d26 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:54.278224 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162de0b-4c8d-4783-89ed-280872994fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:54.278934 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162de0b-4c8d-4783-89ed-280872994fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:54.279216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162de0b-4c8d-4783-89ed-280872994fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:54.279488 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162de0b-4c8d-4783-89ed-280872994fd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:54.359761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162de0b-4c8d-4783-89ed-280872994fd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:54.361526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162de0b-4c8d-4783-89ed-280872994fd8 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:54.401277 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:54.481765 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 595/1198] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:17:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 14:17:54.488691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccce7be-4931-4eac-8079-8ca179fbeef0 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:54.618385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccce7be-4931-4eac-8079-8ca179fbeef0 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:54.621515 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:54.660995 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9f034-17ac-4f1b-af97-7e8738ab1485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:54.661685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9f034-17ac-4f1b-af97-7e8738ab1485 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:54.662004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9f034-17ac-4f1b-af97-7e8738ab1485 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:54.662314 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9f034-17ac-4f1b-af97-7e8738ab1485 None admin] PATH_INFO: `/v3/projects/439faa3146be474fb55c983fb0a43de3` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:54.663562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9f034-17ac-4f1b-af97-7e8738ab1485 None admin] RBAC: Authorizing `identity:get_project(project_id=439faa3146be474fb55c983fb0a43de3)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:54.665130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9f034-17ac-4f1b-af97-7e8738ab1485 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:54.667490 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 604/1199] 10.222.0.62 () {56 vars in 1186 bytes} [Tue Oct 4 14:17:54 2022] GET /identity/v3/projects/439faa3146be474fb55c983fb0a43de3 => generated 361 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:17:54.674130 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162de0b-4c8d-4783-89ed-280872994fd8 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:17:54.789100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162de0b-4c8d-4783-89ed-280872994fd8 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:17:54.827897 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2c7e2-12c0-41df-970a-b1169db4ce8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:17:54.828532 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2c7e2-12c0-41df-970a-b1169db4ce8b None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:17:54.828789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2c7e2-12c0-41df-970a-b1169db4ce8b None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:17:54.829051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2c7e2-12c0-41df-970a-b1169db4ce8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:17:54.829781 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2c7e2-12c0-41df-970a-b1169db4ce8b None admin] RBAC: Adding query filter params (role.id=a16b6daeda5b4a67992f3c12514ca90e, scope.project.id=439faa3146be474fb55c983fb0a43de3, user.id=26a2944feeea43ee8b15fc6d840eb925) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:17:54.830083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2c7e2-12c0-41df-970a-b1169db4ce8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:17:54.831518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2c7e2-12c0-41df-970a-b1169db4ce8b None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:17:54.834814 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:17:54.838857 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 596/1200] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:17:54 2022] GET /identity/v3/role_assignments?user.id=26a2944feeea43ee8b15fc6d840eb925&scope.project.id=439faa3146be474fb55c983fb0a43de3&role.id=a16b6daeda5b4a67992f3c12514ca90e => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:18:04.656650 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=14 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:18:58.512351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036f08f-b0d0-4f94-9feb-720541e1fd9f None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:18:58.513628 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036f08f-b0d0-4f94-9feb-720541e1fd9f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:18:58.513628 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036f08f-b0d0-4f94-9feb-720541e1fd9f None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:18:58.514625 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 605/1201] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:18:58.520683 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f4300-0982-47f1-8e38-b10330d4252f None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:18:58.521276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f4300-0982-47f1-8e38-b10330d4252f None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:18:58.521276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f4300-0982-47f1-8e38-b10330d4252f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:18:58.547608 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-398f4300-0982-47f1-8e38-b10330d4252f None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:18:58.549466 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-398f4300-0982-47f1-8e38-b10330d4252f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:18:58.667527 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 597/1202] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:18:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 14:18:58.981865 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036f08f-b0d0-4f94-9feb-720541e1fd9f None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:18:59.206111 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036f08f-b0d0-4f94-9feb-720541e1fd9f None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:18:59.288332 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d52c03-c9f1-4c4b-990e-088f6d8a94d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:18:59.290293 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d52c03-c9f1-4c4b-990e-088f6d8a94d1 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:18:59.290924 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d52c03-c9f1-4c4b-990e-088f6d8a94d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:18:59.291886 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d52c03-c9f1-4c4b-990e-088f6d8a94d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:18:59.318446 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d52c03-c9f1-4c4b-990e-088f6d8a94d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:18:59.323272 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d52c03-c9f1-4c4b-990e-088f6d8a94d1 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:18:59.355231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-e4d52c03-c9f1-4c4b-990e-088f6d8a94d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:18:59.355231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:18:59.355231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:18:59.355231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:18:59.355231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:18:59.355231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:18:59.355231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:18:59.355231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:18:59.355231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:18:59.355231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:18:59.355231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:18:59.355231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:18:59.355231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:18:59.355231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:18:59.355231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:18:59.355231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:18:59.357805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:18:59.357805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:18:59.357805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:18:59.357805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:18:59.357805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:18:59.357805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:18:59.357805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:18:59.357805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:18:59.357805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:18:59.357805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:18:59.357805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:18:59.357805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:18:59.357805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:18:59.357805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:18:59.357805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:18:59.357805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:18:59.357805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:18:59.360066 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:18:59.360066 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:18:59.360066 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:18:59.362893 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 606/1203] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:18:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:18:59.375146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f4300-0982-47f1-8e38-b10330d4252f None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:18:59.575851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f4300-0982-47f1-8e38-b10330d4252f None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:18:59.641739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:18:59.662269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869eecf-a381-4be7-b76f-42cbda5a4870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:18:59.670822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869eecf-a381-4be7-b76f-42cbda5a4870 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:18:59.670822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869eecf-a381-4be7-b76f-42cbda5a4870 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:18:59.670822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869eecf-a381-4be7-b76f-42cbda5a4870 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:18:59.670822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869eecf-a381-4be7-b76f-42cbda5a4870 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:18:59.670822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869eecf-a381-4be7-b76f-42cbda5a4870 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:18:59.670822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869eecf-a381-4be7-b76f-42cbda5a4870 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:18:59.687286 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 598/1204] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:18:59.695513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d52c03-c9f1-4c4b-990e-088f6d8a94d1 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:18:59.821671 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:18:59.911090 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d52c03-c9f1-4c4b-990e-088f6d8a94d1 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:18:59.987040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72c67e-995f-4f88-a20b-9727aa252969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:18:59.988434 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72c67e-995f-4f88-a20b-9727aa252969 None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:18:59.989921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72c67e-995f-4f88-a20b-9727aa252969 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:18:59.991209 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72c67e-995f-4f88-a20b-9727aa252969 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:18:59.992729 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72c67e-995f-4f88-a20b-9727aa252969 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:18:59.995786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72c67e-995f-4f88-a20b-9727aa252969 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:00.055745 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 607/1205] 10.222.0.62 () {60 vars in 1132 bytes} [Tue Oct 4 14:18:59 2022] POST /identity/v3/users => generated 251 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:19:02.802164 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c5753-0e94-48d9-9387-47d6706584e2 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:02.802935 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c5753-0e94-48d9-9387-47d6706584e2 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:02.802935 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c5753-0e94-48d9-9387-47d6706584e2 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:02.806240 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 599/1206] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:19:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:19:02.816926 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab8e96-280b-4fd9-96d1-b36fb05ee479 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:02.817515 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab8e96-280b-4fd9-96d1-b36fb05ee479 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:02.817831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab8e96-280b-4fd9-96d1-b36fb05ee479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:02.854033 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-8dab8e96-280b-4fd9-96d1-b36fb05ee479 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:19:02.856582 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8dab8e96-280b-4fd9-96d1-b36fb05ee479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:19:02.983638 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 608/1207] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:19:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:19:03.337390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c5753-0e94-48d9-9387-47d6706584e2 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:03.508465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c5753-0e94-48d9-9387-47d6706584e2 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:03.580743 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52debb5d-ffc5-4f7b-9ecb-7a153d5b6a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:03.581640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52debb5d-ffc5-4f7b-9ecb-7a153d5b6a76 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:03.582151 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52debb5d-ffc5-4f7b-9ecb-7a153d5b6a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:03.582474 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52debb5d-ffc5-4f7b-9ecb-7a153d5b6a76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:03.601884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52debb5d-ffc5-4f7b-9ecb-7a153d5b6a76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:19:03.607319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-52debb5d-ffc5-4f7b-9ecb-7a153d5b6a76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:19:03.607319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:03.607319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:03.607319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:03.607319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:03.607319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:03.607319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:03.607319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:03.607319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:03.607319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:03.607319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:03.607319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:03.607319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:19:03.607319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:19:03.607319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:19:03.607319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:19:03.609244 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:19:03.609244 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:19:03.609244 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:19:03.609244 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:19:03.609244 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:03.609244 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:03.609244 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:03.609244 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:03.609244 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:03.609244 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:03.609244 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:03.609244 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:03.609244 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:03.609244 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:03.609244 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:03.609244 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:03.610102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:03.610102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:03.610102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:03.610102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:03.610102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:19:03.610102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:19:03.610102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:19:03.610102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:19:03.610102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:19:03.610102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:19:03.610102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:19:03.610102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:19:03.610102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 600/1208] 10.222.0.62 () {56 vars in 1102 bytes} [Tue Oct 4 14:19:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:03.623925 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab8e96-280b-4fd9-96d1-b36fb05ee479 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:03.683305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:03.833345 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab8e96-280b-4fd9-96d1-b36fb05ee479 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:03.904131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978ecd3-d673-4f60-8a73-a702cae9f377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:03.904810 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978ecd3-d673-4f60-8a73-a702cae9f377 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:03.905139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978ecd3-d673-4f60-8a73-a702cae9f377 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:03.905396 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978ecd3-d673-4f60-8a73-a702cae9f377 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:03.906157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978ecd3-d673-4f60-8a73-a702cae9f377 None admin] RBAC: Adding query filter params (name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:03.906454 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978ecd3-d673-4f60-8a73-a702cae9f377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:03.908263 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978ecd3-d673-4f60-8a73-a702cae9f377 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:03.924982 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 609/1209] 10.222.0.62 () {56 vars in 1103 bytes} [Tue Oct 4 14:19:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:19:03.935167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52debb5d-ffc5-4f7b-9ecb-7a153d5b6a76 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:04.033899 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:04.129113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52debb5d-ffc5-4f7b-9ecb-7a153d5b6a76 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:04.191532 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f417a-f879-4b72-9582-790c7fdd5ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:04.192474 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f417a-f879-4b72-9582-790c7fdd5ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:04.192659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f417a-f879-4b72-9582-790c7fdd5ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:04.192888 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f417a-f879-4b72-9582-790c7fdd5ad7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:04.209976 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f417a-f879-4b72-9582-790c7fdd5ad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:04.211653 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f417a-f879-4b72-9582-790c7fdd5ad7 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:04.234273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-160f417a-f879-4b72-9582-790c7fdd5ad7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:19:04.234273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:04.234273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:04.234273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:04.234273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:04.234273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:04.234273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:04.234273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:04.234273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:04.234273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:04.234273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:04.234273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:04.234273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:19:04.234273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:19:04.234273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:19:04.234273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:19:04.236773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:04.236773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:04.236773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:04.236773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:04.236773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:04.236773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:04.236773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:04.236773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:04.236773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:04.236773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:04.236773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:04.236773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:04.236773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:04.236773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:04.236773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:04.236773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:04.236773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:19:04.238826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:19:04.238826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:19:04.238826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:19:04.243656 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 601/1210] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:04.245132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978ecd3-d673-4f60-8a73-a702cae9f377 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:04.439000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:04.445767 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978ecd3-d673-4f60-8a73-a702cae9f377 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:04.518834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ddda20-6d5b-4066-ba34-a5b98a7c2db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:04.519649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddda20-6d5b-4066-ba34-a5b98a7c2db7 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:04.520026 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddda20-6d5b-4066-ba34-a5b98a7c2db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:04.520375 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddda20-6d5b-4066-ba34-a5b98a7c2db7 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:04.521254 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ddda20-6d5b-4066-ba34-a5b98a7c2db7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:04.521533 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ddda20-6d5b-4066-ba34-a5b98a7c2db7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:04.525034 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ddda20-6d5b-4066-ba34-a5b98a7c2db7 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:04.553532 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 610/1211] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:19:04.563061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f417a-f879-4b72-9582-790c7fdd5ad7 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:04.758222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f417a-f879-4b72-9582-790c7fdd5ad7 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:04.760617 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:04.833835 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9454a9-3f2f-48b6-ada9-0ad27ba5fff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:04.835558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9454a9-3f2f-48b6-ada9-0ad27ba5fff1 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:04.836134 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9454a9-3f2f-48b6-ada9-0ad27ba5fff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:04.836526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9454a9-3f2f-48b6-ada9-0ad27ba5fff1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:04.848745 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9454a9-3f2f-48b6-ada9-0ad27ba5fff1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:04.850703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9454a9-3f2f-48b6-ada9-0ad27ba5fff1 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:04.865215 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-7d9454a9-3f2f-48b6-ada9-0ad27ba5fff1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 14:19:04.865215 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:04.865215 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:04.865215 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:04.865215 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:04.865215 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:04.865215 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:04.865215 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:04.865215 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:04.865215 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:04.865215 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:04.865215 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:04.865215 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:19:04.865215 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:19:04.865215 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:19:04.865215 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:19:04.867638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:04.867638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:04.867638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:19:04.867638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:19:04.867638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:19:04.867638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:19:04.867638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:04.867638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:04.867638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:04.867638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:04.867638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:04.867638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:04.867638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:04.867638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:04.867638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:04.867638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:04.867638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:04.867638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:04.868987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:04.868987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:04.868987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:19:04.868987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:19:04.868987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:19:04.868987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:19:04.868987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:19:04.868987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:19:04.868987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 14:19:04.868987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:19:04.868987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 602/1212] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:19:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:04.873484 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ddda20-6d5b-4066-ba34-a5b98a7c2db7 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:04.999235 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ddda20-6d5b-4066-ba34-a5b98a7c2db7 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:05.049850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc2c07-f4a9-409d-851d-de18147509a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:05.050783 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc2c07-f4a9-409d-851d-de18147509a0 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:05.051181 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc2c07-f4a9-409d-851d-de18147509a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:05.051465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc2c07-f4a9-409d-851d-de18147509a0 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:05.052613 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc2c07-f4a9-409d-851d-de18147509a0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:05.053508 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc2c07-f4a9-409d-851d-de18147509a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:05.055417 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc2c07-f4a9-409d-851d-de18147509a0 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:05.087809 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 611/1213] 10.222.0.62 () {56 vars in 1143 bytes} [Tue Oct 4 14:19:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:05.095895 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9454a9-3f2f-48b6-ada9-0ad27ba5fff1 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:05.250005 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9454a9-3f2f-48b6-ada9-0ad27ba5fff1 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:05.311695 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60672e38-2737-48cc-90d4-3591bb0f62ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:05.313391 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60672e38-2737-48cc-90d4-3591bb0f62ac None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:05.313928 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60672e38-2737-48cc-90d4-3591bb0f62ac None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:05.314521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60672e38-2737-48cc-90d4-3591bb0f62ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:05.376644 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:05.448811 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60672e38-2737-48cc-90d4-3591bb0f62ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:05.450327 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60672e38-2737-48cc-90d4-3591bb0f62ac None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:05.631624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 603/1214] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:19:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 14:19:05.637816 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc2c07-f4a9-409d-851d-de18147509a0 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:05.676820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:05.832327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc2c07-f4a9-409d-851d-de18147509a0 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:05.916918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1f450-5213-4b15-8095-cf04d66e6ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:05.917591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1f450-5213-4b15-8095-cf04d66e6ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:05.923741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1f450-5213-4b15-8095-cf04d66e6ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:05.923741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1f450-5213-4b15-8095-cf04d66e6ee7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:05.934313 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1f450-5213-4b15-8095-cf04d66e6ee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:05.936979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1f450-5213-4b15-8095-cf04d66e6ee7 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:05.962426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-71d1f450-5213-4b15-8095-cf04d66e6ee7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:19:05.962426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:05.962426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:05.962426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:05.962426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:05.962426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:05.962426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:05.962426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:05.962426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:05.962426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:05.962426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:05.962426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:05.962426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:19:05.962426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:19:05.962426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:19:05.962426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:19:05.963802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:05.963802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:05.963802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:05.963802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:05.963802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:05.963802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:05.963802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:05.963802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:05.963802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:05.963802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:05.963802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:05.963802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:05.963802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:05.963802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:05.963802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:05.963802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:05.963802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:19:05.965725 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:19:05.965725 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:19:05.965725 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:19:05.972062 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60672e38-2737-48cc-90d4-3591bb0f62ac None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:05.972363 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 612/1215] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:19:06.061853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:06.149108 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60672e38-2737-48cc-90d4-3591bb0f62ac None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:06.228056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead78d9a-5002-4a60-a454-93a40890ba08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:06.229267 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead78d9a-5002-4a60-a454-93a40890ba08 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:06.229552 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead78d9a-5002-4a60-a454-93a40890ba08 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:06.229959 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead78d9a-5002-4a60-a454-93a40890ba08 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:06.230973 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead78d9a-5002-4a60-a454-93a40890ba08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:06.231587 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead78d9a-5002-4a60-a454-93a40890ba08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:06.233975 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead78d9a-5002-4a60-a454-93a40890ba08 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:06.255782 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 604/1216] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:06.262495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1f450-5213-4b15-8095-cf04d66e6ee7 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:06.410605 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:06.456251 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1f450-5213-4b15-8095-cf04d66e6ee7 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:06.514930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de320a0f-dbd3-4e6f-8e42-2bbf0f07a3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:06.515558 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de320a0f-dbd3-4e6f-8e42-2bbf0f07a3c4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:06.515898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de320a0f-dbd3-4e6f-8e42-2bbf0f07a3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:06.516174 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de320a0f-dbd3-4e6f-8e42-2bbf0f07a3c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:06.525983 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de320a0f-dbd3-4e6f-8e42-2bbf0f07a3c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:06.527554 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de320a0f-dbd3-4e6f-8e42-2bbf0f07a3c4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:06.545317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-de320a0f-dbd3-4e6f-8e42-2bbf0f07a3c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:19:06.545317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:06.545317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:06.545317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:06.545317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:06.545317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:06.545317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:06.545317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:06.545317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:06.545317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:06.545317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:06.545317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:06.545317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:19:06.545317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:19:06.545317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:19:06.547678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:19:06.547678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:06.547678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:06.547678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:06.547678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:06.547678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:06.547678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:06.547678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:06.547678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:06.547678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:06.547678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:06.547678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:06.547678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:06.547678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:06.547678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:06.547678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:06.547678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:06.549736 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:19:06.549736 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:19:06.549736 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:19:06.549736 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:19:06.549736 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:19:06.549736 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:19:06.549736 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:19:06.549736 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:19:06.551285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 613/1217] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:19:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:06.553204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead78d9a-5002-4a60-a454-93a40890ba08 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:06.779357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead78d9a-5002-4a60-a454-93a40890ba08 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:06.822462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:06.840817 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfc175-95eb-4996-bf69-3748cf44818f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:06.841569 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfc175-95eb-4996-bf69-3748cf44818f None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:06.841908 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfc175-95eb-4996-bf69-3748cf44818f None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:06.842158 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfc175-95eb-4996-bf69-3748cf44818f None admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:06.844881 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfc175-95eb-4996-bf69-3748cf44818f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:06.844881 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfc175-95eb-4996-bf69-3748cf44818f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:06.846510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfc175-95eb-4996-bf69-3748cf44818f None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:06.866717 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 605/1218] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:19:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:06.874178 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de320a0f-dbd3-4e6f-8e42-2bbf0f07a3c4 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:07.045790 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de320a0f-dbd3-4e6f-8e42-2bbf0f07a3c4 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:07.085390 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:07.099634 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64fe82d-0bc5-481e-bf49-bea2aa0db9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:07.101607 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fe82d-0bc5-481e-bf49-bea2aa0db9eb None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:07.102426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fe82d-0bc5-481e-bf49-bea2aa0db9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:07.102919 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fe82d-0bc5-481e-bf49-bea2aa0db9eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:07.104735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64fe82d-0bc5-481e-bf49-bea2aa0db9eb None admin] RBAC: Adding query filter params (role.id=e5d031634de14f1e86b912ddddfe7f8c, scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba, user.id=6f98c07455a241398784d221df273aba) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:07.105500 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64fe82d-0bc5-481e-bf49-bea2aa0db9eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:07.108717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64fe82d-0bc5-481e-bf49-bea2aa0db9eb None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:07.130173 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 614/1219] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:19:06 2022] GET /identity/v3/role_assignments?user.id=6f98c07455a241398784d221df273aba&scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba&role.id=e5d031634de14f1e86b912ddddfe7f8c => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:19:09.749927 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7cac4-9ca8-4974-a088-b6c87b65c0a7 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:09.750590 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7cac4-9ca8-4974-a088-b6c87b65c0a7 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:09.750590 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7cac4-9ca8-4974-a088-b6c87b65c0a7 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:09.751857 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 606/1220] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:19:09.758067 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f951c-6bca-4283-8427-108be3a6b5e5 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:09.758652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f951c-6bca-4283-8427-108be3a6b5e5 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:09.758652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f951c-6bca-4283-8427-108be3a6b5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:09.781961 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c90f951c-6bca-4283-8427-108be3a6b5e5 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:19:09.783665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c90f951c-6bca-4283-8427-108be3a6b5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:19:09.892412 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 615/1221] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:19:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:19:10.223186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7cac4-9ca8-4974-a088-b6c87b65c0a7 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:10.358321 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7cac4-9ca8-4974-a088-b6c87b65c0a7 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:10.410932 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fe520-e3a7-4f99-bf9d-94b61776f4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:10.411923 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fe520-e3a7-4f99-bf9d-94b61776f4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:10.413181 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fe520-e3a7-4f99-bf9d-94b61776f4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:10.413478 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fe520-e3a7-4f99-bf9d-94b61776f4a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:10.428293 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fe520-e3a7-4f99-bf9d-94b61776f4a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:19:10.433837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-2b7fe520-e3a7-4f99-bf9d-94b61776f4a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:19:10.433837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:10.433837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:10.433837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:10.433837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:10.433837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:10.433837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:10.433837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:10.433837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:10.433837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:10.433837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:10.433837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:10.433837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:19:10.433837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:19:10.433837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:19:10.433837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:19:10.435968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:19:10.435968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:19:10.435968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:19:10.435968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:19:10.435968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:10.435968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:10.435968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:10.435968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:10.435968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:10.435968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:10.435968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:10.435968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:10.435968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:10.435968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:10.435968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:10.435968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:10.438289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:10.438289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:10.438289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:10.438289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:10.438289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:19:10.438289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:19:10.438289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:19:10.438289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:19:10.438289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:19:10.438289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:19:10.438289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:19:10.438289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:19:10.442868 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 607/1222] 10.222.0.62 () {56 vars in 1102 bytes} [Tue Oct 4 14:19:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:10.444034 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f951c-6bca-4283-8427-108be3a6b5e5 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:10.593945 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f951c-6bca-4283-8427-108be3a6b5e5 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:10.634366 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:10.654155 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf8c5a-d53a-403f-b92c-8e33d49801d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:10.655156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf8c5a-d53a-403f-b92c-8e33d49801d6 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:10.655650 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf8c5a-d53a-403f-b92c-8e33d49801d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:10.656210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf8c5a-d53a-403f-b92c-8e33d49801d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:10.657489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf8c5a-d53a-403f-b92c-8e33d49801d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:10.658039 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf8c5a-d53a-403f-b92c-8e33d49801d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:10.661008 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf8c5a-d53a-403f-b92c-8e33d49801d6 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:10.676448 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 616/1223] 10.222.0.62 () {56 vars in 1103 bytes} [Tue Oct 4 14:19:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:19:10.684324 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fe520-e3a7-4f99-bf9d-94b61776f4a9 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:10.754079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:10.852548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fe520-e3a7-4f99-bf9d-94b61776f4a9 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:10.906575 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815244d7-6cab-4929-b158-827aa8e30600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:10.907380 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815244d7-6cab-4929-b158-827aa8e30600 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:10.907685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815244d7-6cab-4929-b158-827aa8e30600 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:10.907977 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815244d7-6cab-4929-b158-827aa8e30600 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:10.930428 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815244d7-6cab-4929-b158-827aa8e30600 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:10.932661 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815244d7-6cab-4929-b158-827aa8e30600 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:10.954076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-815244d7-6cab-4929-b158-827aa8e30600 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:19:10.954076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:10.954076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:10.954076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:10.954076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:10.954076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:10.954076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:10.954076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:10.954076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:10.954076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:10.954076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:10.954076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:10.954076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:19:10.954076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:19:10.954076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:19:10.954076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:19:10.956298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:10.956298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:10.956298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:10.956298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:10.956298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:10.956298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:10.956298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:10.956298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:10.956298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:10.956298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:10.956298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:10.956298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:10.956298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:10.956298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:10.956298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:10.956298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:10.956298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:19:10.957465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:19:10.957465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:19:10.957465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:19:10.957465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 608/1224] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:19:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:19:10.963383 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf8c5a-d53a-403f-b92c-8e33d49801d6 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:11.122130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf8c5a-d53a-403f-b92c-8e33d49801d6 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:11.166608 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aea8f8-6015-4a07-8a16-0f55649e339e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:11.167251 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aea8f8-6015-4a07-8a16-0f55649e339e None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:11.167752 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aea8f8-6015-4a07-8a16-0f55649e339e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:11.167918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aea8f8-6015-4a07-8a16-0f55649e339e None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:11.168558 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aea8f8-6015-4a07-8a16-0f55649e339e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:11.168916 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aea8f8-6015-4a07-8a16-0f55649e339e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:11.170450 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aea8f8-6015-4a07-8a16-0f55649e339e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:11.187219 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 617/1225] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:11.195188 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815244d7-6cab-4929-b158-827aa8e30600 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:11.349020 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:11.361072 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815244d7-6cab-4929-b158-827aa8e30600 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:11.414974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f9ab4-75e7-41a9-b3ae-eb58d6484a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:11.415980 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f9ab4-75e7-41a9-b3ae-eb58d6484a73 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:11.416425 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f9ab4-75e7-41a9-b3ae-eb58d6484a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:11.416958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f9ab4-75e7-41a9-b3ae-eb58d6484a73 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:11.429326 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f9ab4-75e7-41a9-b3ae-eb58d6484a73 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:11.431885 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f9ab4-75e7-41a9-b3ae-eb58d6484a73 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:11.448507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-e56f9ab4-75e7-41a9-b3ae-eb58d6484a73 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 14:19:11.448507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:11.448507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:11.448507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:11.448507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:11.448507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:11.448507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:11.448507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:11.448507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:11.448507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:11.448507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:11.448507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:11.448507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:19:11.448507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:19:11.448507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:19:11.448507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:19:11.450779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:11.450779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:11.450779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:19:11.450779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:19:11.450779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:19:11.450779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:19:11.450779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:11.450779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:11.450779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:11.450779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:11.450779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:11.450779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:11.450779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:11.450779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:11.450779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:11.450779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:11.450779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:11.450779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:11.452465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:11.452465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:11.452465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:19:11.452465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:19:11.452465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:19:11.452465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:19:11.452465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:19:11.452465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:19:11.452465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 14:19:11.452465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:19:11.452465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 609/1226] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:19:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:11.460106 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aea8f8-6015-4a07-8a16-0f55649e339e None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:11.527656 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:11.611122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aea8f8-6015-4a07-8a16-0f55649e339e None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:11.654243 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd62b64-c2d8-4ce7-a466-45aa376070cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:11.654920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd62b64-c2d8-4ce7-a466-45aa376070cf None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:11.655257 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd62b64-c2d8-4ce7-a466-45aa376070cf None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:11.655624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd62b64-c2d8-4ce7-a466-45aa376070cf None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:11.656534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd62b64-c2d8-4ce7-a466-45aa376070cf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:11.656846 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd62b64-c2d8-4ce7-a466-45aa376070cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:11.658465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd62b64-c2d8-4ce7-a466-45aa376070cf None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:11.687272 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 618/1227] 10.222.0.62 () {56 vars in 1143 bytes} [Tue Oct 4 14:19:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:11.689387 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f9ab4-75e7-41a9-b3ae-eb58d6484a73 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:11.840251 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f9ab4-75e7-41a9-b3ae-eb58d6484a73 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:11.888955 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cffb5-1847-4154-9023-c566207d8494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:11.889685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cffb5-1847-4154-9023-c566207d8494 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:11.889978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cffb5-1847-4154-9023-c566207d8494 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:11.890261 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cffb5-1847-4154-9023-c566207d8494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:11.907541 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cffb5-1847-4154-9023-c566207d8494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:11.909298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cffb5-1847-4154-9023-c566207d8494 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:11.927161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-b14cffb5-1847-4154-9023-c566207d8494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:19:11.927161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:11.927161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:11.927161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:11.927161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:11.927161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:11.927161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:11.927161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:11.927161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:11.927161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:11.927161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:11.927161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:11.927161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:19:11.927161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:19:11.927161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:19:11.927161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:19:11.928916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:11.928916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:11.928916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:11.928916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:11.928916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:11.928916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:11.928916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:11.928916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:11.928916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:11.928916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:11.928916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:11.928916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:11.928916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:11.928916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:11.928916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:11.928916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:11.928916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:19:11.929845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:19:11.929845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:19:11.929845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:19:11.929845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 610/1228] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:19:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:11.935557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd62b64-c2d8-4ce7-a466-45aa376070cf None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:12.092354 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd62b64-c2d8-4ce7-a466-45aa376070cf None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:12.097477 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:12.141754 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94db23-aab7-45a2-ab53-0ed070ad55a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:12.142392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94db23-aab7-45a2-ab53-0ed070ad55a4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:12.142675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94db23-aab7-45a2-ab53-0ed070ad55a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:12.143202 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94db23-aab7-45a2-ab53-0ed070ad55a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:12.143620 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb94db23-aab7-45a2-ab53-0ed070ad55a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:12.143999 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb94db23-aab7-45a2-ab53-0ed070ad55a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:12.145422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb94db23-aab7-45a2-ab53-0ed070ad55a4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:12.160183 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 619/1229] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:19:12.167059 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cffb5-1847-4154-9023-c566207d8494 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:12.177080 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:12.303999 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cffb5-1847-4154-9023-c566207d8494 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:12.360562 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8263f3e-68a0-4c4f-8cf7-f393632f06bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:12.361118 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8263f3e-68a0-4c4f-8cf7-f393632f06bb None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:12.361389 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8263f3e-68a0-4c4f-8cf7-f393632f06bb None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:12.361654 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8263f3e-68a0-4c4f-8cf7-f393632f06bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:12.375529 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8263f3e-68a0-4c4f-8cf7-f393632f06bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:12.377718 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8263f3e-68a0-4c4f-8cf7-f393632f06bb None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:12.400098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-c8263f3e-68a0-4c4f-8cf7-f393632f06bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:19:12.400098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:12.400098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:12.400098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:12.400098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:12.400098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:12.400098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:12.400098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:12.400098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:12.400098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:12.400098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:12.400098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:12.400098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:19:12.400098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:19:12.400098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:19:12.401352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:19:12.401352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:12.401352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:12.401352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:12.401352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:12.401352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:12.401352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:12.401352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:12.401352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:12.401352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:12.401352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:12.401352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:12.401352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:12.401352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:12.401352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:12.401352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:12.401352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:12.402291 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:19:12.402291 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:19:12.402291 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:19:12.402291 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:19:12.402291 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:19:12.402291 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:19:12.402291 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:19:12.402291 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:19:12.403055 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 611/1230] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:19:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:12.410827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94db23-aab7-45a2-ab53-0ed070ad55a4 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:12.566706 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94db23-aab7-45a2-ab53-0ed070ad55a4 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:12.614468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5d47d-579b-40e1-8a2a-901f59f4db4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:12.615056 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5d47d-579b-40e1-8a2a-901f59f4db4f None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:12.615961 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5d47d-579b-40e1-8a2a-901f59f4db4f None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:12.616726 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5d47d-579b-40e1-8a2a-901f59f4db4f None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:12.617099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5d47d-579b-40e1-8a2a-901f59f4db4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:12.617430 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5d47d-579b-40e1-8a2a-901f59f4db4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:12.619155 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5d47d-579b-40e1-8a2a-901f59f4db4f None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:12.641442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 620/1231] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:19:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:12.649087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8263f3e-68a0-4c4f-8cf7-f393632f06bb None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:12.748798 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:12.803432 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8263f3e-68a0-4c4f-8cf7-f393632f06bb None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:12.858775 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6ba33-0729-45c7-ad9e-80dfb8b98892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:12.859511 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6ba33-0729-45c7-ad9e-80dfb8b98892 None admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:12.859820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6ba33-0729-45c7-ad9e-80dfb8b98892 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:12.860087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6ba33-0729-45c7-ad9e-80dfb8b98892 None admin] PATH_INFO: `/v3/projects/fd73ece314ef4f2eabb34e2a88d610ba/users/6f98c07455a241398784d221df273aba/roles/e5d031634de14f1e86b912ddddfe7f8c` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:12.885474 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6ba33-0729-45c7-ad9e-80dfb8b98892 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd73ece314ef4f2eabb34e2a88d610ba, user_id=6f98c07455a241398784d221df273aba, role_id=e5d031634de14f1e86b912ddddfe7f8c)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:12.887255 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6ba33-0729-45c7-ad9e-80dfb8b98892 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:12.909367 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 612/1232] 10.222.0.62 () {58 vars in 1439 bytes} [Tue Oct 4 14:19:12 2022] PUT /identity/v3/projects/fd73ece314ef4f2eabb34e2a88d610ba/users/6f98c07455a241398784d221df273aba/roles/e5d031634de14f1e86b912ddddfe7f8c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:19:15.408489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813ba7e-deac-4e36-9bd4-016734cdaf02 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:15.409334 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813ba7e-deac-4e36-9bd4-016734cdaf02 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:15.409334 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813ba7e-deac-4e36-9bd4-016734cdaf02 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:15.410992 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 621/1233] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:19:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:19:15.417304 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dabdcf-012a-4a0d-940a-7168f5c9485a None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:15.417976 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dabdcf-012a-4a0d-940a-7168f5c9485a None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:15.417976 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dabdcf-012a-4a0d-940a-7168f5c9485a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:15.440075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-c4dabdcf-012a-4a0d-940a-7168f5c9485a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:19:15.441478 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-c4dabdcf-012a-4a0d-940a-7168f5c9485a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:19:15.544004 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 613/1234] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:19:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:19:15.823165 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813ba7e-deac-4e36-9bd4-016734cdaf02 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:15.855448 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:15.980136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813ba7e-deac-4e36-9bd4-016734cdaf02 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:16.034483 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908143cb-265e-4579-ae52-4d2f8b86f467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:16.035142 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908143cb-265e-4579-ae52-4d2f8b86f467 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:16.035409 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908143cb-265e-4579-ae52-4d2f8b86f467 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:16.035680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908143cb-265e-4579-ae52-4d2f8b86f467 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:16.050164 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908143cb-265e-4579-ae52-4d2f8b86f467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:19:16.057685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-908143cb-265e-4579-ae52-4d2f8b86f467 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:19:16.057685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:16.057685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:16.057685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:16.057685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:16.057685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:16.057685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:16.057685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:16.057685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:16.057685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:16.057685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:16.057685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:16.057685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:19:16.057685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:19:16.057685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:19:16.057685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:19:16.058971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:19:16.058971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:19:16.058971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:19:16.058971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:19:16.058971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:16.058971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:16.058971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:16.058971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:16.058971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:16.058971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:16.058971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:16.058971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:16.058971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:16.058971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:16.058971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:16.058971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:16.060022 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:16.060022 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:16.060022 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:16.060022 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:16.060022 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:19:16.060022 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:19:16.060022 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:19:16.060022 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:19:16.060022 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:19:16.060022 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:19:16.060022 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 14:19:16.060022 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:19:16.060022 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 622/1235] 10.222.0.62 () {56 vars in 1102 bytes} [Tue Oct 4 14:19:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:16.067352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dabdcf-012a-4a0d-940a-7168f5c9485a None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:16.143544 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:16.220259 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dabdcf-012a-4a0d-940a-7168f5c9485a None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:16.267702 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8967c5d-dae0-4347-a860-28d6a6aa6053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:16.268489 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8967c5d-dae0-4347-a860-28d6a6aa6053 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:16.268810 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8967c5d-dae0-4347-a860-28d6a6aa6053 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:16.269151 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8967c5d-dae0-4347-a860-28d6a6aa6053 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:16.269851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8967c5d-dae0-4347-a860-28d6a6aa6053 None admin] RBAC: Adding query filter params (name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:16.270165 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8967c5d-dae0-4347-a860-28d6a6aa6053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:16.273042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8967c5d-dae0-4347-a860-28d6a6aa6053 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:16.287881 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 614/1236] 10.222.0.62 () {56 vars in 1103 bytes} [Tue Oct 4 14:19:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:16.293994 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908143cb-265e-4579-ae52-4d2f8b86f467 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:16.417423 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:16.442495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908143cb-265e-4579-ae52-4d2f8b86f467 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:16.507022 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d253b-0c61-48f6-bda8-a14a40cad6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:16.508058 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d253b-0c61-48f6-bda8-a14a40cad6cd None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:16.508447 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d253b-0c61-48f6-bda8-a14a40cad6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:16.508809 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d253b-0c61-48f6-bda8-a14a40cad6cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:16.526570 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d253b-0c61-48f6-bda8-a14a40cad6cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:16.528340 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d253b-0c61-48f6-bda8-a14a40cad6cd None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:16.562016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-827d253b-0c61-48f6-bda8-a14a40cad6cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:19:16.562016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:16.562016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:16.562016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:16.562016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:16.562016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:16.562016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:16.562016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:16.562016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:16.562016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:16.562016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:16.562016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:16.562016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:19:16.562016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:19:16.562016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:19:16.562016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:19:16.563850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:16.563850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:16.563850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:16.563850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:16.563850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:16.563850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:16.563850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:16.563850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:16.563850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:16.563850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:16.563850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:16.563850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:16.563850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:16.563850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:16.563850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:16.563850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:16.563850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:19:16.565596 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:19:16.565596 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:19:16.565596 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:19:16.565596 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 623/1237] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:16.572729 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8967c5d-dae0-4347-a860-28d6a6aa6053 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:16.760121 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8967c5d-dae0-4347-a860-28d6a6aa6053 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:16.774561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:16.823935 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6c661-ef38-4597-b9d0-a57ec06d60ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:16.824873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6c661-ef38-4597-b9d0-a57ec06d60ed None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:16.825290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6c661-ef38-4597-b9d0-a57ec06d60ed None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:16.825707 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6c661-ef38-4597-b9d0-a57ec06d60ed None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:16.826727 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6c661-ef38-4597-b9d0-a57ec06d60ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:16.827200 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6c661-ef38-4597-b9d0-a57ec06d60ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:16.828817 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6c661-ef38-4597-b9d0-a57ec06d60ed None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:16.852048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 615/1238] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:16.861569 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d253b-0c61-48f6-bda8-a14a40cad6cd None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:17.037045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d253b-0c61-48f6-bda8-a14a40cad6cd None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:17.085746 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1009ad-221a-4c9d-bc25-af70c5d1d7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:17.086800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1009ad-221a-4c9d-bc25-af70c5d1d7ff None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:17.087220 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1009ad-221a-4c9d-bc25-af70c5d1d7ff None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:17.087574 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1009ad-221a-4c9d-bc25-af70c5d1d7ff None admin] PATH_INFO: `/v3/users/placement` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:17.092040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:17.102613 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1009ad-221a-4c9d-bc25-af70c5d1d7ff None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:17.105514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1009ad-221a-4c9d-bc25-af70c5d1d7ff None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:17.129429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-1e1009ad-221a-4c9d-bc25-af70c5d1d7ff None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 14:19:17.129429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:17.129429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:17.129429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:17.129429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:17.129429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:17.129429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:17.129429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:17.129429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:17.129429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:17.129429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:17.129429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:17.129429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:19:17.129429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:19:17.129429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:19:17.129429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:19:17.130672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:17.130672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:17.130672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:19:17.130672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:19:17.130672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:19:17.130672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:19:17.130672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:17.130672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:17.130672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:17.130672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:17.130672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:17.130672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:17.130672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:17.130672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:17.130672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:17.130672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:17.130672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:17.130672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:17.131879 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:17.131879 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:17.131879 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:19:17.131879 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:19:17.131879 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:19:17.131879 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:19:17.131879 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:19:17.131879 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:19:17.131879 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 14:19:17.131879 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:19:17.131879 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 624/1239] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:19:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:17.140816 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6c661-ef38-4597-b9d0-a57ec06d60ed None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:17.289290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6c661-ef38-4597-b9d0-a57ec06d60ed None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:17.332005 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63aa21-0c5f-47ee-a778-da0c787c25e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:17.332780 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63aa21-0c5f-47ee-a778-da0c787c25e4 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:17.333057 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63aa21-0c5f-47ee-a778-da0c787c25e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:17.333356 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63aa21-0c5f-47ee-a778-da0c787c25e4 None admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:17.334676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63aa21-0c5f-47ee-a778-da0c787c25e4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:17.335087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63aa21-0c5f-47ee-a778-da0c787c25e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:17.336954 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63aa21-0c5f-47ee-a778-da0c787c25e4 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:17.363816 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 616/1240] 10.222.0.62 () {56 vars in 1143 bytes} [Tue Oct 4 14:19:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:17.369283 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1009ad-221a-4c9d-bc25-af70c5d1d7ff None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:17.506828 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1009ad-221a-4c9d-bc25-af70c5d1d7ff None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:17.566477 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5769da8-d729-4394-a3bb-3e4e64a944d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:17.567113 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5769da8-d729-4394-a3bb-3e4e64a944d6 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:17.567391 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5769da8-d729-4394-a3bb-3e4e64a944d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:17.567688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5769da8-d729-4394-a3bb-3e4e64a944d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:17.646915 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:17.654884 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5769da8-d729-4394-a3bb-3e4e64a944d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:17.656491 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5769da8-d729-4394-a3bb-3e4e64a944d6 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:17.789675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 625/1241] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:19:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 14:19:17.795744 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63aa21-0c5f-47ee-a778-da0c787c25e4 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:17.830884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:17.936111 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63aa21-0c5f-47ee-a778-da0c787c25e4 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:17.994700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb75e0-28c5-4442-93a2-101d8587d51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:17.995356 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb75e0-28c5-4442-93a2-101d8587d51c None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:17.995637 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb75e0-28c5-4442-93a2-101d8587d51c None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:17.995944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb75e0-28c5-4442-93a2-101d8587d51c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:18.012603 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb75e0-28c5-4442-93a2-101d8587d51c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:18.014204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb75e0-28c5-4442-93a2-101d8587d51c None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:18.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-a5fb75e0-28c5-4442-93a2-101d8587d51c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:19:18.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:18.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:18.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:18.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:18.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:18.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:18.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:18.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:18.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:18.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:18.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:18.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:19:18.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:19:18.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:19:18.040905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:19:18.042946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:18.042946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:18.042946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:18.042946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:18.042946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:18.042946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:18.042946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:18.042946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:18.042946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:18.042946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:18.042946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:18.042946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:18.042946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:18.042946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:18.042946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:18.042946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:18.042946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:19:18.045015 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:19:18.045015 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:19:18.045015 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:19:18.047793 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 617/1242] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:18.052334 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5769da8-d729-4394-a3bb-3e4e64a944d6 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:18.183033 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:18.194805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5769da8-d729-4394-a3bb-3e4e64a944d6 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:18.247832 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e09bd-1d3e-4f64-88f0-ec924bba96e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:18.248580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e09bd-1d3e-4f64-88f0-ec924bba96e6 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:18.248794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e09bd-1d3e-4f64-88f0-ec924bba96e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:18.249015 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e09bd-1d3e-4f64-88f0-ec924bba96e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:18.249684 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e09bd-1d3e-4f64-88f0-ec924bba96e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:18.250026 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e09bd-1d3e-4f64-88f0-ec924bba96e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:18.251464 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e09bd-1d3e-4f64-88f0-ec924bba96e6 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:18.265614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 626/1243] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:19:18.275154 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb75e0-28c5-4442-93a2-101d8587d51c None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:18.411098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:18.449143 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb75e0-28c5-4442-93a2-101d8587d51c None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:18.510617 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce93b9-01ee-4254-abd7-932c4806a2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:18.511285 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce93b9-01ee-4254-abd7-932c4806a2fc None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:18.511625 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce93b9-01ee-4254-abd7-932c4806a2fc None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:18.511973 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce93b9-01ee-4254-abd7-932c4806a2fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:18.521576 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce93b9-01ee-4254-abd7-932c4806a2fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:18.523440 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce93b9-01ee-4254-abd7-932c4806a2fc None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:18.546079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-c6ce93b9-01ee-4254-abd7-932c4806a2fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:19:18.546079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:18.546079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:18.546079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:18.546079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:18.546079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:18.546079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:18.546079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:18.546079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:18.546079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:18.546079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:18.546079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:18.546079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:19:18.546079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:19:18.546079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:19:18.547242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:19:18.547242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:18.547242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:18.547242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:18.547242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:18.547242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:18.547242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:18.547242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:18.547242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:18.547242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:18.547242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:18.547242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:18.547242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:18.547242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:18.547242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:18.547242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:18.547242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:18.548376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:19:18.548376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:19:18.548376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:19:18.548376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:19:18.548376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:19:18.548376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:19:18.548376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:19:18.548376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:19:18.548376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 618/1244] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:19:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:18.558343 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e09bd-1d3e-4f64-88f0-ec924bba96e6 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:18.735668 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e09bd-1d3e-4f64-88f0-ec924bba96e6 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:18.784341 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb228d-c5e1-4d3c-ba33-719b144a34ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:18.784996 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb228d-c5e1-4d3c-ba33-719b144a34ce None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:18.785333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb228d-c5e1-4d3c-ba33-719b144a34ce None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:18.785604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb228d-c5e1-4d3c-ba33-719b144a34ce None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:18.786315 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb228d-c5e1-4d3c-ba33-719b144a34ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:18.786636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb228d-c5e1-4d3c-ba33-719b144a34ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:18.788491 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb228d-c5e1-4d3c-ba33-719b144a34ce None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:18.803311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 627/1245] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:19:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:18.810792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce93b9-01ee-4254-abd7-932c4806a2fc None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:18.981403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce93b9-01ee-4254-abd7-932c4806a2fc None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:19.061564 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac04b1-b467-4a91-8a03-4501ec1375ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:19.062373 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac04b1-b467-4a91-8a03-4501ec1375ed None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:19.063053 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac04b1-b467-4a91-8a03-4501ec1375ed None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:19.063549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac04b1-b467-4a91-8a03-4501ec1375ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:19.064923 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac04b1-b467-4a91-8a03-4501ec1375ed None admin] RBAC: Adding query filter params (role.id=e5d031634de14f1e86b912ddddfe7f8c, scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba, user.id=6f98c07455a241398784d221df273aba) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:19.065442 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac04b1-b467-4a91-8a03-4501ec1375ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:19.068182 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac04b1-b467-4a91-8a03-4501ec1375ed None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:19.078373 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 619/1246] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:19:18 2022] GET /identity/v3/role_assignments?user.id=6f98c07455a241398784d221df273aba&scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba&role.id=e5d031634de14f1e86b912ddddfe7f8c => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:21.893996 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07883443-e12b-44db-881a-2ec9091130c0 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:21.894808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07883443-e12b-44db-881a-2ec9091130c0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:21.894808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07883443-e12b-44db-881a-2ec9091130c0 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:21.896796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 628/1247] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:19:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:19:21.903495 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc8ca7-e698-470d-816b-61522f7b5670 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:21.904179 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc8ca7-e698-470d-816b-61522f7b5670 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:21.904179 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc8ca7-e698-470d-816b-61522f7b5670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:21.911035 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:21.928395 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-ebcc8ca7-e698-470d-816b-61522f7b5670 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:19:21.930333 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-ebcc8ca7-e698-470d-816b-61522f7b5670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:19:22.026815 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 620/1248] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:19:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:19:22.376998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07883443-e12b-44db-881a-2ec9091130c0 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:22.402431 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:22.544793 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07883443-e12b-44db-881a-2ec9091130c0 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:22.603452 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84147e6-ae70-48d6-b107-f2340969f6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:22.604222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84147e6-ae70-48d6-b107-f2340969f6e6 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:22.604476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84147e6-ae70-48d6-b107-f2340969f6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:22.604747 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84147e6-ae70-48d6-b107-f2340969f6e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:22.631626 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84147e6-ae70-48d6-b107-f2340969f6e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:19:22.643942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-d84147e6-ae70-48d6-b107-f2340969f6e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:19:22.643942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:22.643942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:22.643942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:22.643942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:22.643942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:22.643942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:22.643942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:22.643942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:22.643942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:22.643942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:22.643942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:22.643942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:19:22.643942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:19:22.643942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:19:22.643942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:19:22.646201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:19:22.646201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:19:22.646201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:19:22.646201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:19:22.646201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:22.646201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:22.646201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:22.646201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:22.646201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:22.646201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:22.646201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:22.646201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:22.646201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:22.646201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:22.646201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:22.646201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:22.648305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:22.648305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:22.648305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:22.648305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:22.648305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:19:22.648305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:19:22.648305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:19:22.648305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:19:22.648305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:19:22.648305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:19:22.648305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:19:22.648305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:19:22.652522 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 629/1249] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:19:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:22.664863 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc8ca7-e698-470d-816b-61522f7b5670 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:22.816549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc8ca7-e698-470d-816b-61522f7b5670 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:22.853775 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:22.859668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb41bc-af1e-4054-9329-1a54f676562a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:22.860305 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb41bc-af1e-4054-9329-1a54f676562a None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:22.860588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb41bc-af1e-4054-9329-1a54f676562a None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:22.860879 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb41bc-af1e-4054-9329-1a54f676562a None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:22.861647 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb41bc-af1e-4054-9329-1a54f676562a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:22.861971 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb41bc-af1e-4054-9329-1a54f676562a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:22.863626 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb41bc-af1e-4054-9329-1a54f676562a None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:22.874140 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 621/1250] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:19:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:22.882084 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84147e6-ae70-48d6-b107-f2340969f6e6 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:22.998045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:23.029127 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84147e6-ae70-48d6-b107-f2340969f6e6 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:23.079212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4ac23-dc3a-4035-9988-146f120495a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:23.080415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4ac23-dc3a-4035-9988-146f120495a3 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:23.080969 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4ac23-dc3a-4035-9988-146f120495a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:23.081554 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4ac23-dc3a-4035-9988-146f120495a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:23.105497 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4ac23-dc3a-4035-9988-146f120495a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:23.108186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4ac23-dc3a-4035-9988-146f120495a3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:23.130948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-b2d4ac23-dc3a-4035-9988-146f120495a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:19:23.130948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:23.130948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:23.130948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:23.130948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:23.130948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:23.130948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:23.130948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:23.130948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:23.130948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:23.130948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:23.130948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:23.130948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:19:23.130948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:19:23.130948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:19:23.130948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:19:23.139101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:23.139101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:23.139101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:23.139101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:23.139101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:23.139101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:23.139101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:23.139101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:23.139101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:23.139101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:23.139101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:23.139101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:23.139101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:23.139101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:23.139101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:23.139101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:23.139101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:19:23.140311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:19:23.140311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:19:23.140311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:19:23.140311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 630/1251] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:23.140585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb41bc-af1e-4054-9329-1a54f676562a None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:23.277551 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb41bc-af1e-4054-9329-1a54f676562a None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:23.328850 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a94605-c95b-4200-aac0-f1ff329c2055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:23.329664 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a94605-c95b-4200-aac0-f1ff329c2055 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:23.330006 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a94605-c95b-4200-aac0-f1ff329c2055 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:23.330283 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a94605-c95b-4200-aac0-f1ff329c2055 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:23.331038 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a94605-c95b-4200-aac0-f1ff329c2055 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:23.331640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a94605-c95b-4200-aac0-f1ff329c2055 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:23.333617 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a94605-c95b-4200-aac0-f1ff329c2055 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:23.354961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 622/1252] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:23.366935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4ac23-dc3a-4035-9988-146f120495a3 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:23.529873 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4ac23-dc3a-4035-9988-146f120495a3 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:23.575992 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:23.586627 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454a06f-1213-46a5-a267-de977eb4f6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:23.587290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454a06f-1213-46a5-a267-de977eb4f6b8 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:23.587569 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454a06f-1213-46a5-a267-de977eb4f6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:23.587879 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454a06f-1213-46a5-a267-de977eb4f6b8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:23.597897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454a06f-1213-46a5-a267-de977eb4f6b8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:23.600369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454a06f-1213-46a5-a267-de977eb4f6b8 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:23.617680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-2454a06f-1213-46a5-a267-de977eb4f6b8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 14:19:23.617680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:23.617680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:23.617680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:23.617680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:23.617680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:23.617680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:23.617680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:23.617680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:23.617680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:23.617680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:23.617680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:23.617680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:19:23.617680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:19:23.617680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:19:23.617680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:19:23.619799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:23.619799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:23.619799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:19:23.619799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:19:23.619799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:19:23.619799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:19:23.619799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:23.619799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:23.619799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:23.619799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:23.619799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:23.619799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:23.619799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:23.619799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:23.619799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:23.619799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:23.619799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:23.619799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:23.621761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:23.621761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:23.621761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:19:23.621761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:19:23.621761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:19:23.621761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:19:23.621761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:19:23.621761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:19:23.621761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 14:19:23.621761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:19:23.621761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 631/1253] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:19:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:23.626014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a94605-c95b-4200-aac0-f1ff329c2055 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:23.714140 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:23.782220 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a94605-c95b-4200-aac0-f1ff329c2055 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:23.826873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb78940-f285-42d3-afda-f5c0390dc8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:23.827510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb78940-f285-42d3-afda-f5c0390dc8ee None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:23.827853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb78940-f285-42d3-afda-f5c0390dc8ee None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:23.828174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb78940-f285-42d3-afda-f5c0390dc8ee None admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:23.828951 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb78940-f285-42d3-afda-f5c0390dc8ee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:23.829256 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb78940-f285-42d3-afda-f5c0390dc8ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:23.830730 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb78940-f285-42d3-afda-f5c0390dc8ee None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:23.854097 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 623/1254] 10.222.0.62 () {56 vars in 1143 bytes} [Tue Oct 4 14:19:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:19:23.860515 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454a06f-1213-46a5-a267-de977eb4f6b8 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:24.025175 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454a06f-1213-46a5-a267-de977eb4f6b8 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:24.081291 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa146a3e-945e-4a0a-9777-14a1dc5e7348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:24.082490 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa146a3e-945e-4a0a-9777-14a1dc5e7348 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:24.082969 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa146a3e-945e-4a0a-9777-14a1dc5e7348 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:24.083451 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa146a3e-945e-4a0a-9777-14a1dc5e7348 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:24.180251 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:24.197367 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa146a3e-945e-4a0a-9777-14a1dc5e7348 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:24.199101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa146a3e-945e-4a0a-9777-14a1dc5e7348 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:24.349958 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 632/1255] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:19:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 14:19:24.357820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb78940-f285-42d3-afda-f5c0390dc8ee None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:24.488954 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb78940-f285-42d3-afda-f5c0390dc8ee None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:24.508449 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:24.544118 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64cdca-4f9d-4cae-bd90-98992c0a46fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:24.544777 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64cdca-4f9d-4cae-bd90-98992c0a46fd None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:24.545054 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64cdca-4f9d-4cae-bd90-98992c0a46fd None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:24.545324 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64cdca-4f9d-4cae-bd90-98992c0a46fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:24.562987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64cdca-4f9d-4cae-bd90-98992c0a46fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:24.564608 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64cdca-4f9d-4cae-bd90-98992c0a46fd None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:24.581642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-bf64cdca-4f9d-4cae-bd90-98992c0a46fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:19:24.581642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:24.581642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:24.581642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:24.581642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:24.581642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:24.581642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:24.581642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:24.581642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:24.581642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:24.581642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:24.581642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:24.581642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:19:24.581642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:19:24.581642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:19:24.581642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:19:24.582832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:24.582832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:24.582832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:24.582832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:24.582832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:24.582832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:24.582832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:24.582832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:24.582832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:24.582832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:24.582832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:24.582832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:24.582832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:24.582832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:24.582832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:24.582832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:24.582832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:19:24.584572 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:19:24.584572 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:19:24.584572 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:19:24.584572 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 624/1256] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:19:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:19:24.590703 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa146a3e-945e-4a0a-9777-14a1dc5e7348 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:24.744961 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:24.765978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa146a3e-945e-4a0a-9777-14a1dc5e7348 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:24.821643 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85df6cc-90ff-4c3e-9d14-a2b9e1a02540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:24.822706 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85df6cc-90ff-4c3e-9d14-a2b9e1a02540 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:24.823080 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85df6cc-90ff-4c3e-9d14-a2b9e1a02540 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:24.823554 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85df6cc-90ff-4c3e-9d14-a2b9e1a02540 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:24.824493 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85df6cc-90ff-4c3e-9d14-a2b9e1a02540 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:24.824987 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85df6cc-90ff-4c3e-9d14-a2b9e1a02540 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:24.828408 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85df6cc-90ff-4c3e-9d14-a2b9e1a02540 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:24.848772 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 633/1257] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:24.855484 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64cdca-4f9d-4cae-bd90-98992c0a46fd None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:25.009054 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64cdca-4f9d-4cae-bd90-98992c0a46fd None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:25.051677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064bde3-d37f-4bab-b050-3f43e1455bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:25.052914 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064bde3-d37f-4bab-b050-3f43e1455bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:25.053217 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064bde3-d37f-4bab-b050-3f43e1455bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:25.053482 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064bde3-d37f-4bab-b050-3f43e1455bf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:25.061450 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064bde3-d37f-4bab-b050-3f43e1455bf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:25.063237 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064bde3-d37f-4bab-b050-3f43e1455bf3 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:25.075853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-d064bde3-d37f-4bab-b050-3f43e1455bf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:19:25.075853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:25.075853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:25.075853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:25.075853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:25.075853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:25.075853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:25.075853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:25.075853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:25.075853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:25.075853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:25.075853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:25.075853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:19:25.075853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:19:25.075853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:19:25.078022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:19:25.078022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:25.078022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:25.078022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:25.078022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:25.078022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:25.078022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:25.078022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:25.078022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:25.078022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:25.078022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:25.078022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:25.078022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:25.078022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:25.078022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:25.078022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:25.078022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:25.080050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:19:25.080050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:19:25.080050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:19:25.080050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:19:25.080050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:19:25.080050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:19:25.080050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:19:25.080050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:19:25.080050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 625/1258] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:19:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:25.084382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85df6cc-90ff-4c3e-9d14-a2b9e1a02540 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:25.280095 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85df6cc-90ff-4c3e-9d14-a2b9e1a02540 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:25.330903 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab69fe-33d1-4c2d-bfc8-b5a568d4d29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:25.331543 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab69fe-33d1-4c2d-bfc8-b5a568d4d29d None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:25.331868 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab69fe-33d1-4c2d-bfc8-b5a568d4d29d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:25.332142 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab69fe-33d1-4c2d-bfc8-b5a568d4d29d None admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:25.332888 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab69fe-33d1-4c2d-bfc8-b5a568d4d29d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:25.333193 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab69fe-33d1-4c2d-bfc8-b5a568d4d29d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:25.335592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab69fe-33d1-4c2d-bfc8-b5a568d4d29d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:25.352112 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 634/1259] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:19:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:25.358389 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064bde3-d37f-4bab-b050-3f43e1455bf3 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:25.405377 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:25.557862 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064bde3-d37f-4bab-b050-3f43e1455bf3 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:25.602849 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2897ede-f76f-4858-8aff-571d8164204c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:25.603483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2897ede-f76f-4858-8aff-571d8164204c None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:25.603792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2897ede-f76f-4858-8aff-571d8164204c None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:25.604073 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2897ede-f76f-4858-8aff-571d8164204c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:25.604847 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2897ede-f76f-4858-8aff-571d8164204c None admin] RBAC: Adding query filter params (role.id=a16b6daeda5b4a67992f3c12514ca90e, scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba, user.id=6f98c07455a241398784d221df273aba) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:25.605158 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2897ede-f76f-4858-8aff-571d8164204c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:25.606663 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2897ede-f76f-4858-8aff-571d8164204c None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:25.613529 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 626/1260] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:19:25 2022] GET /identity/v3/role_assignments?user.id=6f98c07455a241398784d221df273aba&scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba&role.id=a16b6daeda5b4a67992f3c12514ca90e => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:27.910794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414283e0-cafe-465c-8faa-2d347037770b None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:27.912165 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414283e0-cafe-465c-8faa-2d347037770b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:27.912165 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414283e0-cafe-465c-8faa-2d347037770b None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:27.913710 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 635/1261] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:19:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:19:27.919743 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbc029-c07f-47f9-ac2e-c736201f8631 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:27.920282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbc029-c07f-47f9-ac2e-c736201f8631 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:27.920282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbc029-c07f-47f9-ac2e-c736201f8631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:27.941481 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-adcbc029-c07f-47f9-ac2e-c736201f8631 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:19:27.942741 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-adcbc029-c07f-47f9-ac2e-c736201f8631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:19:28.025399 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 627/1262] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:19:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:19:28.342617 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414283e0-cafe-465c-8faa-2d347037770b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:28.355913 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:28.459509 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414283e0-cafe-465c-8faa-2d347037770b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:28.503578 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7cf32-0766-42ce-a3a2-4b650833da62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:28.504245 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7cf32-0766-42ce-a3a2-4b650833da62 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:28.504520 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7cf32-0766-42ce-a3a2-4b650833da62 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:28.504789 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7cf32-0766-42ce-a3a2-4b650833da62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:28.516850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7cf32-0766-42ce-a3a2-4b650833da62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:19:28.522321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-5cc7cf32-0766-42ce-a3a2-4b650833da62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:19:28.522321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:28.522321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:28.522321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:28.522321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:28.522321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:28.522321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:28.522321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:28.522321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:28.522321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:28.522321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:28.522321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:28.522321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:19:28.522321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:19:28.522321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:19:28.522321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:19:28.523541 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:19:28.523541 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:19:28.523541 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:19:28.523541 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:19:28.523541 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:28.523541 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:28.523541 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:28.523541 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:28.523541 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:28.523541 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:28.523541 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:28.523541 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:28.523541 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:28.523541 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:28.523541 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:28.523541 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:28.524691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:28.524691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:28.524691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:28.524691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:28.524691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:19:28.524691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:19:28.524691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:19:28.524691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:19:28.524691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:19:28.524691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:19:28.524691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:19:28.524691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:19:28.524691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 636/1263] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:19:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:28.533714 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbc029-c07f-47f9-ac2e-c736201f8631 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:28.561630 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:28.655115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbc029-c07f-47f9-ac2e-c736201f8631 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:28.696310 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90341aa7-c403-4dbe-b605-b03560ad63d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:28.696990 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90341aa7-c403-4dbe-b605-b03560ad63d5 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:28.697330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90341aa7-c403-4dbe-b605-b03560ad63d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:28.697674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90341aa7-c403-4dbe-b605-b03560ad63d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:28.698708 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90341aa7-c403-4dbe-b605-b03560ad63d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:28.699013 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90341aa7-c403-4dbe-b605-b03560ad63d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:28.700601 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90341aa7-c403-4dbe-b605-b03560ad63d5 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:28.712008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 628/1264] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:19:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:28.718551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7cf32-0766-42ce-a3a2-4b650833da62 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:28.798518 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:28.839081 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7cf32-0766-42ce-a3a2-4b650833da62 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:28.879364 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d8b73-9f12-4514-a365-672dbbb41393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:28.880026 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d8b73-9f12-4514-a365-672dbbb41393 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:28.880887 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d8b73-9f12-4514-a365-672dbbb41393 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:28.881153 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d8b73-9f12-4514-a365-672dbbb41393 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:28.892516 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d8b73-9f12-4514-a365-672dbbb41393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:28.893971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d8b73-9f12-4514-a365-672dbbb41393 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:28.909708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-607d8b73-9f12-4514-a365-672dbbb41393 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:19:28.909708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:28.909708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:28.909708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:28.909708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:28.909708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:28.909708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:28.909708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:28.909708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:28.909708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:28.909708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:28.909708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:28.909708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:19:28.909708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:19:28.909708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:19:28.909708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:19:28.910804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:28.910804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:28.910804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:28.910804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:28.910804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:28.910804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:28.910804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:28.910804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:28.910804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:28.910804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:28.910804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:28.910804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:28.910804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:28.910804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:28.910804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:28.910804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:28.910804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:19:28.912714 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:19:28.912714 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:19:28.912714 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:19:28.912714 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 637/1265] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:19:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:28.916947 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90341aa7-c403-4dbe-b605-b03560ad63d5 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:29.009253 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:29.033731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90341aa7-c403-4dbe-b605-b03560ad63d5 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:29.072196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce07e2c-960f-4307-b7f1-c6a733e1c158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:29.072819 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce07e2c-960f-4307-b7f1-c6a733e1c158 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:29.073107 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce07e2c-960f-4307-b7f1-c6a733e1c158 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:29.073379 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce07e2c-960f-4307-b7f1-c6a733e1c158 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:29.074038 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce07e2c-960f-4307-b7f1-c6a733e1c158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:29.074342 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce07e2c-960f-4307-b7f1-c6a733e1c158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:29.075784 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce07e2c-960f-4307-b7f1-c6a733e1c158 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:29.089567 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 629/1266] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:29.095486 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d8b73-9f12-4514-a365-672dbbb41393 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:29.208984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d8b73-9f12-4514-a365-672dbbb41393 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:29.231500 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:29.247341 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a03a8f-5c8c-464e-8134-5f2435df65c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:29.248008 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a03a8f-5c8c-464e-8134-5f2435df65c4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:29.248282 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a03a8f-5c8c-464e-8134-5f2435df65c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:29.248546 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a03a8f-5c8c-464e-8134-5f2435df65c4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:29.257662 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a03a8f-5c8c-464e-8134-5f2435df65c4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:29.259110 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a03a8f-5c8c-464e-8134-5f2435df65c4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:29.271027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-53a03a8f-5c8c-464e-8134-5f2435df65c4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 14:19:29.271027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:29.271027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:29.271027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:29.271027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:29.271027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:29.271027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:29.271027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:29.271027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:29.271027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:29.271027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:29.271027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:29.271027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:19:29.271027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:19:29.271027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:19:29.271027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:19:29.272738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:29.272738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:29.272738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:19:29.272738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:19:29.272738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:19:29.272738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:19:29.272738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:29.272738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:29.272738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:29.272738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:29.272738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:29.272738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:29.272738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:29.272738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:29.272738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:29.272738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:29.272738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:29.272738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:29.275139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:29.275139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:29.275139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:19:29.275139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:19:29.275139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:19:29.275139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:19:29.275139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:19:29.275139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:19:29.275139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 14:19:29.275139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:19:29.275139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 638/1267] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:19:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:29.278857 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce07e2c-960f-4307-b7f1-c6a733e1c158 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:29.398537 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce07e2c-960f-4307-b7f1-c6a733e1c158 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:29.437789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0226ba6-9fcf-49cf-9780-8f0c09aa0720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:29.438403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0226ba6-9fcf-49cf-9780-8f0c09aa0720 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:29.438673 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0226ba6-9fcf-49cf-9780-8f0c09aa0720 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:29.438980 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0226ba6-9fcf-49cf-9780-8f0c09aa0720 None admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:29.439679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0226ba6-9fcf-49cf-9780-8f0c09aa0720 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:29.440011 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0226ba6-9fcf-49cf-9780-8f0c09aa0720 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:29.441458 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0226ba6-9fcf-49cf-9780-8f0c09aa0720 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:29.451386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:29.461251 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 630/1268] 10.222.0.62 () {56 vars in 1143 bytes} [Tue Oct 4 14:19:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:29.467304 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a03a8f-5c8c-464e-8134-5f2435df65c4 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:29.576146 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a03a8f-5c8c-464e-8134-5f2435df65c4 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:29.610975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fe733-4750-448e-91dd-b925f1412741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:29.611608 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fe733-4750-448e-91dd-b925f1412741 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:29.611913 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fe733-4750-448e-91dd-b925f1412741 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:29.612183 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fe733-4750-448e-91dd-b925f1412741 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:29.624418 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186fe733-4750-448e-91dd-b925f1412741 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:29.625872 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186fe733-4750-448e-91dd-b925f1412741 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:29.640527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-186fe733-4750-448e-91dd-b925f1412741 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:19:29.640527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:29.640527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:29.640527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:29.640527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:29.640527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:29.640527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:29.640527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:29.640527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:29.640527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:29.640527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:29.640527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:29.640527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:19:29.640527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:19:29.640527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:19:29.640527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:19:29.641794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:29.641794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:29.641794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:29.641794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:29.641794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:29.641794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:29.641794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:29.641794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:29.641794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:29.641794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:29.641794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:29.641794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:29.641794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:29.641794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:29.641794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:29.641794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:29.641794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:19:29.642787 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:19:29.642787 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:19:29.642787 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:19:29.642787 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 639/1269] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:19:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:29.648529 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0226ba6-9fcf-49cf-9780-8f0c09aa0720 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:29.769822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0226ba6-9fcf-49cf-9780-8f0c09aa0720 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:29.809747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb60c2-93a4-40c6-a18a-208e53d094c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:29.810356 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb60c2-93a4-40c6-a18a-208e53d094c0 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:29.810630 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb60c2-93a4-40c6-a18a-208e53d094c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:29.810898 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb60c2-93a4-40c6-a18a-208e53d094c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:29.811537 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb60c2-93a4-40c6-a18a-208e53d094c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:29.811861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb60c2-93a4-40c6-a18a-208e53d094c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:29.813499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb60c2-93a4-40c6-a18a-208e53d094c0 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:29.825913 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 631/1270] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:29.832089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fe733-4750-448e-91dd-b925f1412741 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:29.866251 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:29.946062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fe733-4750-448e-91dd-b925f1412741 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:29.990490 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafb696-a1b4-4021-a443-c3540ab9debc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:29.991539 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafb696-a1b4-4021-a443-c3540ab9debc None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:29.992042 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafb696-a1b4-4021-a443-c3540ab9debc None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:29.992510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafb696-a1b4-4021-a443-c3540ab9debc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:30.004386 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddafb696-a1b4-4021-a443-c3540ab9debc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:30.008322 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddafb696-a1b4-4021-a443-c3540ab9debc None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:30.024269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-ddafb696-a1b4-4021-a443-c3540ab9debc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:19:30.024269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:30.024269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:30.024269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:30.024269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:30.024269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:30.024269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:30.024269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:30.024269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:30.024269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:30.024269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:30.024269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:30.024269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:19:30.024269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:19:30.024269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:19:30.025495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:19:30.025495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:30.025495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:30.025495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:30.025495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:30.025495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:30.025495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:30.025495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:30.025495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:30.025495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:30.025495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:30.025495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:30.025495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:30.025495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:30.025495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:30.025495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:30.025495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:30.026636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:19:30.026636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:19:30.026636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:19:30.026636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:19:30.026636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:19:30.026636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:19:30.026636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:19:30.026636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:19:30.026636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 640/1271] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:19:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:30.031817 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb60c2-93a4-40c6-a18a-208e53d094c0 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:30.096157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:30.142930 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb60c2-93a4-40c6-a18a-208e53d094c0 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:30.179591 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7398b-99ea-4532-b28d-7ba13c7de815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:30.180232 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7398b-99ea-4532-b28d-7ba13c7de815 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:30.180504 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7398b-99ea-4532-b28d-7ba13c7de815 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:30.180767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7398b-99ea-4532-b28d-7ba13c7de815 None admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:30.181457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7398b-99ea-4532-b28d-7ba13c7de815 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:30.181754 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7398b-99ea-4532-b28d-7ba13c7de815 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:30.183185 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7398b-99ea-4532-b28d-7ba13c7de815 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:30.198651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 632/1272] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:19:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:30.204906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafb696-a1b4-4021-a443-c3540ab9debc None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:30.314308 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:30.323700 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafb696-a1b4-4021-a443-c3540ab9debc None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:30.357913 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f997a9-2b85-47de-bf2d-867c53efee8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:30.358606 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f997a9-2b85-47de-bf2d-867c53efee8d None admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:30.358969 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f997a9-2b85-47de-bf2d-867c53efee8d None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:30.359240 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f997a9-2b85-47de-bf2d-867c53efee8d None admin] PATH_INFO: `/v3/projects/fd73ece314ef4f2eabb34e2a88d610ba/users/6f98c07455a241398784d221df273aba/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:30.361236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f997a9-2b85-47de-bf2d-867c53efee8d None admin] RBAC: Authorizing `identity:create_grant(project_id=fd73ece314ef4f2eabb34e2a88d610ba, user_id=6f98c07455a241398784d221df273aba, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:30.362752 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f997a9-2b85-47de-bf2d-867c53efee8d None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:30.378466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 641/1273] 10.222.0.62 () {58 vars in 1439 bytes} [Tue Oct 4 14:19:30 2022] PUT /identity/v3/projects/fd73ece314ef4f2eabb34e2a88d610ba/users/6f98c07455a241398784d221df273aba/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:19:32.644499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46203f-aeaa-4340-986a-e3a56e3dfc60 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:32.645073 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46203f-aeaa-4340-986a-e3a56e3dfc60 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:32.645268 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46203f-aeaa-4340-986a-e3a56e3dfc60 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:32.650471 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 633/1274] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:19:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:19:32.658249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520684fb-b254-4d5d-a7ed-65940eee5e2a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:32.658849 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520684fb-b254-4d5d-a7ed-65940eee5e2a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:32.658849 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520684fb-b254-4d5d-a7ed-65940eee5e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:32.678984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-520684fb-b254-4d5d-a7ed-65940eee5e2a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:19:32.680241 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-520684fb-b254-4d5d-a7ed-65940eee5e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:19:32.795923 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 642/1275] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:19:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:19:33.072973 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46203f-aeaa-4340-986a-e3a56e3dfc60 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:33.210141 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46203f-aeaa-4340-986a-e3a56e3dfc60 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:33.229855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:33.254807 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984af2ad-6501-48ce-9f8d-23b24026e1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:33.255445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984af2ad-6501-48ce-9f8d-23b24026e1ab None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:33.255750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984af2ad-6501-48ce-9f8d-23b24026e1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:33.256002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984af2ad-6501-48ce-9f8d-23b24026e1ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:33.267372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984af2ad-6501-48ce-9f8d-23b24026e1ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 14:19:33.272418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-984af2ad-6501-48ce-9f8d-23b24026e1ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:19:33.272418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:33.272418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:33.272418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:33.272418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:33.272418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:33.272418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:33.272418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:33.272418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:33.272418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:33.272418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:33.272418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:33.272418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 14:19:33.272418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 14:19:33.272418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 14:19:33.272418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 14:19:33.273685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 14:19:33.273685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 14:19:33.273685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 14:19:33.273685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 14:19:33.273685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:33.273685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:33.273685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:33.273685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:33.273685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:33.273685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:33.273685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:33.273685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:33.273685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:33.273685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:33.273685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:33.273685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:33.275791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:33.275791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:33.275791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:33.275791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:33.275791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 14:19:33.275791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 14:19:33.275791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 14:19:33.275791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 14:19:33.275791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 14:19:33.275791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 14:19:33.275791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 14:19:33.275791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:19:33.275791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 634/1276] 10.222.0.62 () {56 vars in 1096 bytes} [Tue Oct 4 14:19:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:33.283332 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520684fb-b254-4d5d-a7ed-65940eee5e2a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:33.379442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:33.415917 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520684fb-b254-4d5d-a7ed-65940eee5e2a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:33.467827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07fa31-4062-4d60-bef2-2f5a2da26f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:33.468463 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07fa31-4062-4d60-bef2-2f5a2da26f56 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:33.468742 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07fa31-4062-4d60-bef2-2f5a2da26f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:33.469012 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07fa31-4062-4d60-bef2-2f5a2da26f56 None admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:33.469701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07fa31-4062-4d60-bef2-2f5a2da26f56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:33.470004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07fa31-4062-4d60-bef2-2f5a2da26f56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:33.471400 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07fa31-4062-4d60-bef2-2f5a2da26f56 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:33.482053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 643/1277] 10.222.0.62 () {56 vars in 1099 bytes} [Tue Oct 4 14:19:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:19:33.492312 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984af2ad-6501-48ce-9f8d-23b24026e1ab None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:33.612776 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984af2ad-6501-48ce-9f8d-23b24026e1ab None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:33.652732 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04025eb0-9238-4ab3-97f1-322a273cecea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:33.653524 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04025eb0-9238-4ab3-97f1-322a273cecea None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:33.653524 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04025eb0-9238-4ab3-97f1-322a273cecea None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:33.653791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04025eb0-9238-4ab3-97f1-322a273cecea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:33.666042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04025eb0-9238-4ab3-97f1-322a273cecea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:33.667510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04025eb0-9238-4ab3-97f1-322a273cecea None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:33.685178 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-04025eb0-9238-4ab3-97f1-322a273cecea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:19:33.685178 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:33.685178 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:33.685178 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:33.685178 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:33.685178 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:33.685178 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:33.685178 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:33.685178 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:33.685178 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:33.685178 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:33.685178 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:33.685178 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:19:33.685178 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:19:33.685178 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:19:33.685178 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:19:33.686357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:33.686357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:33.686357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:33.686357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:33.686357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:33.686357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:33.686357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:33.686357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:33.686357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:33.686357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:33.686357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:33.686357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:33.686357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:33.686357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:33.686357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:33.686357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:33.686357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:19:33.688491 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:19:33.688491 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:19:33.688491 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:19:33.688491 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 635/1278] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:19:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:33.697608 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07fa31-4062-4d60-bef2-2f5a2da26f56 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:33.816876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07fa31-4062-4d60-bef2-2f5a2da26f56 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:33.857543 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed913d45-ff07-4cdf-8894-b7d8e3cfe4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:33.858170 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed913d45-ff07-4cdf-8894-b7d8e3cfe4f4 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:33.858451 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed913d45-ff07-4cdf-8894-b7d8e3cfe4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:33.858721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed913d45-ff07-4cdf-8894-b7d8e3cfe4f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:33.859381 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed913d45-ff07-4cdf-8894-b7d8e3cfe4f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:33.859680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed913d45-ff07-4cdf-8894-b7d8e3cfe4f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:33.861106 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed913d45-ff07-4cdf-8894-b7d8e3cfe4f4 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:33.874316 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 644/1279] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:33.884265 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04025eb0-9238-4ab3-97f1-322a273cecea None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:33.940713 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:34.021470 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04025eb0-9238-4ab3-97f1-322a273cecea None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:34.062702 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d1a25-224c-4d09-a5f2-a6334b794b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:34.063352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d1a25-224c-4d09-a5f2-a6334b794b4c None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:34.063629 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d1a25-224c-4d09-a5f2-a6334b794b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:34.063929 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d1a25-224c-4d09-a5f2-a6334b794b4c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:34.073590 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d1a25-224c-4d09-a5f2-a6334b794b4c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:34.075068 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d1a25-224c-4d09-a5f2-a6334b794b4c None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:34.088369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-ee7d1a25-224c-4d09-a5f2-a6334b794b4c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 14:19:34.088369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:34.088369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:34.088369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:34.088369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:34.088369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:34.088369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:34.088369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:34.088369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:34.088369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:34.088369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:34.088369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:34.088369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 14:19:34.088369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 14:19:34.088369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 14:19:34.088369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 14:19:34.090288 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:34.090288 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:34.090288 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 14:19:34.090288 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:19:34.090288 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 14:19:34.090288 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 14:19:34.090288 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:34.090288 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:34.090288 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:34.090288 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:34.090288 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:34.090288 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:34.090288 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:34.090288 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:34.090288 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:34.090288 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:34.090288 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:34.090288 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:34.092361 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:34.092361 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:34.092361 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 14:19:34.092361 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 14:19:34.092361 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 14:19:34.092361 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 14:19:34.092361 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 14:19:34.092361 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 14:19:34.092361 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 14:19:34.092361 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:19:34.092361 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 636/1280] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:19:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:34.095829 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed913d45-ff07-4cdf-8894-b7d8e3cfe4f4 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:34.100642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:34.216825 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed913d45-ff07-4cdf-8894-b7d8e3cfe4f4 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:34.253417 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec8d76-9ba8-4f69-922c-37faac801721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:34.254041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec8d76-9ba8-4f69-922c-37faac801721 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:34.254318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec8d76-9ba8-4f69-922c-37faac801721 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:34.254588 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec8d76-9ba8-4f69-922c-37faac801721 None admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:34.255396 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec8d76-9ba8-4f69-922c-37faac801721 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:34.255701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec8d76-9ba8-4f69-922c-37faac801721 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:34.257189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec8d76-9ba8-4f69-922c-37faac801721 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:34.277412 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 645/1281] 10.222.0.62 () {56 vars in 1143 bytes} [Tue Oct 4 14:19:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:34.283840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d1a25-224c-4d09-a5f2-a6334b794b4c None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:34.386518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:34.403045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d1a25-224c-4d09-a5f2-a6334b794b4c None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:34.446276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11a293-3345-4df5-92e5-68a35ff9c05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:34.446879 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11a293-3345-4df5-92e5-68a35ff9c05e None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:34.447152 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11a293-3345-4df5-92e5-68a35ff9c05e None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:34.447417 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11a293-3345-4df5-92e5-68a35ff9c05e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:34.523144 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11a293-3345-4df5-92e5-68a35ff9c05e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:34.524874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11a293-3345-4df5-92e5-68a35ff9c05e None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:34.628331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:34.640147 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 637/1282] 10.222.0.62 () {58 vars in 1282 bytes} [Tue Oct 4 14:19:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 14:19:34.647689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec8d76-9ba8-4f69-922c-37faac801721 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:34.733421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:34.792738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec8d76-9ba8-4f69-922c-37faac801721 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:34.862699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85116587-9e80-4f1b-9c44-43ab39f38ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:34.863355 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85116587-9e80-4f1b-9c44-43ab39f38ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:34.863631 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85116587-9e80-4f1b-9c44-43ab39f38ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:34.863932 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85116587-9e80-4f1b-9c44-43ab39f38ca3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:34.877040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85116587-9e80-4f1b-9c44-43ab39f38ca3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:34.878507 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85116587-9e80-4f1b-9c44-43ab39f38ca3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:34.895521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-85116587-9e80-4f1b-9c44-43ab39f38ca3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:19:34.895521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:34.895521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:34.895521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:34.895521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:34.895521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:34.895521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:34.895521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:34.895521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:34.895521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:34.895521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:34.895521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:34.895521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 14:19:34.895521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 14:19:34.895521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 14:19:34.895521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 14:19:34.896920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:34.896920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:34.896920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:34.896920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:34.896920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:34.896920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:34.896920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:34.896920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:34.896920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:34.896920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:34.896920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:34.896920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:34.896920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:34.896920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:34.896920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:34.896920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:34.896920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 14:19:34.898047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 14:19:34.898047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 14:19:34.898047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:19:34.898047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 646/1283] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 14:19:34.906089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11a293-3345-4df5-92e5-68a35ff9c05e None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:35.015732 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11a293-3345-4df5-92e5-68a35ff9c05e None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:35.055980 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bb457-790d-4d45-8c62-2552cbc79805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:35.056638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bb457-790d-4d45-8c62-2552cbc79805 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:35.056792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bb457-790d-4d45-8c62-2552cbc79805 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:35.057061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bb457-790d-4d45-8c62-2552cbc79805 None admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:35.057711 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bb457-790d-4d45-8c62-2552cbc79805 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:35.058011 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bb457-790d-4d45-8c62-2552cbc79805 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:35.059402 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bb457-790d-4d45-8c62-2552cbc79805 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:35.072492 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 638/1284] 10.222.0.62 () {56 vars in 1109 bytes} [Tue Oct 4 14:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:35.079863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85116587-9e80-4f1b-9c44-43ab39f38ca3 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:35.222602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85116587-9e80-4f1b-9c44-43ab39f38ca3 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:35.240162 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:35.273620 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105adca3-8ed3-4167-8659-97197665dc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:35.274278 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105adca3-8ed3-4167-8659-97197665dc05 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:35.274555 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105adca3-8ed3-4167-8659-97197665dc05 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:35.274834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105adca3-8ed3-4167-8659-97197665dc05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:35.282421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105adca3-8ed3-4167-8659-97197665dc05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:35.283907 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105adca3-8ed3-4167-8659-97197665dc05 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:35.296934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application [None req-105adca3-8ed3-4167-8659-97197665dc05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:19:35.296934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:35.296934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:35.296934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:35.296934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:35.296934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:35.296934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:35.296934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:35.296934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:35.296934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:35.296934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:35.296934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:35.296934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 14:19:35.296934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 14:19:35.296934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 14:19:35.298158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 14:19:35.298158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:35.298158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:35.298158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:35.298158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:35.298158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:35.298158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:35.298158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:35.298158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:35.298158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:35.298158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:35.298158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:35.298158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:35.298158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:35.298158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:35.298158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:35.298158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:35.299440 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 14:19:35.299440 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 14:19:35.299440 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 14:19:35.299440 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 14:19:35.299440 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 14:19:35.299440 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 14:19:35.299440 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 14:19:35.299440 dv-cinder-860260-1-smb devstack@keystone.service[81467]: ERROR keystone.server.flask.application Oct 04 14:19:35.299440 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 647/1285] 10.222.0.62 () {56 vars in 1111 bytes} [Tue Oct 4 14:19:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:35.305012 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bb457-790d-4d45-8c62-2552cbc79805 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:35.358335 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:35.411952 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bb457-790d-4d45-8c62-2552cbc79805 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:35.446779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02348ebf-c944-4ac9-9159-b5b12b636d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:35.447379 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02348ebf-c944-4ac9-9159-b5b12b636d55 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:35.447653 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02348ebf-c944-4ac9-9159-b5b12b636d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:35.447949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02348ebf-c944-4ac9-9159-b5b12b636d55 None admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:35.448629 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02348ebf-c944-4ac9-9159-b5b12b636d55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:35.448926 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02348ebf-c944-4ac9-9159-b5b12b636d55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:35.450358 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02348ebf-c944-4ac9-9159-b5b12b636d55 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:35.463200 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 639/1286] 10.222.0.62 () {56 vars in 1148 bytes} [Tue Oct 4 14:19:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:35.469451 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105adca3-8ed3-4167-8659-97197665dc05 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:35.584344 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105adca3-8ed3-4167-8659-97197665dc05 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:35.623921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33dc4d-bf8c-4059-888b-ca959228d068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:35.624460 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33dc4d-bf8c-4059-888b-ca959228d068 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:35.624738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33dc4d-bf8c-4059-888b-ca959228d068 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:35.625010 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33dc4d-bf8c-4059-888b-ca959228d068 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:35.625757 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33dc4d-bf8c-4059-888b-ca959228d068 None admin] RBAC: Adding query filter params (role.id=a16b6daeda5b4a67992f3c12514ca90e, scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba, user.id=6f98c07455a241398784d221df273aba) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:35.626064 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33dc4d-bf8c-4059-888b-ca959228d068 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:35.627523 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33dc4d-bf8c-4059-888b-ca959228d068 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:35.634369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 648/1287] 10.222.0.62 () {56 vars in 1374 bytes} [Tue Oct 4 14:19:35 2022] GET /identity/v3/role_assignments?user.id=6f98c07455a241398784d221df273aba&scope.project.id=fd73ece314ef4f2eabb34e2a88d610ba&role.id=a16b6daeda5b4a67992f3c12514ca90e => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:38.080537 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aca6ad-ad0a-47b0-9df1-4fccb02cc10e None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:38.081109 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aca6ad-ad0a-47b0-9df1-4fccb02cc10e None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:38.081109 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aca6ad-ad0a-47b0-9df1-4fccb02cc10e None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:38.082426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 640/1288] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:19:38.089200 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad166cf5-2e78-4e12-8783-2f8cb8f0c26a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:38.089740 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad166cf5-2e78-4e12-8783-2f8cb8f0c26a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:38.089740 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad166cf5-2e78-4e12-8783-2f8cb8f0c26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:38.110578 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ad166cf5-2e78-4e12-8783-2f8cb8f0c26a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:19:38.111880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ad166cf5-2e78-4e12-8783-2f8cb8f0c26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:19:38.144251 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:38.186855 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 649/1289] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:19:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:19:38.467101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aca6ad-ad0a-47b0-9df1-4fccb02cc10e None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:38.586381 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aca6ad-ad0a-47b0-9df1-4fccb02cc10e None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:38.599606 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:38.627426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17637047-9fd2-485d-b050-ec882303d5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:38.628179 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17637047-9fd2-485d-b050-ec882303d5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:38.628501 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17637047-9fd2-485d-b050-ec882303d5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:38.628816 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17637047-9fd2-485d-b050-ec882303d5e4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:38.629453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17637047-9fd2-485d-b050-ec882303d5e4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:38.631008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17637047-9fd2-485d-b050-ec882303d5e4 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:38.641749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-17637047-9fd2-485d-b050-ec882303d5e4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 14:19:38.641749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:38.641749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:19:38.641749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:19:38.641749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:19:38.641749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:19:38.641749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:19:38.641749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:19:38.641749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 14:19:38.641749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:19:38.641749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:19:38.641749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:19:38.641749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:38.641749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:38.641749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:38.641749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:38.641749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:38.643119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:38.643119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:38.643119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:38.643119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:38.643119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:38.643119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:38.643119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:19:38.643119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:19:38.643119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:19:38.643119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:19:38.643119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:38.643119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:38.643119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:38.643119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:38.643119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:38.643119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:38.644194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:38.644194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:38.644194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:38.644194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:38.644194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:38.644194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:38.644194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:38.644194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:38.644194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:38.644194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:38.644194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:19:38.644194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:19:38.644194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 14:19:38.644194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:19:38.644194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 641/1290] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Oct 4 14:19:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:38.652179 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad166cf5-2e78-4e12-8783-2f8cb8f0c26a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:38.796049 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad166cf5-2e78-4e12-8783-2f8cb8f0c26a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:38.835513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f02c2c-a77c-45a8-a09a-f69acbafa874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:38.836171 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f02c2c-a77c-45a8-a09a-f69acbafa874 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:38.836444 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f02c2c-a77c-45a8-a09a-f69acbafa874 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:38.836710 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f02c2c-a77c-45a8-a09a-f69acbafa874 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:38.837356 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f02c2c-a77c-45a8-a09a-f69acbafa874 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:38.837655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f02c2c-a77c-45a8-a09a-f69acbafa874 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:38.839038 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f02c2c-a77c-45a8-a09a-f69acbafa874 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:38.844734 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 650/1291] 10.222.0.62 () {56 vars in 1116 bytes} [Tue Oct 4 14:19:38 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:38.850823 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17637047-9fd2-485d-b050-ec882303d5e4 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:38.968108 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17637047-9fd2-485d-b050-ec882303d5e4 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:39.006822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea81b2-0401-413e-9f7d-7d3a9e39b255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:39.007433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea81b2-0401-413e-9f7d-7d3a9e39b255 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:39.007732 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea81b2-0401-413e-9f7d-7d3a9e39b255 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:39.008002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea81b2-0401-413e-9f7d-7d3a9e39b255 None admin] PATH_INFO: `/v3/services` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:39.008643 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea81b2-0401-413e-9f7d-7d3a9e39b255 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:39.008939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea81b2-0401-413e-9f7d-7d3a9e39b255 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:39.010335 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea81b2-0401-413e-9f7d-7d3a9e39b255 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:39.015584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 642/1292] 10.222.0.62 () {56 vars in 1116 bytes} [Tue Oct 4 14:19:38 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:41.298476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca8bf0-be2f-4e17-ae2c-fc26ce833ea7 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:41.299120 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca8bf0-be2f-4e17-ae2c-fc26ce833ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:41.299120 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca8bf0-be2f-4e17-ae2c-fc26ce833ea7 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:41.300432 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 651/1293] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:19:41.307827 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a0110-7b9d-47b4-b2ff-df91867e2c13 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:41.308390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a0110-7b9d-47b4-b2ff-df91867e2c13 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:41.308390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a0110-7b9d-47b4-b2ff-df91867e2c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:41.328717 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-a74a0110-7b9d-47b4-b2ff-df91867e2c13 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:19:41.329954 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a74a0110-7b9d-47b4-b2ff-df91867e2c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:19:41.366218 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:41.411762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 643/1294] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:19:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 14:19:41.685844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca8bf0-be2f-4e17-ae2c-fc26ce833ea7 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:41.726085 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:41.803486 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca8bf0-be2f-4e17-ae2c-fc26ce833ea7 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:41.840056 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94345ecf-0a56-4e2d-8e3a-5c5d6fbdb61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:41.840575 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94345ecf-0a56-4e2d-8e3a-5c5d6fbdb61e None admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:41.840849 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94345ecf-0a56-4e2d-8e3a-5c5d6fbdb61e None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:41.841106 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94345ecf-0a56-4e2d-8e3a-5c5d6fbdb61e None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:41.841763 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94345ecf-0a56-4e2d-8e3a-5c5d6fbdb61e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:41.843106 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94345ecf-0a56-4e2d-8e3a-5c5d6fbdb61e None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:41.858335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 652/1295] 10.222.0.62 () {60 vars in 1141 bytes} [Tue Oct 4 14:19:41 2022] POST /identity/v3/services => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:19:44.170801 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af80a5-09ef-44fe-a090-8e842eb69c6e None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:44.171490 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af80a5-09ef-44fe-a090-8e842eb69c6e None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:44.171490 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af80a5-09ef-44fe-a090-8e842eb69c6e None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:44.172752 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 644/1296] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:19:44.179222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949af15-c09d-475c-9103-a128b1d0ec57 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:44.179832 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949af15-c09d-475c-9103-a128b1d0ec57 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:44.179832 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949af15-c09d-475c-9103-a128b1d0ec57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:44.199430 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-9949af15-c09d-475c-9103-a128b1d0ec57 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:19:44.200662 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9949af15-c09d-475c-9103-a128b1d0ec57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:19:44.282785 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 653/1297] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:19:44 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 14:19:44.567665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af80a5-09ef-44fe-a090-8e842eb69c6e None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:44.680556 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af80a5-09ef-44fe-a090-8e842eb69c6e None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:44.719611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ac846-6282-4e6c-84e7-1ae262a92afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:44.720359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ac846-6282-4e6c-84e7-1ae262a92afd None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:44.720681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ac846-6282-4e6c-84e7-1ae262a92afd None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:44.720999 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ac846-6282-4e6c-84e7-1ae262a92afd None admin] PATH_INFO: `/v3/services/placement` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:44.721644 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ac846-6282-4e6c-84e7-1ae262a92afd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:44.723110 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ac846-6282-4e6c-84e7-1ae262a92afd None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:44.734119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-d95ac846-6282-4e6c-84e7-1ae262a92afd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 14:19:44.734119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:44.734119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:19:44.734119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:19:44.734119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:19:44.734119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:19:44.734119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:19:44.734119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:19:44.734119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 14:19:44.734119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:19:44.734119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:19:44.734119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:19:44.734119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:44.734119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:44.734119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:44.734119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:44.734119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:44.735946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:44.735946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:44.735946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:44.735946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:44.735946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:44.735946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:44.735946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:19:44.735946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:19:44.735946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:19:44.735946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:19:44.735946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:44.735946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:44.735946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:44.735946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:44.735946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:44.735946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:44.736966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:44.736966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:44.736966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:44.736966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:44.736966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:44.736966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:44.736966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:44.736966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:44.736966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:44.736966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:44.736966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:19:44.736966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:19:44.736966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 14:19:44.736966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:19:44.736966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 645/1298] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Oct 4 14:19:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:44.744614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949af15-c09d-475c-9103-a128b1d0ec57 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:44.765694 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:44.856394 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949af15-c09d-475c-9103-a128b1d0ec57 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:44.894695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc455f6-59e0-40c7-8544-d06bc79ee9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:44.896209 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc455f6-59e0-40c7-8544-d06bc79ee9f3 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:44.896482 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc455f6-59e0-40c7-8544-d06bc79ee9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:44.896747 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc455f6-59e0-40c7-8544-d06bc79ee9f3 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:44.897394 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc455f6-59e0-40c7-8544-d06bc79ee9f3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:44.897693 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc455f6-59e0-40c7-8544-d06bc79ee9f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:44.899094 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc455f6-59e0-40c7-8544-d06bc79ee9f3 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:44.905034 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 654/1299] 10.222.0.62 () {56 vars in 1116 bytes} [Tue Oct 4 14:19:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:19:44.911745 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ac846-6282-4e6c-84e7-1ae262a92afd None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:44.969226 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:45.082501 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ac846-6282-4e6c-84e7-1ae262a92afd None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:45.123581 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a3738-38c4-4cc8-887f-0931f5ddaa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:45.124156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a3738-38c4-4cc8-887f-0931f5ddaa1e None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:45.124431 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a3738-38c4-4cc8-887f-0931f5ddaa1e None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:45.124703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a3738-38c4-4cc8-887f-0931f5ddaa1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:45.125455 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a3738-38c4-4cc8-887f-0931f5ddaa1e None admin] RBAC: Adding query filter params (interface=public, service_id=9a67dc09385540989eff08035fb8671a, region_id=RegionOne) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:45.125764 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a3738-38c4-4cc8-887f-0931f5ddaa1e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:45.127199 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a3738-38c4-4cc8-887f-0931f5ddaa1e None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:45.133712 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 646/1300] 10.222.0.62 () {56 vars in 1251 bytes} [Tue Oct 4 14:19:44 2022] GET /identity/v3/endpoints?service_id=9a67dc09385540989eff08035fb8671a&interface=public®ion_id=RegionOne => generated 194 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:19:45.139744 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc455f6-59e0-40c7-8544-d06bc79ee9f3 None admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:45.249012 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:45.274477 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc455f6-59e0-40c7-8544-d06bc79ee9f3 None admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:45.315376 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544a80d-7f9f-45a8-a554-95a36746bf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:45.316030 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544a80d-7f9f-45a8-a554-95a36746bf59 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:45.316309 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544a80d-7f9f-45a8-a554-95a36746bf59 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:45.316582 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544a80d-7f9f-45a8-a554-95a36746bf59 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:45.317723 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544a80d-7f9f-45a8-a554-95a36746bf59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:45.319104 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544a80d-7f9f-45a8-a554-95a36746bf59 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:45.326419 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 655/1301] 10.222.0.62 () {56 vars in 1087 bytes} [Tue Oct 4 14:19:45 2022] GET /identity/v3/services => generated 2191 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:19:47.554396 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e86eb-9159-40de-bbf1-e3eb719cc389 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:47.554934 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e86eb-9159-40de-bbf1-e3eb719cc389 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:47.554934 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e86eb-9159-40de-bbf1-e3eb719cc389 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:47.556308 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 647/1302] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:19:47.562339 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502630a-cccf-4443-9204-62323aed00a1 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:47.563132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502630a-cccf-4443-9204-62323aed00a1 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:47.563132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502630a-cccf-4443-9204-62323aed00a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:47.582753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-1502630a-cccf-4443-9204-62323aed00a1 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:19:47.584550 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1502630a-cccf-4443-9204-62323aed00a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:19:47.659724 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 656/1303] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:19:47 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 14:19:47.933531 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e86eb-9159-40de-bbf1-e3eb719cc389 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:48.036619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:48.046639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e86eb-9159-40de-bbf1-e3eb719cc389 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:48.088852 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd74afb-b11b-43dc-a835-b1d4e9c4e6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:48.089968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd74afb-b11b-43dc-a835-b1d4e9c4e6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:48.090457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd74afb-b11b-43dc-a835-b1d4e9c4e6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:48.090835 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd74afb-b11b-43dc-a835-b1d4e9c4e6d3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:48.091445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd74afb-b11b-43dc-a835-b1d4e9c4e6d3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:48.093181 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd74afb-b11b-43dc-a835-b1d4e9c4e6d3 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:48.116204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application [None req-acd74afb-b11b-43dc-a835-b1d4e9c4e6d3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 14:19:48.116204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:48.116204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 14:19:48.116204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 14:19:48.116204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 14:19:48.116204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 14:19:48.116204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 14:19:48.116204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:19:48.116204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 14:19:48.116204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:19:48.116204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 14:19:48.116204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:19:48.116204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 14:19:48.116204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 14:19:48.116204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 14:19:48.116204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 14:19:48.116204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 14:19:48.117549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 14:19:48.117549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 14:19:48.117549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 14:19:48.117549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 14:19:48.117549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 14:19:48.117549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 14:19:48.117549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 14:19:48.117549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 14:19:48.117549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 14:19:48.117549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 14:19:48.117549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 14:19:48.117549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 14:19:48.117549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 14:19:48.117549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 14:19:48.117549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 14:19:48.117549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 14:19:48.118611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 14:19:48.118611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application with Lock( Oct 04 14:19:48.118611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 14:19:48.118611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self._enter() Oct 04 14:19:48.118611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 14:19:48.118611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 14:19:48.118611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 14:19:48.118611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application return self.creator() Oct 04 14:19:48.118611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 14:19:48.118611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application created_value = creator( Oct 04 14:19:48.118611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 14:19:48.118611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 14:19:48.118611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 14:19:48.118611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: ERROR keystone.server.flask.application Oct 04 14:19:48.118611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 648/1304] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Oct 4 14:19:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 14:19:48.123785 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502630a-cccf-4443-9204-62323aed00a1 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:48.220525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:48.248192 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502630a-cccf-4443-9204-62323aed00a1 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:48.288717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a74081-65eb-4a91-b4ce-5318df002859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:48.289342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a74081-65eb-4a91-b4ce-5318df002859 None admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:48.289621 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a74081-65eb-4a91-b4ce-5318df002859 None admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:48.289893 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a74081-65eb-4a91-b4ce-5318df002859 None admin] PATH_INFO: `/v3/services` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:48.290534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a74081-65eb-4a91-b4ce-5318df002859 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:19:48.290836 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a74081-65eb-4a91-b4ce-5318df002859 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:48.292232 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a74081-65eb-4a91-b4ce-5318df002859 None admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:48.297821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 657/1305] 10.222.0.62 () {56 vars in 1116 bytes} [Tue Oct 4 14:19:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:19:48.304084 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd74afb-b11b-43dc-a835-b1d4e9c4e6d3 None admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:19:48.415085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd74afb-b11b-43dc-a835-b1d4e9c4e6d3 None admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:19:48.454146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c842d44-11c4-4cb9-8c62-51229a048134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:19:48.454762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c842d44-11c4-4cb9-8c62-51229a048134 None admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:19:48.455040 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c842d44-11c4-4cb9-8c62-51229a048134 None admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:19:48.455309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c842d44-11c4-4cb9-8c62-51229a048134 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:19:48.456033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c842d44-11c4-4cb9-8c62-51229a048134 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:19:48.457496 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c842d44-11c4-4cb9-8c62-51229a048134 None admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:19:48.478858 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 649/1306] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:19:48 2022] POST /identity/v3/endpoints => generated 331 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:19:58.295420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=30 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:19:58.474075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:20:59.338998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15ace6-5742-4c8e-88b2-1992618444d7 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:20:59.339625 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15ace6-5742-4c8e-88b2-1992618444d7 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:20:59.339625 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15ace6-5742-4c8e-88b2-1992618444d7 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:20:59.348010 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 658/1307] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:20:59 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:20:59.349574 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171d262-7a79-4e3a-a032-aed137306b20 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:20:59.350061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171d262-7a79-4e3a-a032-aed137306b20 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:20:59.350145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171d262-7a79-4e3a-a032-aed137306b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:20:59.479522 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-7171d262-7a79-4e3a-a032-aed137306b20 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:20:59.485079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-7171d262-7a79-4e3a-a032-aed137306b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:20:59.720059 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 650/1308] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:21:00.025996 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2c69b-d71f-49ba-b309-10824991ac01 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:00.026302 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2c69b-d71f-49ba-b309-10824991ac01 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:00.026540 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2c69b-d71f-49ba-b309-10824991ac01 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:00.028171 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 659/1309] 10.222.0.62 () {54 vars in 964 bytes} [Tue Oct 4 14:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:21:00.034335 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982a428-bd22-4625-a66e-fb3d16b8c9aa None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:00.034594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982a428-bd22-4625-a66e-fb3d16b8c9aa None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:00.034864 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982a428-bd22-4625-a66e-fb3d16b8c9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:00.119169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-8982a428-bd22-4625-a66e-fb3d16b8c9aa None None] MFA Rules not processed for user `624487005e4f4180a9d56a29a7daad1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:21:00.121263 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-8982a428-bd22-4625-a66e-fb3d16b8c9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:00.143014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:00.216985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 651/1310] 10.222.0.62 () {58 vars in 1061 bytes} [Tue Oct 4 14:21:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:21:00.217797 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2c69b-d71f-49ba-b309-10824991ac01 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:21:00.219624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e0d2c69b-d71f-49ba-b309-10824991ac01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:00.383217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2c69b-d71f-49ba-b309-10824991ac01 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:21:00.474677 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c4765-7601-42f0-81bf-f9ed90b63546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:21:00.475295 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c4765-7601-42f0-81bf-f9ed90b63546 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:00.475565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c4765-7601-42f0-81bf-f9ed90b63546 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:00.475858 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c4765-7601-42f0-81bf-f9ed90b63546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:00.477454 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-007c4765-7601-42f0-81bf-f9ed90b63546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:00.542049 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:00.608245 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c4765-7601-42f0-81bf-f9ed90b63546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:21:00.610584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c4765-7601-42f0-81bf-f9ed90b63546 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:21:00.634103 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 660/1311] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:21:03.174989 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defadc86-5ded-4d00-9d31-b8fc5a1d1fc6 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:03.175536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defadc86-5ded-4d00-9d31-b8fc5a1d1fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:03.175536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defadc86-5ded-4d00-9d31-b8fc5a1d1fc6 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:03.176925 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 652/1312] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:21:03.182427 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd772448-f1c4-4c6f-9396-fb9f2f9cb3e1 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:03.182880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd772448-f1c4-4c6f-9396-fb9f2f9cb3e1 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:03.182969 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd772448-f1c4-4c6f-9396-fb9f2f9cb3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:03.271478 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-bd772448-f1c4-4c6f-9396-fb9f2f9cb3e1 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:21:03.272722 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bd772448-f1c4-4c6f-9396-fb9f2f9cb3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:03.369823 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 661/1313] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:21:03.659484 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defadc86-5ded-4d00-9d31-b8fc5a1d1fc6 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:21:03.661054 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-defadc86-5ded-4d00-9d31-b8fc5a1d1fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:03.764670 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defadc86-5ded-4d00-9d31-b8fc5a1d1fc6 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:21:03.837430 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:03.839982 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b249c02-8422-412d-93d4-7eaecd7ce418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:21:03.840807 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b249c02-8422-412d-93d4-7eaecd7ce418 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:03.841139 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b249c02-8422-412d-93d4-7eaecd7ce418 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:03.841577 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b249c02-8422-412d-93d4-7eaecd7ce418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:03.843404 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-7b249c02-8422-412d-93d4-7eaecd7ce418 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:03.952326 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b249c02-8422-412d-93d4-7eaecd7ce418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:21:03.953681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b249c02-8422-412d-93d4-7eaecd7ce418 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:21:03.975792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 653/1314] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:21:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:21:06.477654 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defac93-e03c-431b-bc0f-3f2dc7087666 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:06.478215 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defac93-e03c-431b-bc0f-3f2dc7087666 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:06.478215 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defac93-e03c-431b-bc0f-3f2dc7087666 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:06.479682 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 662/1315] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:21:06.484862 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e8caa-cf42-4ebc-90b6-7cdd5401bb30 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:06.485285 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e8caa-cf42-4ebc-90b6-7cdd5401bb30 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:06.485394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e8caa-cf42-4ebc-90b6-7cdd5401bb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:06.551720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-572e8caa-cf42-4ebc-90b6-7cdd5401bb30 None None] MFA Rules not processed for user `0edc99bb2191439ca8839bea31becd96`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:21:06.552923 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-572e8caa-cf42-4ebc-90b6-7cdd5401bb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:06.609561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:06.653301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 654/1316] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:21:06 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:21:07.004259 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d374e-f3ea-4870-94f7-084b88c56e19 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:07.004519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d374e-f3ea-4870-94f7-084b88c56e19 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:07.004810 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d374e-f3ea-4870-94f7-084b88c56e19 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:07.006148 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 663/1317] 10.222.0.62 () {54 vars in 964 bytes} [Tue Oct 4 14:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:21:07.012583 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132ae46-614b-4dbe-86bb-b3c2f97c7cbe None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:07.012892 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132ae46-614b-4dbe-86bb-b3c2f97c7cbe None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:07.013171 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132ae46-614b-4dbe-86bb-b3c2f97c7cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:07.107286 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-a132ae46-614b-4dbe-86bb-b3c2f97c7cbe None None] MFA Rules not processed for user `624487005e4f4180a9d56a29a7daad1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:21:07.108531 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a132ae46-614b-4dbe-86bb-b3c2f97c7cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:07.209085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 655/1318] 10.222.0.62 () {58 vars in 1061 bytes} [Tue Oct 4 14:21:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:21:07.218802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d374e-f3ea-4870-94f7-084b88c56e19 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:21:07.220630 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ac9d374e-f3ea-4870-94f7-084b88c56e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:07.235269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:07.373743 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d374e-f3ea-4870-94f7-084b88c56e19 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:21:07.463491 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d94f82-a3b2-40bd-85e6-627b314f5041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:21:07.464124 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d94f82-a3b2-40bd-85e6-627b314f5041 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:07.464399 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d94f82-a3b2-40bd-85e6-627b314f5041 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:07.464663 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d94f82-a3b2-40bd-85e6-627b314f5041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:07.466254 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-38d94f82-a3b2-40bd-85e6-627b314f5041 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:07.534251 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:07.589306 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d94f82-a3b2-40bd-85e6-627b314f5041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:21:07.590735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d94f82-a3b2-40bd-85e6-627b314f5041 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:21:07.615677 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 664/1319] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:21:07 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:21:10.741599 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572d336-1e9c-439a-aca7-b7a969c92f00 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:10.742167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572d336-1e9c-439a-aca7-b7a969c92f00 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:10.742167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572d336-1e9c-439a-aca7-b7a969c92f00 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:10.743471 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 656/1320] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:21:10.749080 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31028c9-a7f5-4f42-97dc-a00ddd170aec None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:10.749551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31028c9-a7f5-4f42-97dc-a00ddd170aec None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:10.749733 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31028c9-a7f5-4f42-97dc-a00ddd170aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:10.823813 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c31028c9-a7f5-4f42-97dc-a00ddd170aec None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:21:10.824960 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c31028c9-a7f5-4f42-97dc-a00ddd170aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:10.932358 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 665/1321] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:21:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:21:11.248022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572d336-1e9c-439a-aca7-b7a969c92f00 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:21:11.249582 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-6572d336-1e9c-439a-aca7-b7a969c92f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:11.306548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:11.367770 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572d336-1e9c-439a-aca7-b7a969c92f00 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:21:11.448163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd60302-33e1-4c31-bb61-2ebbe25345db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:21:11.448850 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd60302-33e1-4c31-bb61-2ebbe25345db service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:11.449131 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd60302-33e1-4c31-bb61-2ebbe25345db service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:11.449426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd60302-33e1-4c31-bb61-2ebbe25345db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:11.451257 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-9cd60302-33e1-4c31-bb61-2ebbe25345db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:11.562590 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:11.576623 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd60302-33e1-4c31-bb61-2ebbe25345db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:21:11.578050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd60302-33e1-4c31-bb61-2ebbe25345db service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:21:11.597158 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 657/1322] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:21:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:21:14.572939 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa06e31-0830-4e34-9225-513508b4a7c9 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:14.573525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa06e31-0830-4e34-9225-513508b4a7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:14.573525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa06e31-0830-4e34-9225-513508b4a7c9 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:14.574938 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 666/1323] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:21:14.581796 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee84e1-6e3e-4c32-870f-92919cdaf313 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:14.582346 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee84e1-6e3e-4c32-870f-92919cdaf313 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:14.582346 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee84e1-6e3e-4c32-870f-92919cdaf313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:14.653514 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-01ee84e1-6e3e-4c32-870f-92919cdaf313 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:21:14.654737 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-01ee84e1-6e3e-4c32-870f-92919cdaf313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:14.762282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 658/1324] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:21:15.045919 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa06e31-0830-4e34-9225-513508b4a7c9 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:21:15.047453 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5fa06e31-0830-4e34-9225-513508b4a7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:15.069148 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:15.159298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa06e31-0830-4e34-9225-513508b4a7c9 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:21:15.237246 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90899553-ff43-48f7-88a8-f622836ffd6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:21:15.237875 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90899553-ff43-48f7-88a8-f622836ffd6c service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:15.238159 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90899553-ff43-48f7-88a8-f622836ffd6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:15.238439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90899553-ff43-48f7-88a8-f622836ffd6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:15.240082 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-90899553-ff43-48f7-88a8-f622836ffd6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:15.317390 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:15.354939 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90899553-ff43-48f7-88a8-f622836ffd6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:21:15.356440 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90899553-ff43-48f7-88a8-f622836ffd6c service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:21:15.374720 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 667/1325] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:21:17.597618 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a5b93-d13a-4cb9-b359-726d3a94fe47 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:17.598150 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a5b93-d13a-4cb9-b359-726d3a94fe47 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:17.598150 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a5b93-d13a-4cb9-b359-726d3a94fe47 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:17.599473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 659/1326] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:21:17.604896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba491e7-5957-4aee-9a95-b795dbc7d1be None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:17.605314 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba491e7-5957-4aee-9a95-b795dbc7d1be None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:17.605423 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba491e7-5957-4aee-9a95-b795dbc7d1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:17.678513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-8ba491e7-5957-4aee-9a95-b795dbc7d1be None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:21:17.679805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8ba491e7-5957-4aee-9a95-b795dbc7d1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:17.781571 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 668/1327] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:21:18.062152 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a5b93-d13a-4cb9-b359-726d3a94fe47 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:21:18.064070 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f97a5b93-d13a-4cb9-b359-726d3a94fe47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:18.128703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:18.176933 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a5b93-d13a-4cb9-b359-726d3a94fe47 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:21:18.254460 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f9324-8438-4f5d-8e2f-056be552a033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:21:18.255067 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f9324-8438-4f5d-8e2f-056be552a033 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:18.255341 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f9324-8438-4f5d-8e2f-056be552a033 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:18.255608 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f9324-8438-4f5d-8e2f-056be552a033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:18.257252 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-261f9324-8438-4f5d-8e2f-056be552a033 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:18.370000 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:18.372438 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f9324-8438-4f5d-8e2f-056be552a033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:21:18.373960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f9324-8438-4f5d-8e2f-056be552a033 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:21:18.393538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 660/1328] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:21:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:21:20.728808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6d7c4-0e75-4c33-8fc1-79ba837f6364 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:20.729407 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6d7c4-0e75-4c33-8fc1-79ba837f6364 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:20.729543 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6d7c4-0e75-4c33-8fc1-79ba837f6364 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:20.730938 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 669/1329] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:21:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:21:20.739478 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b610a8-d15b-408e-bd85-35b2098721f9 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:20.740111 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b610a8-d15b-408e-bd85-35b2098721f9 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:20.740111 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b610a8-d15b-408e-bd85-35b2098721f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:20.831385 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-a9b610a8-d15b-408e-bd85-35b2098721f9 None None] MFA Rules not processed for user `0edc99bb2191439ca8839bea31becd96`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:21:20.836354 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a9b610a8-d15b-408e-bd85-35b2098721f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:20.975817 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 661/1330] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:21:20 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:21:21.273289 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6d7c4-0e75-4c33-8fc1-79ba837f6364 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:21:21.275100 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-55a6d7c4-0e75-4c33-8fc1-79ba837f6364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:21.318158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:21.411851 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6d7c4-0e75-4c33-8fc1-79ba837f6364 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:21:21.513142 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd99292-7f92-4975-8a06-6a577a268755 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:21:21.513870 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd99292-7f92-4975-8a06-6a577a268755 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:21.514218 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd99292-7f92-4975-8a06-6a577a268755 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:21.514556 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd99292-7f92-4975-8a06-6a577a268755 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:21.516372 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9bd99292-7f92-4975-8a06-6a577a268755 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:21.617386 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:21.654943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd99292-7f92-4975-8a06-6a577a268755 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:21:21.656322 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd99292-7f92-4975-8a06-6a577a268755 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:21:21.682683 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 670/1331] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:21:21 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:21:24.279999 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ae0f7-2191-4007-82a2-12cad9dd1355 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:24.280581 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ae0f7-2191-4007-82a2-12cad9dd1355 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:24.280581 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ae0f7-2191-4007-82a2-12cad9dd1355 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:24.281926 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 662/1332] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:21:24.289316 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9233c-6911-4ed2-abb2-e710234135cf None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:24.289865 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9233c-6911-4ed2-abb2-e710234135cf None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:24.289865 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9233c-6911-4ed2-abb2-e710234135cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:24.372224 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-0fe9233c-6911-4ed2-abb2-e710234135cf None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:21:24.373448 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0fe9233c-6911-4ed2-abb2-e710234135cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:24.484975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 671/1333] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:21:24.790551 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ae0f7-2191-4007-82a2-12cad9dd1355 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:21:24.792120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-855ae0f7-2191-4007-82a2-12cad9dd1355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:24.875701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:24.917503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ae0f7-2191-4007-82a2-12cad9dd1355 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:21:25.002961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0d957-b1c1-4747-9efb-83bd3297e261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:21:25.003571 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0d957-b1c1-4747-9efb-83bd3297e261 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:25.003888 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0d957-b1c1-4747-9efb-83bd3297e261 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:25.004179 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0d957-b1c1-4747-9efb-83bd3297e261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:25.005841 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-2ce0d957-b1c1-4747-9efb-83bd3297e261 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:25.120894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0d957-b1c1-4747-9efb-83bd3297e261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:21:25.122340 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0d957-b1c1-4747-9efb-83bd3297e261 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:21:25.133331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:25.142550 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 663/1334] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:21:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:21:27.368867 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d008c-8be7-47d5-9116-b10feaff0c76 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:27.369385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d008c-8be7-47d5-9116-b10feaff0c76 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:27.369385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d008c-8be7-47d5-9116-b10feaff0c76 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:27.370718 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 672/1335] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:21:27.376100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01df19-9bce-490a-9c66-05aa69c61637 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:27.376641 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01df19-9bce-490a-9c66-05aa69c61637 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:27.376739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01df19-9bce-490a-9c66-05aa69c61637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:27.442360 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-bc01df19-9bce-490a-9c66-05aa69c61637 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:21:27.443552 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-bc01df19-9bce-490a-9c66-05aa69c61637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:27.538499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 664/1336] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:21:27.834994 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d008c-8be7-47d5-9116-b10feaff0c76 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:21:27.836602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-947d008c-8be7-47d5-9116-b10feaff0c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:27.879097 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:27.947386 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d008c-8be7-47d5-9116-b10feaff0c76 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:21:28.033636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ebce4-96aa-49a9-b005-e6038f18c517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:21:28.034250 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ebce4-96aa-49a9-b005-e6038f18c517 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:28.034529 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ebce4-96aa-49a9-b005-e6038f18c517 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:28.034799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ebce4-96aa-49a9-b005-e6038f18c517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:28.036452 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-381ebce4-96aa-49a9-b005-e6038f18c517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:28.123927 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:28.151595 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ebce4-96aa-49a9-b005-e6038f18c517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:21:28.153057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ebce4-96aa-49a9-b005-e6038f18c517 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:21:28.172319 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 673/1337] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:21:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:21:30.778481 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c99c20-7ee0-4d1f-96e4-c372ff3b008c None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:30.779029 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c99c20-7ee0-4d1f-96e4-c372ff3b008c None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:30.779029 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c99c20-7ee0-4d1f-96e4-c372ff3b008c None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:30.780389 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 665/1338] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:21:30.786223 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2bbb1-ec55-4fc0-90fa-3aefc3d3ebaf None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:30.786698 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2bbb1-ec55-4fc0-90fa-3aefc3d3ebaf None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:30.786816 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2bbb1-ec55-4fc0-90fa-3aefc3d3ebaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:30.858904 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c1a2bbb1-ec55-4fc0-90fa-3aefc3d3ebaf None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:21:30.860099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c1a2bbb1-ec55-4fc0-90fa-3aefc3d3ebaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:30.965568 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 674/1339] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:21:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:21:31.247973 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c99c20-7ee0-4d1f-96e4-c372ff3b008c None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:21:31.249505 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-07c99c20-7ee0-4d1f-96e4-c372ff3b008c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:31.326615 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:31.356007 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c99c20-7ee0-4d1f-96e4-c372ff3b008c None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:21:31.429437 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462825f-4b88-48cd-b085-02fa9993fad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:21:31.429964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462825f-4b88-48cd-b085-02fa9993fad4 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:31.430241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462825f-4b88-48cd-b085-02fa9993fad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:31.430509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462825f-4b88-48cd-b085-02fa9993fad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:31.432159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-7462825f-4b88-48cd-b085-02fa9993fad4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:31.555306 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462825f-4b88-48cd-b085-02fa9993fad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:21:31.556797 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462825f-4b88-48cd-b085-02fa9993fad4 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:21:31.575914 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 666/1340] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:21:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:21:35.755927 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaccb6-61ec-4b7a-bf15-0289c6d6ffed None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:35.756554 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaccb6-61ec-4b7a-bf15-0289c6d6ffed None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:35.756554 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaccb6-61ec-4b7a-bf15-0289c6d6ffed None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:35.757940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 675/1341] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:21:35.763631 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b276d-f3e0-4a8a-9389-8c88e386678c None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:35.764178 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b276d-f3e0-4a8a-9389-8c88e386678c None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:35.764178 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b276d-f3e0-4a8a-9389-8c88e386678c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:35.770464 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:35.839387 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-071b276d-f3e0-4a8a-9389-8c88e386678c None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:21:35.840664 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-071b276d-f3e0-4a8a-9389-8c88e386678c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:35.951205 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 667/1342] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:21:36.234212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eaccb6-61ec-4b7a-bf15-0289c6d6ffed None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:21:36.236714 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-24eaccb6-61ec-4b7a-bf15-0289c6d6ffed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:36.297356 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:36.367397 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eaccb6-61ec-4b7a-bf15-0289c6d6ffed None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:21:36.456634 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec724c25-96af-4ee8-be28-5dc4f01234f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:21:36.457256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec724c25-96af-4ee8-be28-5dc4f01234f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:36.457531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec724c25-96af-4ee8-be28-5dc4f01234f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:36.457791 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec724c25-96af-4ee8-be28-5dc4f01234f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:36.459494 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ec724c25-96af-4ee8-be28-5dc4f01234f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:36.579890 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:36.599646 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec724c25-96af-4ee8-be28-5dc4f01234f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:21:36.601121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec724c25-96af-4ee8-be28-5dc4f01234f7 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:21:36.620616 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 676/1343] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:21:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:21:39.661177 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60284742-bc27-4f97-9152-de36b2246b3f None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:39.661716 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60284742-bc27-4f97-9152-de36b2246b3f None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:39.661716 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60284742-bc27-4f97-9152-de36b2246b3f None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:39.662948 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 668/1344] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:21:39.668364 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0e097-6603-4286-83cf-af39eab9e402 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:39.668853 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0e097-6603-4286-83cf-af39eab9e402 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:39.668989 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0e097-6603-4286-83cf-af39eab9e402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:39.746231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-67c0e097-6603-4286-83cf-af39eab9e402 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:21:39.747453 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-67c0e097-6603-4286-83cf-af39eab9e402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:39.855998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 677/1345] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:21:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:21:40.152017 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60284742-bc27-4f97-9152-de36b2246b3f None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:21:40.153642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-60284742-bc27-4f97-9152-de36b2246b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:40.243936 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:40.261978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60284742-bc27-4f97-9152-de36b2246b3f None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:21:40.342394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce5ab0-d8fa-44a7-91c9-9208eed62116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:21:40.343012 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce5ab0-d8fa-44a7-91c9-9208eed62116 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:40.343286 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce5ab0-d8fa-44a7-91c9-9208eed62116 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:40.343552 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce5ab0-d8fa-44a7-91c9-9208eed62116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:40.345812 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-afce5ab0-d8fa-44a7-91c9-9208eed62116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:40.462814 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce5ab0-d8fa-44a7-91c9-9208eed62116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:21:40.464287 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce5ab0-d8fa-44a7-91c9-9208eed62116 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:21:40.482620 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 669/1346] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:21:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:21:44.825612 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b68566-e5b2-4410-b725-3d974d07cdb5 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:44.826151 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b68566-e5b2-4410-b725-3d974d07cdb5 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:44.826151 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b68566-e5b2-4410-b725-3d974d07cdb5 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:44.827494 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 678/1347] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:21:44.834525 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20958a-bb81-4b08-b99b-1a95dec7b386 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:44.835024 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20958a-bb81-4b08-b99b-1a95dec7b386 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:44.835115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20958a-bb81-4b08-b99b-1a95dec7b386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:44.851409 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:44.910683 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-5a20958a-bb81-4b08-b99b-1a95dec7b386 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:21:44.911912 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-5a20958a-bb81-4b08-b99b-1a95dec7b386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:45.023480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 670/1348] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:21:45.331379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b68566-e5b2-4410-b725-3d974d07cdb5 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:21:45.332964 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-68b68566-e5b2-4410-b725-3d974d07cdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:45.401279 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:45.455435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b68566-e5b2-4410-b725-3d974d07cdb5 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:21:45.537275 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac84e68-4555-43d1-875e-0d0472330e3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:21:45.537884 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac84e68-4555-43d1-875e-0d0472330e3a service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:45.538158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac84e68-4555-43d1-875e-0d0472330e3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:45.538425 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac84e68-4555-43d1-875e-0d0472330e3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:45.540079 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6ac84e68-4555-43d1-875e-0d0472330e3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:45.651007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:45.655553 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac84e68-4555-43d1-875e-0d0472330e3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:21:45.657518 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac84e68-4555-43d1-875e-0d0472330e3a service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:21:45.680583 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 679/1349] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:21:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:21:50.761194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649bf06-fd1a-4408-a3ca-a8e2e6006fe5 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:50.761696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649bf06-fd1a-4408-a3ca-a8e2e6006fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:50.762005 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649bf06-fd1a-4408-a3ca-a8e2e6006fe5 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:50.763925 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 671/1350] 10.222.0.62 () {54 vars in 921 bytes} [Tue Oct 4 14:21:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:21:50.769892 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677f75b-c4bf-41e2-b272-994e5d741fea None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:50.770397 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677f75b-c4bf-41e2-b272-994e5d741fea None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:50.770494 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677f75b-c4bf-41e2-b272-994e5d741fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:50.882248 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-9677f75b-c4bf-41e2-b272-994e5d741fea None None] MFA Rules not processed for user `6f98c07455a241398784d221df273aba`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:21:50.883575 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9677f75b-c4bf-41e2-b272-994e5d741fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:51.033711 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 680/1351] 10.222.0.62 () {58 vars in 1018 bytes} [Tue Oct 4 14:21:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:21:55.021718 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=59 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:55.284422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfa97e-87f5-4185-ac06-04b196602f99 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:55.284606 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfa97e-87f5-4185-ac06-04b196602f99 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:55.284896 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfa97e-87f5-4185-ac06-04b196602f99 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:55.286461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 672/1352] 10.222.0.62 () {54 vars in 921 bytes} [Tue Oct 4 14:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:21:55.292054 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11758ee-5080-43a1-91a6-26b80bc49c54 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:55.292646 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11758ee-5080-43a1-91a6-26b80bc49c54 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:55.293103 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11758ee-5080-43a1-91a6-26b80bc49c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:55.352903 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:55.380096 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c11758ee-5080-43a1-91a6-26b80bc49c54 None None] MFA Rules not processed for user `6f98c07455a241398784d221df273aba`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:21:55.381492 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c11758ee-5080-43a1-91a6-26b80bc49c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:55.498124 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 681/1353] 10.222.0.62 () {58 vars in 1018 bytes} [Tue Oct 4 14:21:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:21:56.826033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb252b-ab25-40f1-80be-8bcf7ae90810 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:56.826568 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb252b-ab25-40f1-80be-8bcf7ae90810 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:56.826683 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb252b-ab25-40f1-80be-8bcf7ae90810 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:56.827946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 673/1354] 10.222.0.62 () {54 vars in 921 bytes} [Tue Oct 4 14:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:21:56.833728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c94a0-af60-4ee6-b11b-5d77e6fb4d5d None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:21:56.834202 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c94a0-af60-4ee6-b11b-5d77e6fb4d5d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:21:56.834353 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c94a0-af60-4ee6-b11b-5d77e6fb4d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:21:56.923861 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-a13c94a0-af60-4ee6-b11b-5d77e6fb4d5d None None] MFA Rules not processed for user `6f98c07455a241398784d221df273aba`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:21:56.925286 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a13c94a0-af60-4ee6-b11b-5d77e6fb4d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:21:56.971049 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:21:57.049821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 682/1355] 10.222.0.62 () {58 vars in 1018 bytes} [Tue Oct 4 14:21:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:22:00.958980 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1d169-e66b-4ad6-8ae6-b61582f37356 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:00.959847 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1d169-e66b-4ad6-8ae6-b61582f37356 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:00.959847 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1d169-e66b-4ad6-8ae6-b61582f37356 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:00.961143 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 674/1356] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:22:00.967070 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da0b2a-27ca-4f3c-9314-23a8270bff2d None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:00.970991 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da0b2a-27ca-4f3c-9314-23a8270bff2d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:00.970991 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da0b2a-27ca-4f3c-9314-23a8270bff2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:01.071584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-85da0b2a-27ca-4f3c-9314-23a8270bff2d None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:22:01.073125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-85da0b2a-27ca-4f3c-9314-23a8270bff2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:01.204371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 683/1357] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:22:01.504199 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ef645-41de-48e5-9443-0046d288f9b1 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:01.504485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ef645-41de-48e5-9443-0046d288f9b1 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:01.504759 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ef645-41de-48e5-9443-0046d288f9b1 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:01.506090 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 675/1358] 10.222.0.62 () {54 vars in 961 bytes} [Tue Oct 4 14:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:22:01.515746 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a32076-6156-490a-a4e4-de62852741fc None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:01.517375 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a32076-6156-490a-a4e4-de62852741fc None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:01.517913 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a32076-6156-490a-a4e4-de62852741fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:01.543982 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:01.618603 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-31a32076-6156-490a-a4e4-de62852741fc None None] MFA Rules not processed for user `151e7b9c7a7b46d58dc2f563d05775e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:22:01.619826 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-31a32076-6156-490a-a4e4-de62852741fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:01.757081 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 684/1359] 10.222.0.62 () {58 vars in 1058 bytes} [Tue Oct 4 14:22:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:22:01.762544 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ef645-41de-48e5-9443-0046d288f9b1 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:22:01.764078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-411ef645-41de-48e5-9443-0046d288f9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:01.941524 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ef645-41de-48e5-9443-0046d288f9b1 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:22:02.037919 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:02.085168 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33492e-ee9a-4c76-aca7-600987c8ec21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:22:02.085904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33492e-ee9a-4c76-aca7-600987c8ec21 service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:02.086255 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33492e-ee9a-4c76-aca7-600987c8ec21 service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:02.086600 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33492e-ee9a-4c76-aca7-600987c8ec21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:02.088336 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-fd33492e-ee9a-4c76-aca7-600987c8ec21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:02.221166 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33492e-ee9a-4c76-aca7-600987c8ec21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:22:02.222932 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33492e-ee9a-4c76-aca7-600987c8ec21 service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:22:02.244850 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 676/1360] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:22:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:22:05.055592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc3c5a-a2cf-4c4c-b30c-a0d0111aba4e None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:05.056350 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc3c5a-a2cf-4c4c-b30c-a0d0111aba4e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:05.056350 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc3c5a-a2cf-4c4c-b30c-a0d0111aba4e None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:05.057645 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 685/1361] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:22:05.065654 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd1df5-ec5e-4ee7-8f13-07cc4ba15a69 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:05.066240 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd1df5-ec5e-4ee7-8f13-07cc4ba15a69 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:05.066386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd1df5-ec5e-4ee7-8f13-07cc4ba15a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:05.139807 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-5fcd1df5-ec5e-4ee7-8f13-07cc4ba15a69 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:22:05.142210 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-5fcd1df5-ec5e-4ee7-8f13-07cc4ba15a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:05.188379 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:05.259368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 677/1362] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:22:05.567071 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc3c5a-a2cf-4c4c-b30c-a0d0111aba4e None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:22:05.568935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-23cc3c5a-a2cf-4c4c-b30c-a0d0111aba4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:05.647983 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:05.748006 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc3c5a-a2cf-4c4c-b30c-a0d0111aba4e None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:22:05.888190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7fe42-b646-4a1b-8fc9-4543f76d5713 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:22:05.888807 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7fe42-b646-4a1b-8fc9-4543f76d5713 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:05.889079 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7fe42-b646-4a1b-8fc9-4543f76d5713 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:05.889345 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7fe42-b646-4a1b-8fc9-4543f76d5713 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:05.891602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9fc7fe42-b646-4a1b-8fc9-4543f76d5713 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:05.917957 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:06.000763 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7fe42-b646-4a1b-8fc9-4543f76d5713 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:22:06.002995 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7fe42-b646-4a1b-8fc9-4543f76d5713 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:22:06.024069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 686/1363] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:22:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:22:08.638141 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b044d-1444-4d9e-957d-b3d9811b7122 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:08.638703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b044d-1444-4d9e-957d-b3d9811b7122 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:08.638703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b044d-1444-4d9e-957d-b3d9811b7122 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:08.640238 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 678/1364] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:22:08.646024 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f61c86-b545-42d2-84d3-5db326abdff2 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:08.646524 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f61c86-b545-42d2-84d3-5db326abdff2 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:08.646524 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f61c86-b545-42d2-84d3-5db326abdff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:08.733187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-21f61c86-b545-42d2-84d3-5db326abdff2 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:22:08.734633 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-21f61c86-b545-42d2-84d3-5db326abdff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:08.888796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:08.896139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 687/1365] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:22:09.254216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984c7ac-5304-4d16-b071-627f5b0c2c84 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:09.254484 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984c7ac-5304-4d16-b071-627f5b0c2c84 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:09.254881 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984c7ac-5304-4d16-b071-627f5b0c2c84 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:09.256615 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 679/1366] 10.222.0.62 () {54 vars in 961 bytes} [Tue Oct 4 14:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:22:09.268154 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473e37c-1cd1-40f8-8d95-9456fb006056 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:09.268633 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473e37c-1cd1-40f8-8d95-9456fb006056 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:09.269080 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473e37c-1cd1-40f8-8d95-9456fb006056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:09.415015 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-b473e37c-1cd1-40f8-8d95-9456fb006056 None None] MFA Rules not processed for user `151e7b9c7a7b46d58dc2f563d05775e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:22:09.416590 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b473e37c-1cd1-40f8-8d95-9456fb006056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:09.643817 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 688/1367] 10.222.0.62 () {58 vars in 1058 bytes} [Tue Oct 4 14:22:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:22:09.653029 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984c7ac-5304-4d16-b071-627f5b0c2c84 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:22:09.653733 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-5984c7ac-5304-4d16-b071-627f5b0c2c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:09.855532 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead76f6-5a24-4345-8d00-f6f70cb5c281 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:09.856156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead76f6-5a24-4345-8d00-f6f70cb5c281 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:09.856156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead76f6-5a24-4345-8d00-f6f70cb5c281 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:09.857945 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 689/1368] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:22:09.864289 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23782872-b679-4175-9ab1-4befe25e6135 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:09.864626 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23782872-b679-4175-9ab1-4befe25e6135 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:09.864987 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23782872-b679-4175-9ab1-4befe25e6135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:09.907233 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984c7ac-5304-4d16-b071-627f5b0c2c84 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:22:09.949919 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:09.975030 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:09.985769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-23782872-b679-4175-9ab1-4befe25e6135 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:22:09.987090 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-23782872-b679-4175-9ab1-4befe25e6135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:10.102734 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d9f2b-7082-4bfe-9850-9a451c009774 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:22:10.103770 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d9f2b-7082-4bfe-9850-9a451c009774 service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:10.104266 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d9f2b-7082-4bfe-9850-9a451c009774 service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:10.104729 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d9f2b-7082-4bfe-9850-9a451c009774 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:10.106846 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-c73d9f2b-7082-4bfe-9850-9a451c009774 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:10.135246 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 690/1369] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:22:10.229127 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d9f2b-7082-4bfe-9850-9a451c009774 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:22:10.230584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d9f2b-7082-4bfe-9850-9a451c009774 service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:22:10.264906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 680/1370] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:22:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:22:10.570809 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9986e8-b242-4b9b-9408-5c25610deb7c None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:10.571284 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9986e8-b242-4b9b-9408-5c25610deb7c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:10.571581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9986e8-b242-4b9b-9408-5c25610deb7c None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:10.574399 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 691/1371] 10.222.0.62 () {54 vars in 963 bytes} [Tue Oct 4 14:22:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:22:10.582779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c8bf4-eadf-4802-ace2-d1b1de88a604 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:10.583240 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c8bf4-eadf-4802-ace2-d1b1de88a604 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:10.583815 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c8bf4-eadf-4802-ace2-d1b1de88a604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:10.643123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:10.753527 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-d03c8bf4-eadf-4802-ace2-d1b1de88a604 None None] MFA Rules not processed for user `c5d3bf1c2d944d51a0fd0ff84be1c7e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:22:10.755648 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d03c8bf4-eadf-4802-ace2-d1b1de88a604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:10.936892 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 681/1372] 10.222.0.62 () {58 vars in 1060 bytes} [Tue Oct 4 14:22:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:22:10.944010 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9986e8-b242-4b9b-9408-5c25610deb7c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:22:10.945817 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9f9986e8-b242-4b9b-9408-5c25610deb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:11.106195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9986e8-b242-4b9b-9408-5c25610deb7c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:22:11.155050 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:11.232653 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb28f1-cc76-47d3-b771-d4a82c1c31be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:22:11.233278 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb28f1-cc76-47d3-b771-d4a82c1c31be service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:11.233547 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb28f1-cc76-47d3-b771-d4a82c1c31be service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:11.233811 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb28f1-cc76-47d3-b771-d4a82c1c31be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:11.235584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5dbb28f1-cc76-47d3-b771-d4a82c1c31be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:11.366593 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb28f1-cc76-47d3-b771-d4a82c1c31be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:22:11.368161 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb28f1-cc76-47d3-b771-d4a82c1c31be service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:22:11.390140 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 692/1373] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:22:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:22:12.713570 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894054e-e701-42b2-b75d-b0220209fb59 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:12.714107 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894054e-e701-42b2-b75d-b0220209fb59 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:12.714107 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894054e-e701-42b2-b75d-b0220209fb59 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:12.715363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 682/1374] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:22:12.721412 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dca1f-03f0-46b9-9205-ed360c15bc56 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:12.722034 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dca1f-03f0-46b9-9205-ed360c15bc56 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:12.722034 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dca1f-03f0-46b9-9205-ed360c15bc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:12.811521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-187dca1f-03f0-46b9-9205-ed360c15bc56 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:22:12.813344 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-187dca1f-03f0-46b9-9205-ed360c15bc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:12.821311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:12.917083 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 693/1375] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:22:13.225548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894054e-e701-42b2-b75d-b0220209fb59 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:22:13.227079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a894054e-e701-42b2-b75d-b0220209fb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:13.353589 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:13.394257 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894054e-e701-42b2-b75d-b0220209fb59 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:22:13.569838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a6353-1ae2-4c72-af17-e7ba306fec82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:22:13.570961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a6353-1ae2-4c72-af17-e7ba306fec82 service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:13.572138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a6353-1ae2-4c72-af17-e7ba306fec82 service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:13.572635 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a6353-1ae2-4c72-af17-e7ba306fec82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:13.575819 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-4f3a6353-1ae2-4c72-af17-e7ba306fec82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:13.669568 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:13.686990 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a6353-1ae2-4c72-af17-e7ba306fec82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:22:13.689551 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a6353-1ae2-4c72-af17-e7ba306fec82 service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:22:13.711222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 683/1376] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:22:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:22:16.148176 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d0e54-7cbb-4ad9-ae69-4f59d26b52fa None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:16.148858 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d0e54-7cbb-4ad9-ae69-4f59d26b52fa None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:16.148858 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d0e54-7cbb-4ad9-ae69-4f59d26b52fa None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:16.150765 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 694/1377] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:22:16.158361 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba635a4-f079-471c-8229-da2785e7e25e None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:16.160324 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba635a4-f079-471c-8229-da2785e7e25e None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:16.160905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba635a4-f079-471c-8229-da2785e7e25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:16.302306 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-9ba635a4-f079-471c-8229-da2785e7e25e None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:22:16.303693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-9ba635a4-f079-471c-8229-da2785e7e25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:16.446384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 684/1378] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:22:16.752111 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d0e54-7cbb-4ad9-ae69-4f59d26b52fa None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:22:16.753650 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-fa2d0e54-7cbb-4ad9-ae69-4f59d26b52fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:16.977502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:17.000697 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d0e54-7cbb-4ad9-ae69-4f59d26b52fa None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:22:17.244854 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c9b5c-2010-4c80-ab3d-2034d3c02823 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:22:17.245871 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c9b5c-2010-4c80-ab3d-2034d3c02823 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:17.246365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c9b5c-2010-4c80-ab3d-2034d3c02823 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:17.246911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c9b5c-2010-4c80-ab3d-2034d3c02823 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:17.249584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-208c9b5c-2010-4c80-ab3d-2034d3c02823 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:17.399631 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c9b5c-2010-4c80-ab3d-2034d3c02823 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:22:17.402824 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c9b5c-2010-4c80-ab3d-2034d3c02823 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:22:17.418885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:17.434860 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 695/1379] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:22:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:22:20.056284 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb2c77-e623-4c35-b0db-7923d4c71788 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:20.056812 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb2c77-e623-4c35-b0db-7923d4c71788 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:20.057169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb2c77-e623-4c35-b0db-7923d4c71788 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:20.059667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 685/1380] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:22:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:22:20.067765 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d5ee9-d983-43f9-a24a-1e10aa520193 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:20.068486 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d5ee9-d983-43f9-a24a-1e10aa520193 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:20.068848 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d5ee9-d983-43f9-a24a-1e10aa520193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:20.182446 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-070d5ee9-d983-43f9-a24a-1e10aa520193 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:22:20.184397 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-070d5ee9-d983-43f9-a24a-1e10aa520193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:20.332034 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 696/1381] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:22:20.626855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb2c77-e623-4c35-b0db-7923d4c71788 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:22:20.628662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-12fb2c77-e623-4c35-b0db-7923d4c71788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:20.705234 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:20.811225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb2c77-e623-4c35-b0db-7923d4c71788 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:22:21.001725 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8984b-dd63-4fb7-91c2-60305b16e38f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:22:21.002777 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8984b-dd63-4fb7-91c2-60305b16e38f service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:21.003283 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8984b-dd63-4fb7-91c2-60305b16e38f service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:21.003808 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8984b-dd63-4fb7-91c2-60305b16e38f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:21.007034 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-13b8984b-dd63-4fb7-91c2-60305b16e38f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:21.043904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:21.154434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8984b-dd63-4fb7-91c2-60305b16e38f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:22:21.157636 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8984b-dd63-4fb7-91c2-60305b16e38f service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:22:21.184496 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 686/1382] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:22:23.665579 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa5111-3d34-45c2-83a3-db3c03075503 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:23.666181 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa5111-3d34-45c2-83a3-db3c03075503 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:23.666181 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa5111-3d34-45c2-83a3-db3c03075503 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:23.667447 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 697/1383] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:22:23.673375 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d595be-1549-4415-966e-6a0901c42289 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:23.674057 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d595be-1549-4415-966e-6a0901c42289 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:23.674057 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d595be-1549-4415-966e-6a0901c42289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:23.747367 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-f7d595be-1549-4415-966e-6a0901c42289 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:22:23.748537 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f7d595be-1549-4415-966e-6a0901c42289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:23.858384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:23.866686 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 687/1384] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:22:24.153400 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa5111-3d34-45c2-83a3-db3c03075503 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:22:24.156538 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8faa5111-3d34-45c2-83a3-db3c03075503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:24.249583 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:24.327909 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa5111-3d34-45c2-83a3-db3c03075503 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:22:24.454745 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1165f-11b4-412e-8421-d4e71e315173 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:22:24.455279 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1165f-11b4-412e-8421-d4e71e315173 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:24.455551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1165f-11b4-412e-8421-d4e71e315173 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:24.455901 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1165f-11b4-412e-8421-d4e71e315173 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:24.457464 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f3c1165f-11b4-412e-8421-d4e71e315173 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:24.498785 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:24.564480 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1165f-11b4-412e-8421-d4e71e315173 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:22:24.566059 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1165f-11b4-412e-8421-d4e71e315173 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:22:24.586746 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 698/1385] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:22:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:22:26.998071 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c2637-f267-432c-8cdf-70c225e9cdee None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:26.998643 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c2637-f267-432c-8cdf-70c225e9cdee None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:26.998643 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c2637-f267-432c-8cdf-70c225e9cdee None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:27.000774 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 688/1386] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:22:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:22:27.006028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9e7a7-5b48-4f64-b6ab-ea9f4bf1465e None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:27.006476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9e7a7-5b48-4f64-b6ab-ea9f4bf1465e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:27.006572 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9e7a7-5b48-4f64-b6ab-ea9f4bf1465e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:27.074410 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-bcf9e7a7-5b48-4f64-b6ab-ea9f4bf1465e None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:22:27.075615 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bcf9e7a7-5b48-4f64-b6ab-ea9f4bf1465e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:27.181215 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 699/1387] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:22:27.483693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c2637-f267-432c-8cdf-70c225e9cdee None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:22:27.486297 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-596c2637-f267-432c-8cdf-70c225e9cdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:27.676493 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c2637-f267-432c-8cdf-70c225e9cdee None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:22:27.751408 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:27.790147 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec34ccf-95a3-4e5a-b4e9-f42296537182 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:27.790970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec34ccf-95a3-4e5a-b4e9-f42296537182 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:27.791250 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec34ccf-95a3-4e5a-b4e9-f42296537182 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:27.792624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 700/1388] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:22:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:22:27.798419 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933f26e-8253-4af2-95dc-f55c36ba91b9 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:27.798699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933f26e-8253-4af2-95dc-f55c36ba91b9 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:27.798973 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933f26e-8253-4af2-95dc-f55c36ba91b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:27.802401 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55607d94-732d-415d-9da3-d8bfa62ce33a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:22:27.803019 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55607d94-732d-415d-9da3-d8bfa62ce33a service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:27.803298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55607d94-732d-415d-9da3-d8bfa62ce33a service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:27.803566 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55607d94-732d-415d-9da3-d8bfa62ce33a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:27.805207 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-55607d94-732d-415d-9da3-d8bfa62ce33a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:27.815776 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:27.876745 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c933f26e-8253-4af2-95dc-f55c36ba91b9 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:22:27.878013 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c933f26e-8253-4af2-95dc-f55c36ba91b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:27.908803 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55607d94-732d-415d-9da3-d8bfa62ce33a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:22:27.910738 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55607d94-732d-415d-9da3-d8bfa62ce33a service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:22:27.931740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 689/1389] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:22:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:22:27.987994 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 701/1390] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:22:28.312286 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33420cb4-12a3-4336-8fad-0eb872f5358d None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:28.312888 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33420cb4-12a3-4336-8fad-0eb872f5358d None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:28.312988 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33420cb4-12a3-4336-8fad-0eb872f5358d None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:28.314810 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 690/1391] 10.222.0.62 () {54 vars in 962 bytes} [Tue Oct 4 14:22:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:22:28.321219 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1d516-7db1-4b67-8cca-1ba99094e3e8 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:28.321801 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1d516-7db1-4b67-8cca-1ba99094e3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:28.321982 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1d516-7db1-4b67-8cca-1ba99094e3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:28.423372 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ddd1d516-7db1-4b67-8cca-1ba99094e3e8 None None] MFA Rules not processed for user `289b020c9cd242dca9b512803199daae`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:22:28.424651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ddd1d516-7db1-4b67-8cca-1ba99094e3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:28.464449 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:28.513427 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 702/1392] 10.222.0.62 () {58 vars in 1059 bytes} [Tue Oct 4 14:22:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:22:28.523612 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33420cb4-12a3-4336-8fad-0eb872f5358d None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:22:28.526118 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-33420cb4-12a3-4336-8fad-0eb872f5358d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:28.620670 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:28.658242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33420cb4-12a3-4336-8fad-0eb872f5358d None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:22:28.752541 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8afd49-27ba-43ee-a156-97b1e1ed67c1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '289b020c9cd242dca9b512803199daae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:22:28.753156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8afd49-27ba-43ee-a156-97b1e1ed67c1 service glance] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:28.753426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8afd49-27ba-43ee-a156-97b1e1ed67c1 service glance] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:28.753691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8afd49-27ba-43ee-a156-97b1e1ed67c1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:28.755340 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-ac8afd49-27ba-43ee-a156-97b1e1ed67c1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:28.890893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8afd49-27ba-43ee-a156-97b1e1ed67c1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:22:28.890893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8afd49-27ba-43ee-a156-97b1e1ed67c1 service glance] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:22:28.912258 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 691/1393] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:22:29.748442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a5232-a683-4324-80ef-56b97f2109f0 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:29.749233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a5232-a683-4324-80ef-56b97f2109f0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:29.749233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a5232-a683-4324-80ef-56b97f2109f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:29.842451 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-7a2a5232-a683-4324-80ef-56b97f2109f0 None None] MFA Rules not processed for user `c5dc12a8bc2b406b8a148bf609d5d2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:22:29.844564 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7a2a5232-a683-4324-80ef-56b97f2109f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:29.943497 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 703/1394] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Oct 4 14:22:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:22:29.990657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d7179-5a57-4e59-bad0-fc979e1a6852 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:29.991418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d7179-5a57-4e59-bad0-fc979e1a6852 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:29.991418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d7179-5a57-4e59-bad0-fc979e1a6852 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:29.992486 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 692/1395] 10.222.0.62 () {54 vars in 943 bytes} [Tue Oct 4 14:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:22:30.000358 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d5106-dc1e-4803-b797-4690607c08fb None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:30.000674 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d5106-dc1e-4803-b797-4690607c08fb None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:30.000948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d5106-dc1e-4803-b797-4690607c08fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:30.085106 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:30.107167 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-829d5106-dc1e-4803-b797-4690607c08fb None None] MFA Rules not processed for user `4860d5958e724e568576a9067290a27e`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:22:30.108431 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-829d5106-dc1e-4803-b797-4690607c08fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:30.263697 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 704/1396] 10.222.0.62 () {58 vars in 1040 bytes} [Tue Oct 4 14:22:29 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:22:30.274419 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d7179-5a57-4e59-bad0-fc979e1a6852 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:22:30.275998 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-549d7179-5a57-4e59-bad0-fc979e1a6852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:30.280857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd9d61-735a-43d3-a934-3d9a3d766bf7 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:30.282327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd9d61-735a-43d3-a934-3d9a3d766bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:30.282741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd9d61-735a-43d3-a934-3d9a3d766bf7 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:30.285386 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 705/1397] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:22:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:22:30.291077 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58a6d5-766e-44e9-8e7d-a89488171181 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:30.291357 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58a6d5-766e-44e9-8e7d-a89488171181 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:30.291621 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58a6d5-766e-44e9-8e7d-a89488171181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:30.294070 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:30.383044 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ba58a6d5-766e-44e9-8e7d-a89488171181 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:22:30.384321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ba58a6d5-766e-44e9-8e7d-a89488171181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:30.460990 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d7179-5a57-4e59-bad0-fc979e1a6852 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:22:30.463629 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:30.520327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 706/1398] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:22:30.586102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:30.592674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e2dd9-b100-4448-9af6-d88ca4e6e76a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4860d5958e724e568576a9067290a27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:22:30.593290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e2dd9-b100-4448-9af6-d88ca4e6e76a service swift] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:30.593585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e2dd9-b100-4448-9af6-d88ca4e6e76a service swift] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:30.594057 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e2dd9-b100-4448-9af6-d88ca4e6e76a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:30.595911 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d14e2dd9-b100-4448-9af6-d88ca4e6e76a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:30.686449 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e2dd9-b100-4448-9af6-d88ca4e6e76a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:22:30.689470 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e2dd9-b100-4448-9af6-d88ca4e6e76a service swift] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:22:30.698812 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 693/1399] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Oct 4 14:22:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 14:22:30.843411 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58a6d5-766e-44e9-8e7d-a89488171181 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:22:30.845237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ba58a6d5-766e-44e9-8e7d-a89488171181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:31.005701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58a6d5-766e-44e9-8e7d-a89488171181 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:22:31.151615 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:31.251536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0928a1-45d3-4177-9939-acb244c0eb6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:22:31.252348 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0928a1-45d3-4177-9939-acb244c0eb6b service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:31.252783 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0928a1-45d3-4177-9939-acb244c0eb6b service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:31.253221 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0928a1-45d3-4177-9939-acb244c0eb6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:31.255056 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2c0928a1-45d3-4177-9939-acb244c0eb6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:31.420018 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0928a1-45d3-4177-9939-acb244c0eb6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:22:31.421792 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0928a1-45d3-4177-9939-acb244c0eb6b service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:22:31.446953 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 707/1400] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:22:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:22:34.048070 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51b203-68eb-43f7-9411-8403dbaa50be None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:34.048943 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51b203-68eb-43f7-9411-8403dbaa50be None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:34.049921 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51b203-68eb-43f7-9411-8403dbaa50be None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:34.055776 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 694/1401] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:22:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:22:34.058729 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d2fc5-e84f-41b2-826e-3d36ca793e81 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:34.059681 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d2fc5-e84f-41b2-826e-3d36ca793e81 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:34.060186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d2fc5-e84f-41b2-826e-3d36ca793e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:34.169418 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-fb5d2fc5-e84f-41b2-826e-3d36ca793e81 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:22:34.170684 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-fb5d2fc5-e84f-41b2-826e-3d36ca793e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:34.232938 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:34.353034 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 708/1402] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:22:34.653579 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51b203-68eb-43f7-9411-8403dbaa50be None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:22:34.655863 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-6e51b203-68eb-43f7-9411-8403dbaa50be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:34.868753 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:34.884867 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51b203-68eb-43f7-9411-8403dbaa50be None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:22:35.006551 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027b4f1-3ef1-4a32-8bae-dbbf3043df42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:22:35.006551 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027b4f1-3ef1-4a32-8bae-dbbf3043df42 service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:35.006551 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027b4f1-3ef1-4a32-8bae-dbbf3043df42 service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:35.006551 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027b4f1-3ef1-4a32-8bae-dbbf3043df42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:35.008534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-5027b4f1-3ef1-4a32-8bae-dbbf3043df42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:35.122276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027b4f1-3ef1-4a32-8bae-dbbf3043df42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:22:35.123964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027b4f1-3ef1-4a32-8bae-dbbf3043df42 service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:22:35.135887 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:35.147570 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 695/1403] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:22:37.504523 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f2c2d-ae4f-4fbe-b2c0-fb61e49decc5 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:37.505110 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f2c2d-ae4f-4fbe-b2c0-fb61e49decc5 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:37.505110 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f2c2d-ae4f-4fbe-b2c0-fb61e49decc5 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:37.506682 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 709/1404] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:22:37.512167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee83ce-dbad-491a-9f86-61216799c73a None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:37.512595 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee83ce-dbad-491a-9f86-61216799c73a None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:37.512709 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee83ce-dbad-491a-9f86-61216799c73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:37.595376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-a1ee83ce-dbad-491a-9f86-61216799c73a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:22:37.596657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a1ee83ce-dbad-491a-9f86-61216799c73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:37.714457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 696/1405] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:22:38.016814 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f2c2d-ae4f-4fbe-b2c0-fb61e49decc5 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:22:38.018686 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0a7f2c2d-ae4f-4fbe-b2c0-fb61e49decc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:38.206709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f2c2d-ae4f-4fbe-b2c0-fb61e49decc5 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:22:38.229574 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:38.347008 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53495c3-e642-416b-add3-fe73e1bd1f5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:22:38.347544 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53495c3-e642-416b-add3-fe73e1bd1f5f service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:38.347850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53495c3-e642-416b-add3-fe73e1bd1f5f service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:38.348117 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53495c3-e642-416b-add3-fe73e1bd1f5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:38.349768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b53495c3-e642-416b-add3-fe73e1bd1f5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:38.456871 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53495c3-e642-416b-add3-fe73e1bd1f5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:22:38.458575 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53495c3-e642-416b-add3-fe73e1bd1f5f service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:22:38.481724 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 710/1406] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:22:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:22:40.919246 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48c088-d1b7-4104-9856-5757084a731b None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:40.919850 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48c088-d1b7-4104-9856-5757084a731b None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:40.919850 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48c088-d1b7-4104-9856-5757084a731b None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:40.921751 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 697/1407] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:22:40.927552 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3ab7c-d413-446f-a1ec-dfcd2bcbeb32 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:40.928119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3ab7c-d413-446f-a1ec-dfcd2bcbeb32 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:40.928119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3ab7c-d413-446f-a1ec-dfcd2bcbeb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:40.957395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:41.021989 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c0a3ab7c-d413-446f-a1ec-dfcd2bcbeb32 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:22:41.023521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c0a3ab7c-d413-446f-a1ec-dfcd2bcbeb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:41.173129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 711/1408] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:22:41.468304 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48c088-d1b7-4104-9856-5757084a731b None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:22:41.470418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-0a48c088-d1b7-4104-9856-5757084a731b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:41.574328 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:41.663576 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48c088-d1b7-4104-9856-5757084a731b None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:22:41.816058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666323b-de10-400a-bf38-1f24e132d71f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:22:41.816702 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666323b-de10-400a-bf38-1f24e132d71f service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:41.816980 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666323b-de10-400a-bf38-1f24e132d71f service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:41.817249 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666323b-de10-400a-bf38-1f24e132d71f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:41.818918 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-9666323b-de10-400a-bf38-1f24e132d71f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:41.879998 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:41.980160 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666323b-de10-400a-bf38-1f24e132d71f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:22:41.983829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666323b-de10-400a-bf38-1f24e132d71f service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:22:42.030340 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 698/1409] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:22:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:22:51.168518 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=56 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:52.017766 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=29 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:54.176794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ebf44-ec67-41e9-955d-a8ad3fd3dd9f None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:54.177388 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ebf44-ec67-41e9-955d-a8ad3fd3dd9f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:54.177499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ebf44-ec67-41e9-955d-a8ad3fd3dd9f None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:54.181019 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 712/1410] 10.222.0.62 () {54 vars in 918 bytes} [Tue Oct 4 14:22:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:22:54.186997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a977118-3613-4fbd-bf27-b1ca42b8b864 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:54.187854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a977118-3613-4fbd-bf27-b1ca42b8b864 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:54.187854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a977118-3613-4fbd-bf27-b1ca42b8b864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:54.388865 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-2a977118-3613-4fbd-bf27-b1ca42b8b864 None None] MFA Rules not processed for user `6f98c07455a241398784d221df273aba`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:22:54.390656 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-2a977118-3613-4fbd-bf27-b1ca42b8b864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:54.503979 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 699/1411] 10.222.0.62 () {58 vars in 1015 bytes} [Tue Oct 4 14:22:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:22:54.520958 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3266d-4c2d-46a2-a7de-7afaf85dda3d None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:54.521268 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3266d-4c2d-46a2-a7de-7afaf85dda3d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:54.521571 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3266d-4c2d-46a2-a7de-7afaf85dda3d None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:54.523061 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 713/1412] 10.222.0.62 () {54 vars in 918 bytes} [Tue Oct 4 14:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:22:54.528629 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bfbf4-39bd-490f-9152-48625940b2c4 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:54.528909 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bfbf4-39bd-490f-9152-48625940b2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:54.529174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bfbf4-39bd-490f-9152-48625940b2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:54.605262 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:54.608368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-615bfbf4-39bd-490f-9152-48625940b2c4 None None] MFA Rules not processed for user `151e7b9c7a7b46d58dc2f563d05775e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:22:54.610196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-615bfbf4-39bd-490f-9152-48625940b2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:54.736184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 700/1413] 10.222.0.62 () {58 vars in 1015 bytes} [Tue Oct 4 14:22:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:22:57.453238 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4822d62-50a3-4f22-be0e-13e6c54e6237 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:57.453786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4822d62-50a3-4f22-be0e-13e6c54e6237 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:57.453786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4822d62-50a3-4f22-be0e-13e6c54e6237 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:57.455028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 14:22:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:22:57.461144 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d687a8-2734-4294-957b-7b02e42de751 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:57.461719 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d687a8-2734-4294-957b-7b02e42de751 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:57.461719 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d687a8-2734-4294-957b-7b02e42de751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:57.537376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-b3d687a8-2734-4294-957b-7b02e42de751 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:22:57.538605 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b3d687a8-2734-4294-957b-7b02e42de751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:57.598365 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:57.644166 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 14:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:22:57.942255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4822d62-50a3-4f22-be0e-13e6c54e6237 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:22:57.944112 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f4822d62-50a3-4f22-be0e-13e6c54e6237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:58.107055 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4822d62-50a3-4f22-be0e-13e6c54e6237 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:22:58.200026 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:58.243852 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938bc03-7d49-4438-97bd-9d31e14faa22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:22:58.244466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938bc03-7d49-4438-97bd-9d31e14faa22 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:58.244746 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938bc03-7d49-4438-97bd-9d31e14faa22 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:58.245019 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938bc03-7d49-4438-97bd-9d31e14faa22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:58.246659 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3938bc03-7d49-4438-97bd-9d31e14faa22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:58.343490 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938bc03-7d49-4438-97bd-9d31e14faa22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:22:58.345156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938bc03-7d49-4438-97bd-9d31e14faa22 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:22:58.363942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 715/1416] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:22:59.558637 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d9f16-88fa-4271-87f2-a554da3f688e None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:59.559118 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d9f16-88fa-4271-87f2-a554da3f688e None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:59.559234 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d9f16-88fa-4271-87f2-a554da3f688e None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:59.560536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 14:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:22:59.567552 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d382ce7-8526-4bc2-ac62-186079aff6b9 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:22:59.568086 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d382ce7-8526-4bc2-ac62-186079aff6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:22:59.568086 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d382ce7-8526-4bc2-ac62-186079aff6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:22:59.660451 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-5d382ce7-8526-4bc2-ac62-186079aff6b9 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:22:59.661675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5d382ce7-8526-4bc2-ac62-186079aff6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:22:59.691732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:59.773301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 14:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:22:59.926118 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d9f16-88fa-4271-87f2-a554da3f688e None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:22:59.927530 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-446d9f16-88fa-4271-87f2-a554da3f688e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:00.092775 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d9f16-88fa-4271-87f2-a554da3f688e None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:23:00.145931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:00.229947 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d0916-ab97-49aa-9831-4d835ddf7732 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:23:00.230538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d0916-ab97-49aa-9831-4d835ddf7732 service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:00.230818 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d0916-ab97-49aa-9831-4d835ddf7732 service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:00.231118 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d0916-ab97-49aa-9831-4d835ddf7732 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:00.232744 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-0c7d0916-ab97-49aa-9831-4d835ddf7732 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:00.329984 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d0916-ab97-49aa-9831-4d835ddf7732 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:23:00.331574 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d0916-ab97-49aa-9831-4d835ddf7732 service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:23:00.350532 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 703/1419] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:22:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:23:01.582866 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0804e-fb92-4a23-b3ff-c9bce1110f9f None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:01.583471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0804e-fb92-4a23-b3ff-c9bce1110f9f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:01.583471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0804e-fb92-4a23-b3ff-c9bce1110f9f None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:01.584820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 14:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:23:01.593287 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8b394-4f52-46f9-9e83-e2245bf768e2 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:01.593864 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8b394-4f52-46f9-9e83-e2245bf768e2 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:01.593864 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8b394-4f52-46f9-9e83-e2245bf768e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:01.657224 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:01.683870 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-8aa8b394-4f52-46f9-9e83-e2245bf768e2 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:23:01.685093 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-8aa8b394-4f52-46f9-9e83-e2245bf768e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:01.792297 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 14:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:23:01.945756 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0804e-fb92-4a23-b3ff-c9bce1110f9f None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:23:01.947296 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3ea0804e-fb92-4a23-b3ff-c9bce1110f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:02.110349 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0804e-fb92-4a23-b3ff-c9bce1110f9f None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:23:02.124916 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:02.239952 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060752d-4923-4ed3-951c-df99e35174bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:23:02.240536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060752d-4923-4ed3-951c-df99e35174bf service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:02.240815 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060752d-4923-4ed3-951c-df99e35174bf service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:02.241080 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060752d-4923-4ed3-951c-df99e35174bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:02.242833 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f060752d-4923-4ed3-951c-df99e35174bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:02.348122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060752d-4923-4ed3-951c-df99e35174bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:23:02.349751 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060752d-4923-4ed3-951c-df99e35174bf service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:23:02.370057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 718/1422] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:23:03.541872 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9e7e2-c80d-4c19-abf9-2eeac42ff17a None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:03.542533 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9e7e2-c80d-4c19-abf9-2eeac42ff17a None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:03.542533 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9e7e2-c80d-4c19-abf9-2eeac42ff17a None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:03.543831 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 14:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:23:03.551163 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a8252-ab62-416a-832a-4796d5536016 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:03.551792 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a8252-ab62-416a-832a-4796d5536016 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:03.551792 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a8252-ab62-416a-832a-4796d5536016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:03.573229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:03.634853 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-113a8252-ab62-416a-832a-4796d5536016 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:23:03.636104 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-113a8252-ab62-416a-832a-4796d5536016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:03.734923 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 14:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:23:03.887968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9e7e2-c80d-4c19-abf9-2eeac42ff17a None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:23:03.889422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-06e9e7e2-c80d-4c19-abf9-2eeac42ff17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:03.998205 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:04.034984 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9e7e2-c80d-4c19-abf9-2eeac42ff17a None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:23:04.146775 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa34f15-6237-4590-adf4-283133ad0aec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:23:04.147303 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa34f15-6237-4590-adf4-283133ad0aec service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:04.147610 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa34f15-6237-4590-adf4-283133ad0aec service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:04.147917 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa34f15-6237-4590-adf4-283133ad0aec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:04.149526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-9aa34f15-6237-4590-adf4-283133ad0aec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:04.226746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:04.241190 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa34f15-6237-4590-adf4-283133ad0aec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:23:04.242777 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa34f15-6237-4590-adf4-283133ad0aec service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:23:04.260645 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 706/1425] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:23:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:23:05.390587 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e8ebd-960e-4d5d-8eb2-574058a1abab None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:05.391168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e8ebd-960e-4d5d-8eb2-574058a1abab None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:05.391168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e8ebd-960e-4d5d-8eb2-574058a1abab None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:05.392504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 14:23:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:23:05.399278 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46245044-d944-4abf-b2a9-a2c149b8d78d None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:05.399829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46245044-d944-4abf-b2a9-a2c149b8d78d None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:05.399829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46245044-d944-4abf-b2a9-a2c149b8d78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:05.493884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-46245044-d944-4abf-b2a9-a2c149b8d78d None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:23:05.495277 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-46245044-d944-4abf-b2a9-a2c149b8d78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:05.606065 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 14:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:23:05.765493 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e8ebd-960e-4d5d-8eb2-574058a1abab None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:23:05.767060 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5e8e8ebd-960e-4d5d-8eb2-574058a1abab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:05.860655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:05.931005 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e8ebd-960e-4d5d-8eb2-574058a1abab None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:23:06.062011 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecbee2-65cd-4304-a611-cd73f8bba855 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:23:06.062701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecbee2-65cd-4304-a611-cd73f8bba855 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:06.063075 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecbee2-65cd-4304-a611-cd73f8bba855 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:06.063450 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecbee2-65cd-4304-a611-cd73f8bba855 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:06.065759 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1fecbee2-65cd-4304-a611-cd73f8bba855 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:06.130332 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:06.182106 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecbee2-65cd-4304-a611-cd73f8bba855 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:23:06.183772 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecbee2-65cd-4304-a611-cd73f8bba855 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:23:06.206347 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 721/1428] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:23:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:23:07.294734 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569339f-5b5c-48c2-85f8-272960a0fe5f None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:07.295312 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569339f-5b5c-48c2-85f8-272960a0fe5f None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:07.295312 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569339f-5b5c-48c2-85f8-272960a0fe5f None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:07.297217 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 14:23:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:23:07.304112 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136a6b3-69dc-4ab5-a3af-f7d55f56f6e0 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:07.304655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136a6b3-69dc-4ab5-a3af-f7d55f56f6e0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:07.304655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136a6b3-69dc-4ab5-a3af-f7d55f56f6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:07.392443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-5136a6b3-69dc-4ab5-a3af-f7d55f56f6e0 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:23:07.393653 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5136a6b3-69dc-4ab5-a3af-f7d55f56f6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:07.498658 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 14:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:23:07.659299 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569339f-5b5c-48c2-85f8-272960a0fe5f None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:23:07.661015 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-4569339f-5b5c-48c2-85f8-272960a0fe5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:07.714144 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:07.830075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569339f-5b5c-48c2-85f8-272960a0fe5f None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:23:07.965576 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa5ff4-431d-4ad8-8fc5-106240826390 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:23:07.966184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa5ff4-431d-4ad8-8fc5-106240826390 service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:07.966456 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa5ff4-431d-4ad8-8fc5-106240826390 service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:07.966751 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa5ff4-431d-4ad8-8fc5-106240826390 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:07.969073 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-ebfa5ff4-431d-4ad8-8fc5-106240826390 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:07.976490 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:08.072835 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa5ff4-431d-4ad8-8fc5-106240826390 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:23:08.074413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa5ff4-431d-4ad8-8fc5-106240826390 service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:23:08.093817 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 709/1431] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:23:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:23:09.271001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630426b-9d2d-40a9-9cf6-584e709b6bdf None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:09.271634 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630426b-9d2d-40a9-9cf6-584e709b6bdf None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:09.271634 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630426b-9d2d-40a9-9cf6-584e709b6bdf None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:09.273103 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 14:23:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:23:09.280496 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803d8df-1ec1-4574-af27-22a55b61a6e9 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:09.281086 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803d8df-1ec1-4574-af27-22a55b61a6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:09.281086 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803d8df-1ec1-4574-af27-22a55b61a6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:09.378341 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-1803d8df-1ec1-4574-af27-22a55b61a6e9 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:23:09.379599 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-1803d8df-1ec1-4574-af27-22a55b61a6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:09.464619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:09.504438 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 14:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:23:09.663418 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630426b-9d2d-40a9-9cf6-584e709b6bdf None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:23:09.665476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8630426b-9d2d-40a9-9cf6-584e709b6bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:09.691380 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:09.886355 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630426b-9d2d-40a9-9cf6-584e709b6bdf None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:23:09.989465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:10.018673 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615aa47-3e16-4505-8b06-ed16cbe07a6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:23:10.019286 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615aa47-3e16-4505-8b06-ed16cbe07a6b service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:10.019562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615aa47-3e16-4505-8b06-ed16cbe07a6b service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:10.019861 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615aa47-3e16-4505-8b06-ed16cbe07a6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:10.021522 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b615aa47-3e16-4505-8b06-ed16cbe07a6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:10.123096 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615aa47-3e16-4505-8b06-ed16cbe07a6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:23:10.125935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615aa47-3e16-4505-8b06-ed16cbe07a6b service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:23:10.152152 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 724/1434] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:23:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:23:11.269272 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9945fc-21a5-4089-ae72-e85223055987 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:11.269851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9945fc-21a5-4089-ae72-e85223055987 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:11.269998 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9945fc-21a5-4089-ae72-e85223055987 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:11.271692 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 14:23:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:23:11.279116 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b74023-8d57-4d04-9621-543ad9721b2b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:11.280233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b74023-8d57-4d04-9621-543ad9721b2b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:11.280421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b74023-8d57-4d04-9621-543ad9721b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:11.371603 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-b8b74023-8d57-4d04-9621-543ad9721b2b None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:23:11.372901 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b8b74023-8d57-4d04-9621-543ad9721b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:11.428911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:11.518420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 14:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:23:11.672285 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9945fc-21a5-4089-ae72-e85223055987 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:23:11.674893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-8a9945fc-21a5-4089-ae72-e85223055987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:11.851339 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9945fc-21a5-4089-ae72-e85223055987 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:23:11.918748 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:11.988726 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9dbde-4275-463f-b0ae-b2702053d2ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:23:11.989335 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9dbde-4275-463f-b0ae-b2702053d2ce service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:11.989614 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9dbde-4275-463f-b0ae-b2702053d2ce service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:11.989878 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9dbde-4275-463f-b0ae-b2702053d2ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:11.991520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-24b9dbde-4275-463f-b0ae-b2702053d2ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:12.092240 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9dbde-4275-463f-b0ae-b2702053d2ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:23:12.093891 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9dbde-4275-463f-b0ae-b2702053d2ce service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:23:12.114841 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 712/1437] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:23:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:23:13.257799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95098b7a-ce5d-4b5b-a6a6-0817f2c81bc0 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:13.258340 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95098b7a-ce5d-4b5b-a6a6-0817f2c81bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:13.258340 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95098b7a-ce5d-4b5b-a6a6-0817f2c81bc0 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:13.259659 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 14:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:23:13.267258 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf46563-5c7d-4d25-add6-c70e25651c58 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:13.267810 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf46563-5c7d-4d25-add6-c70e25651c58 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:13.267810 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf46563-5c7d-4d25-add6-c70e25651c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:13.347636 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-fdf46563-5c7d-4d25-add6-c70e25651c58 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:23:13.348881 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-fdf46563-5c7d-4d25-add6-c70e25651c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:13.351008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:13.448591 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 14:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:23:13.606022 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95098b7a-ce5d-4b5b-a6a6-0817f2c81bc0 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:23:13.607603 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-95098b7a-ce5d-4b5b-a6a6-0817f2c81bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:13.763692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95098b7a-ce5d-4b5b-a6a6-0817f2c81bc0 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:23:13.794365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:13.894283 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b690206-a097-4e68-9609-6f3450555502 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:23:13.894910 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b690206-a097-4e68-9609-6f3450555502 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:13.895186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b690206-a097-4e68-9609-6f3450555502 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:13.895456 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b690206-a097-4e68-9609-6f3450555502 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:13.897157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8b690206-a097-4e68-9609-6f3450555502 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:13.996430 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b690206-a097-4e68-9609-6f3450555502 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:23:13.998045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b690206-a097-4e68-9609-6f3450555502 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:23:14.017607 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 727/1440] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:23:16.192339 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9c32c-677f-4688-94ef-ecebf6733b71 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:16.192943 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9c32c-677f-4688-94ef-ecebf6733b71 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:16.192943 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9c32c-677f-4688-94ef-ecebf6733b71 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:16.194345 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 14:23:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:23:16.200277 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec72a4c-a217-4b53-8f17-609ac4119eab None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:16.200856 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec72a4c-a217-4b53-8f17-609ac4119eab None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:16.200856 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec72a4c-a217-4b53-8f17-609ac4119eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:16.253470 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:16.284324 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-8ec72a4c-a217-4b53-8f17-609ac4119eab None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:23:16.285825 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8ec72a4c-a217-4b53-8f17-609ac4119eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:16.429266 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 14:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:23:16.749200 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9c32c-677f-4688-94ef-ecebf6733b71 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:23:16.750851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-1dc9c32c-677f-4688-94ef-ecebf6733b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:16.880198 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9c32c-677f-4688-94ef-ecebf6733b71 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:23:16.919013 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:16.978773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32194789-012d-4502-9090-92b823dfdf64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:23:16.979415 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32194789-012d-4502-9090-92b823dfdf64 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:16.979697 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32194789-012d-4502-9090-92b823dfdf64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:16.980005 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32194789-012d-4502-9090-92b823dfdf64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:16.981797 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-32194789-012d-4502-9090-92b823dfdf64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:17.117011 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32194789-012d-4502-9090-92b823dfdf64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:23:17.119302 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32194789-012d-4502-9090-92b823dfdf64 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:23:17.152294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 715/1443] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:23:19.588574 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afbbb6-a8f2-46eb-a6b7-89cda903c038 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:19.589421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afbbb6-a8f2-46eb-a6b7-89cda903c038 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:19.589421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afbbb6-a8f2-46eb-a6b7-89cda903c038 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:19.590613 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 14:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:23:19.597578 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feac936-1b2d-47ef-b21c-ebf83987fde9 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:19.598152 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feac936-1b2d-47ef-b21c-ebf83987fde9 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:19.598258 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feac936-1b2d-47ef-b21c-ebf83987fde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:19.676815 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-1feac936-1b2d-47ef-b21c-ebf83987fde9 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:23:19.678029 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-1feac936-1b2d-47ef-b21c-ebf83987fde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:19.692661 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:19.790149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 14:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:23:20.095473 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afbbb6-a8f2-46eb-a6b7-89cda903c038 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:23:20.097076 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-12afbbb6-a8f2-46eb-a6b7-89cda903c038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:20.203979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afbbb6-a8f2-46eb-a6b7-89cda903c038 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:23:20.217619 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:20.294873 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59897a94-2572-425e-8df6-0812b0735919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:23:20.295765 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59897a94-2572-425e-8df6-0812b0735919 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:20.296025 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59897a94-2572-425e-8df6-0812b0735919 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:20.296290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59897a94-2572-425e-8df6-0812b0735919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:20.297914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-59897a94-2572-425e-8df6-0812b0735919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:20.540202 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59897a94-2572-425e-8df6-0812b0735919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:23:20.541705 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59897a94-2572-425e-8df6-0812b0735919 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:23:20.563375 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 730/1446] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:23:23.133098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c94db-990d-458c-bcca-c019054ba86a None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:23.133688 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c94db-990d-458c-bcca-c019054ba86a None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:23.133688 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c94db-990d-458c-bcca-c019054ba86a None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:23.135023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 14:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:23:23.140693 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae47f0-6487-4661-bf67-4450ecfdc719 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:23.141136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae47f0-6487-4661-bf67-4450ecfdc719 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:23.141261 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae47f0-6487-4661-bf67-4450ecfdc719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:23.194386 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:23.213021 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-8aae47f0-6487-4661-bf67-4450ecfdc719 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:23:23.214230 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8aae47f0-6487-4661-bf67-4450ecfdc719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:23.315300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 14:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:23:23.614046 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c94db-990d-458c-bcca-c019054ba86a None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:23:23.615644 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-5e6c94db-990d-458c-bcca-c019054ba86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:23.734015 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c94db-990d-458c-bcca-c019054ba86a None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:23:23.775390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:23.811047 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a12e30-a75d-4769-bacc-ff776cd41f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:23:23.811572 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a12e30-a75d-4769-bacc-ff776cd41f42 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:23.811867 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a12e30-a75d-4769-bacc-ff776cd41f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:23.812133 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a12e30-a75d-4769-bacc-ff776cd41f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:23.813756 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a5a12e30-a75d-4769-bacc-ff776cd41f42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:23.929446 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a12e30-a75d-4769-bacc-ff776cd41f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:23:23.930887 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a12e30-a75d-4769-bacc-ff776cd41f42 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:23:23.949570 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 718/1449] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:23:26.316779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebcef9-250f-4457-addc-88a7817a417c None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:26.316779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebcef9-250f-4457-addc-88a7817a417c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:26.317592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebcef9-250f-4457-addc-88a7817a417c None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:26.318339 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 14:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:23:26.324183 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbe3a0-023a-41c4-b47e-89c8670a7eac None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:26.324676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbe3a0-023a-41c4-b47e-89c8670a7eac None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:26.324773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbe3a0-023a-41c4-b47e-89c8670a7eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:26.400211 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-c0fbe3a0-023a-41c4-b47e-89c8670a7eac None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:23:26.401439 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-c0fbe3a0-023a-41c4-b47e-89c8670a7eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:26.423176 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:26.503246 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 14:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:23:26.789716 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebcef9-250f-4457-addc-88a7817a417c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:23:26.791282 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-fdebcef9-250f-4457-addc-88a7817a417c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:26.902320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebcef9-250f-4457-addc-88a7817a417c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:23:26.924550 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:26.978090 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bad9e-a396-412d-95b5-052d5f527dbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:23:26.978827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bad9e-a396-412d-95b5-052d5f527dbe service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:26.979108 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bad9e-a396-412d-95b5-052d5f527dbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:26.979378 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bad9e-a396-412d-95b5-052d5f527dbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:26.980998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d78bad9e-a396-412d-95b5-052d5f527dbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:27.104178 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78bad9e-a396-412d-95b5-052d5f527dbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:23:27.105519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78bad9e-a396-412d-95b5-052d5f527dbe service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:23:27.124240 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 733/1452] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:23:29.412701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c1619-7e3d-4a57-8e9d-ead092922009 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:29.413244 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c1619-7e3d-4a57-8e9d-ead092922009 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:29.413244 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c1619-7e3d-4a57-8e9d-ead092922009 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:29.414596 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 14:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:23:29.420814 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbfa8a-c6ca-4c03-ba5c-23e9d25bb438 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:29.421559 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbfa8a-c6ca-4c03-ba5c-23e9d25bb438 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:29.421559 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbfa8a-c6ca-4c03-ba5c-23e9d25bb438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:29.485330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:29.488046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-17bbfa8a-c6ca-4c03-ba5c-23e9d25bb438 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:23:29.490004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-17bbfa8a-c6ca-4c03-ba5c-23e9d25bb438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:29.588340 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 14:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:23:29.899025 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c1619-7e3d-4a57-8e9d-ead092922009 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:23:29.900929 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-041c1619-7e3d-4a57-8e9d-ead092922009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:30.007045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c1619-7e3d-4a57-8e9d-ead092922009 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:23:30.062794 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:30.088249 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e587137-0f04-45ae-8782-6e5bc3db3d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:23:30.088858 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e587137-0f04-45ae-8782-6e5bc3db3d20 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:30.089134 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e587137-0f04-45ae-8782-6e5bc3db3d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:30.089402 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e587137-0f04-45ae-8782-6e5bc3db3d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:30.091022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-6e587137-0f04-45ae-8782-6e5bc3db3d20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:30.206724 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e587137-0f04-45ae-8782-6e5bc3db3d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:23:30.208211 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e587137-0f04-45ae-8782-6e5bc3db3d20 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:23:30.226468 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 721/1455] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:23:32.680834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ec88c-e177-4808-aaa8-a89a4060d679 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:32.681435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ec88c-e177-4808-aaa8-a89a4060d679 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:32.681545 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ec88c-e177-4808-aaa8-a89a4060d679 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:32.683202 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 14:23:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:23:32.691115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53d0c8-e62c-4628-a339-9a2b1f36e709 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:32.691666 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53d0c8-e62c-4628-a339-9a2b1f36e709 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:32.691666 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53d0c8-e62c-4628-a339-9a2b1f36e709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:32.768123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-ab53d0c8-e62c-4628-a339-9a2b1f36e709 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:23:32.769364 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-ab53d0c8-e62c-4628-a339-9a2b1f36e709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:32.801145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:32.876435 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 14:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:23:33.164626 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ec88c-e177-4808-aaa8-a89a4060d679 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:23:33.166150 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-648ec88c-e177-4808-aaa8-a89a4060d679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:33.279446 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ec88c-e177-4808-aaa8-a89a4060d679 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:23:33.308939 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:33.360016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9cdf2-d93e-4ae7-a04f-478171e805ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:23:33.365395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9cdf2-d93e-4ae7-a04f-478171e805ef service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:33.365395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9cdf2-d93e-4ae7-a04f-478171e805ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:33.365395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9cdf2-d93e-4ae7-a04f-478171e805ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:33.365395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bad9cdf2-d93e-4ae7-a04f-478171e805ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:33.482661 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9cdf2-d93e-4ae7-a04f-478171e805ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:23:33.484134 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9cdf2-d93e-4ae7-a04f-478171e805ef service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:23:33.503161 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 736/1458] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:23:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:23:35.899578 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36004a67-e342-433e-8248-bc8f81ce1e5e None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:35.900157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36004a67-e342-433e-8248-bc8f81ce1e5e None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:35.900157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36004a67-e342-433e-8248-bc8f81ce1e5e None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:35.901405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 14:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:23:35.907687 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c0747-5184-4ac1-88d1-5c2de40f9bdf None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:35.908136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c0747-5184-4ac1-88d1-5c2de40f9bdf None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:35.908271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c0747-5184-4ac1-88d1-5c2de40f9bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:35.974713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c98c0747-5184-4ac1-88d1-5c2de40f9bdf None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:23:35.975936 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c98c0747-5184-4ac1-88d1-5c2de40f9bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:35.984229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:36.080788 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 14:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:23:36.362816 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36004a67-e342-433e-8248-bc8f81ce1e5e None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:23:36.364421 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-36004a67-e342-433e-8248-bc8f81ce1e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:36.471440 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36004a67-e342-433e-8248-bc8f81ce1e5e None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:23:36.526092 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:36.545409 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6dc7c-5efd-4070-9e4d-e3b02bed7520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:23:36.546013 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6dc7c-5efd-4070-9e4d-e3b02bed7520 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:36.546292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6dc7c-5efd-4070-9e4d-e3b02bed7520 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:36.546561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6dc7c-5efd-4070-9e4d-e3b02bed7520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:36.548173 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b4d6dc7c-5efd-4070-9e4d-e3b02bed7520 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:36.661967 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6dc7c-5efd-4070-9e4d-e3b02bed7520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:23:36.663322 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6dc7c-5efd-4070-9e4d-e3b02bed7520 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:23:36.681728 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 724/1461] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:23:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:23:38.923260 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163aeb2b-bb99-44f4-897b-068b72548185 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:38.923823 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163aeb2b-bb99-44f4-897b-068b72548185 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:38.923823 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163aeb2b-bb99-44f4-897b-068b72548185 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:38.925055 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 14:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:23:38.930336 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c6cb7-9186-4516-a9b7-e3f3b13f136e None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:38.930773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c6cb7-9186-4516-a9b7-e3f3b13f136e None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:38.930871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c6cb7-9186-4516-a9b7-e3f3b13f136e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:38.999855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-0a4c6cb7-9186-4516-a9b7-e3f3b13f136e None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:23:39.001059 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-0a4c6cb7-9186-4516-a9b7-e3f3b13f136e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:39.039775 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:39.098641 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 14:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:23:39.402355 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163aeb2b-bb99-44f4-897b-068b72548185 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:23:39.404521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-163aeb2b-bb99-44f4-897b-068b72548185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:39.516388 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163aeb2b-bb99-44f4-897b-068b72548185 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:23:39.562440 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:39.599297 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d62b74-b0af-48a7-a866-7250dfba3b7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:23:39.599930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d62b74-b0af-48a7-a866-7250dfba3b7c service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:39.600207 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d62b74-b0af-48a7-a866-7250dfba3b7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:39.600474 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d62b74-b0af-48a7-a866-7250dfba3b7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:39.602061 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-51d62b74-b0af-48a7-a866-7250dfba3b7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:39.710867 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d62b74-b0af-48a7-a866-7250dfba3b7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:23:39.712568 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d62b74-b0af-48a7-a866-7250dfba3b7c service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:23:39.732022 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 739/1464] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:23:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:23:41.963604 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbc0ee-325f-4f67-9af6-4f41aafd5e33 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:41.964239 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbc0ee-325f-4f67-9af6-4f41aafd5e33 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:41.964239 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbc0ee-325f-4f67-9af6-4f41aafd5e33 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:41.965532 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 14:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:23:41.972215 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea4de3-1bc9-4d0f-a9b3-4f44a067a645 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:41.972640 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea4de3-1bc9-4d0f-a9b3-4f44a067a645 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:41.972749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea4de3-1bc9-4d0f-a9b3-4f44a067a645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:42.040714 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-56ea4de3-1bc9-4d0f-a9b3-4f44a067a645 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:23:42.041928 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-56ea4de3-1bc9-4d0f-a9b3-4f44a067a645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:42.061558 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:42.141432 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 14:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:23:42.429446 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbc0ee-325f-4f67-9af6-4f41aafd5e33 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:23:42.431026 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-17bbc0ee-325f-4f67-9af6-4f41aafd5e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:42.558414 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbc0ee-325f-4f67-9af6-4f41aafd5e33 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:23:42.626780 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:42.633497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31999cde-ee90-4b16-95aa-d646c6b435dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:23:42.634102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31999cde-ee90-4b16-95aa-d646c6b435dd service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:42.634378 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31999cde-ee90-4b16-95aa-d646c6b435dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:42.634646 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31999cde-ee90-4b16-95aa-d646c6b435dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:42.636280 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-31999cde-ee90-4b16-95aa-d646c6b435dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:42.746853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31999cde-ee90-4b16-95aa-d646c6b435dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:23:42.748761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31999cde-ee90-4b16-95aa-d646c6b435dd service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:23:42.767570 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 727/1467] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:23:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:23:45.020949 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe478a5-44c9-4c02-b7c7-bd188e15f883 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:45.021519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe478a5-44c9-4c02-b7c7-bd188e15f883 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:45.021519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe478a5-44c9-4c02-b7c7-bd188e15f883 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:45.022858 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 14:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:23:45.028272 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f9ebb-2a01-4708-a8b6-15ea3134680f None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:45.028742 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f9ebb-2a01-4708-a8b6-15ea3134680f None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:45.029410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f9ebb-2a01-4708-a8b6-15ea3134680f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:45.096131 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-ae5f9ebb-2a01-4708-a8b6-15ea3134680f None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:23:45.097349 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-ae5f9ebb-2a01-4708-a8b6-15ea3134680f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:45.146134 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:45.202361 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 14:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:23:45.485646 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe478a5-44c9-4c02-b7c7-bd188e15f883 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:23:45.487168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-dbe478a5-44c9-4c02-b7c7-bd188e15f883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:45.591946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe478a5-44c9-4c02-b7c7-bd188e15f883 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:23:45.640697 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:45.666492 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a4f9d-2daf-4c0e-8ab7-f84d3316af9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:23:45.667096 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a4f9d-2daf-4c0e-8ab7-f84d3316af9b service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:23:45.667368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a4f9d-2daf-4c0e-8ab7-f84d3316af9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:23:45.667628 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a4f9d-2daf-4c0e-8ab7-f84d3316af9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:23:45.669275 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c76a4f9d-2daf-4c0e-8ab7-f84d3316af9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:23:45.780857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a4f9d-2daf-4c0e-8ab7-f84d3316af9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:23:45.782207 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a4f9d-2daf-4c0e-8ab7-f84d3316af9b service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:23:45.800363 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 742/1470] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:23:55.199766 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=22 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:55.797963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=66 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:24:05.919061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284f5eb-242c-4005-8c11-67f5df5df242 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:24:05.919631 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284f5eb-242c-4005-8c11-67f5df5df242 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:24:05.919631 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284f5eb-242c-4005-8c11-67f5df5df242 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:24:05.920908 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 729/1471] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:24:05.926376 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f440a-8014-4877-b4ae-af551c9f7a5b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:24:05.926836 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f440a-8014-4877-b4ae-af551c9f7a5b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:24:05.926941 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f440a-8014-4877-b4ae-af551c9f7a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:24:05.998499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-bf8f440a-8014-4877-b4ae-af551c9f7a5b None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:24:05.999799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bf8f440a-8014-4877-b4ae-af551c9f7a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:24:06.101010 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 743/1472] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:24:06.405576 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cdc49-e58d-42b9-a2b1-06592cc53ed9 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:24:06.405853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cdc49-e58d-42b9-a2b1-06592cc53ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:24:06.406125 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cdc49-e58d-42b9-a2b1-06592cc53ed9 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:24:06.407503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 730/1473] 10.222.0.62 () {54 vars in 962 bytes} [Tue Oct 4 14:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:24:06.413614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f32245-bb23-4ed8-8cf1-a8b568a6c8e8 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:24:06.413895 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f32245-bb23-4ed8-8cf1-a8b568a6c8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:24:06.414169 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f32245-bb23-4ed8-8cf1-a8b568a6c8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:24:06.496333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-b6f32245-bb23-4ed8-8cf1-a8b568a6c8e8 None None] MFA Rules not processed for user `289b020c9cd242dca9b512803199daae`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:24:06.498006 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b6f32245-bb23-4ed8-8cf1-a8b568a6c8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:24:06.520894 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:24:06.592348 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 744/1474] 10.222.0.62 () {58 vars in 1059 bytes} [Tue Oct 4 14:24:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:24:06.600295 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cdc49-e58d-42b9-a2b1-06592cc53ed9 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:24:06.601997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-867cdc49-e58d-42b9-a2b1-06592cc53ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:24:06.738452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cdc49-e58d-42b9-a2b1-06592cc53ed9 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:24:06.826329 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e2183-8a92-4325-8a5e-cfe9cdff45d4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '289b020c9cd242dca9b512803199daae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:24:06.827036 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e2183-8a92-4325-8a5e-cfe9cdff45d4 service glance] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:24:06.827313 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e2183-8a92-4325-8a5e-cfe9cdff45d4 service glance] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:24:06.827572 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e2183-8a92-4325-8a5e-cfe9cdff45d4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:24:06.829297 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-0a6e2183-8a92-4325-8a5e-cfe9cdff45d4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:24:06.888574 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:24:06.948735 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e2183-8a92-4325-8a5e-cfe9cdff45d4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:24:06.950863 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e2183-8a92-4325-8a5e-cfe9cdff45d4 service glance] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:24:06.970660 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 731/1475] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:24:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:24:09.274612 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec59b47-af5b-44f7-9ccb-beafed2d1b0f None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:24:09.275167 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec59b47-af5b-44f7-9ccb-beafed2d1b0f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:24:09.275167 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec59b47-af5b-44f7-9ccb-beafed2d1b0f None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:24:09.276570 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 745/1476] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:24:09.282447 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd63576-35c2-45ae-b0f2-0094f80185d5 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:24:09.282873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd63576-35c2-45ae-b0f2-0094f80185d5 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:24:09.282997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd63576-35c2-45ae-b0f2-0094f80185d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:24:09.358634 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-3dd63576-35c2-45ae-b0f2-0094f80185d5 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:24:09.359915 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-3dd63576-35c2-45ae-b0f2-0094f80185d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:24:09.457629 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 732/1477] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:24:09.734085 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec59b47-af5b-44f7-9ccb-beafed2d1b0f None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:24:09.736851 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-dec59b47-af5b-44f7-9ccb-beafed2d1b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:24:09.874253 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec59b47-af5b-44f7-9ccb-beafed2d1b0f None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:24:09.929681 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:24:09.984654 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81eeafa-190f-4143-9a10-635e9abadd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:24:09.985313 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81eeafa-190f-4143-9a10-635e9abadd0d admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:24:09.985589 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81eeafa-190f-4143-9a10-635e9abadd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:24:09.985857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81eeafa-190f-4143-9a10-635e9abadd0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:24:09.986506 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81eeafa-190f-4143-9a10-635e9abadd0d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:24:09.988306 dv-cinder-860260-1-smb devstack@keystone.service[81467]: WARNING py.warnings [None req-e81eeafa-190f-4143-9a10-635e9abadd0d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 14:24:09.988306 dv-cinder-860260-1-smb devstack@keystone.service[81467]: warnings.warn(msg) Oct 04 14:24:09.988306 dv-cinder-860260-1-smb devstack@keystone.service[81467]: Oct 04 14:24:09.989450 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81eeafa-190f-4143-9a10-635e9abadd0d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:24:10.015579 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 746/1478] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Oct 4 14:24:09 2022] GET /identity/v3/projects => generated 2553 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:24:12.484786 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0cc6a-d4d9-4fd8-a865-5ff90e0b5939 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:24:12.485384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0cc6a-d4d9-4fd8-a865-5ff90e0b5939 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:24:12.485384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0cc6a-d4d9-4fd8-a865-5ff90e0b5939 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:24:12.486644 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 733/1479] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:24:12.492050 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d62526-7cd8-46d0-b791-90c4740b3a16 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:24:12.492475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d62526-7cd8-46d0-b791-90c4740b3a16 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:24:12.492580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d62526-7cd8-46d0-b791-90c4740b3a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:24:12.567078 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e4d62526-7cd8-46d0-b791-90c4740b3a16 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:24:12.568492 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e4d62526-7cd8-46d0-b791-90c4740b3a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:24:12.678160 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 747/1480] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:24:12.982902 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0cc6a-d4d9-4fd8-a865-5ff90e0b5939 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:24:12.985724 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-7dd0cc6a-d4d9-4fd8-a865-5ff90e0b5939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:24:12.995427 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:24:13.140148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0cc6a-d4d9-4fd8-a865-5ff90e0b5939 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:24:13.225134 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:24:13.261292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47094a91-6a83-4dd4-9cc5-82cab8e935e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:24:13.262148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47094a91-6a83-4dd4-9cc5-82cab8e935e3 service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:24:13.262291 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47094a91-6a83-4dd4-9cc5-82cab8e935e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:24:13.262520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47094a91-6a83-4dd4-9cc5-82cab8e935e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:24:13.264317 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-47094a91-6a83-4dd4-9cc5-82cab8e935e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:24:13.362046 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47094a91-6a83-4dd4-9cc5-82cab8e935e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:24:13.367227 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47094a91-6a83-4dd4-9cc5-82cab8e935e3 service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:24:13.388873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 734/1481] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:24:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:24:15.922554 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ceeda-8e50-4fa3-a84a-5b7ddbfea093 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:24:15.923100 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ceeda-8e50-4fa3-a84a-5b7ddbfea093 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:24:15.923100 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ceeda-8e50-4fa3-a84a-5b7ddbfea093 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:24:15.924621 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 748/1482] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:24:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:24:15.930544 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dfd53-0845-43c1-a44b-5409949b5487 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:24:15.931241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dfd53-0845-43c1-a44b-5409949b5487 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:24:15.931241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dfd53-0845-43c1-a44b-5409949b5487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:24:16.003078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-b16dfd53-0845-43c1-a44b-5409949b5487 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:24:16.004306 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b16dfd53-0845-43c1-a44b-5409949b5487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:24:16.057228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:24:16.114171 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 735/1483] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:24:16.405591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ceeda-8e50-4fa3-a84a-5b7ddbfea093 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:24:16.407345 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d22ceeda-8e50-4fa3-a84a-5b7ddbfea093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:24:16.432419 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:24:16.515785 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ceeda-8e50-4fa3-a84a-5b7ddbfea093 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:24:16.594582 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d408308-d34e-486c-a792-157d86574df6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:24:16.595193 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d408308-d34e-486c-a792-157d86574df6 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:24:16.595471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d408308-d34e-486c-a792-157d86574df6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:24:16.595764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d408308-d34e-486c-a792-157d86574df6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:24:16.597363 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3d408308-d34e-486c-a792-157d86574df6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:24:16.672903 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:24:16.709394 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d408308-d34e-486c-a792-157d86574df6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:24:16.710821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d408308-d34e-486c-a792-157d86574df6 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:24:16.731010 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 749/1484] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:24:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:24:19.149073 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f23b8-ec34-4c11-a101-cec918e73934 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:24:19.149659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f23b8-ec34-4c11-a101-cec918e73934 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:24:19.149659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f23b8-ec34-4c11-a101-cec918e73934 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:24:19.150949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 736/1485] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:24:19.156350 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0390d8-3719-450d-b22f-99310ea93f8f None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:24:19.156777 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0390d8-3719-450d-b22f-99310ea93f8f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:24:19.156917 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0390d8-3719-450d-b22f-99310ea93f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:24:19.223360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-0b0390d8-3719-450d-b22f-99310ea93f8f None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:24:19.224675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0b0390d8-3719-450d-b22f-99310ea93f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:24:19.322362 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 750/1486] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:24:19.622438 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f23b8-ec34-4c11-a101-cec918e73934 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:24:19.623983 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-dc6f23b8-ec34-4c11-a101-cec918e73934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:24:19.727277 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f23b8-ec34-4c11-a101-cec918e73934 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:24:19.804903 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:24:19.806833 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ee05c-ff61-46a4-bd38-0df73abcdd60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:24:19.807514 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ee05c-ff61-46a4-bd38-0df73abcdd60 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:24:19.808021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ee05c-ff61-46a4-bd38-0df73abcdd60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:24:19.808352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ee05c-ff61-46a4-bd38-0df73abcdd60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:24:19.811895 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-035ee05c-ff61-46a4-bd38-0df73abcdd60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:24:19.934851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ee05c-ff61-46a4-bd38-0df73abcdd60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:24:19.936392 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ee05c-ff61-46a4-bd38-0df73abcdd60 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:24:19.955390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 737/1487] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:24:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:24:22.350855 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc1958-bb78-4575-a5a3-7f127ab3eb78 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:24:22.351427 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc1958-bb78-4575-a5a3-7f127ab3eb78 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:24:22.351427 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc1958-bb78-4575-a5a3-7f127ab3eb78 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:24:22.352761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 751/1488] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:24:22.358653 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a6be7-dca6-496a-b8b1-7b18b547dcb0 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:24:22.359112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a6be7-dca6-496a-b8b1-7b18b547dcb0 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:24:22.359221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a6be7-dca6-496a-b8b1-7b18b547dcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:24:22.424742 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-fd1a6be7-dca6-496a-b8b1-7b18b547dcb0 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:24:22.425931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-fd1a6be7-dca6-496a-b8b1-7b18b547dcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:24:22.483222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:24:22.528627 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 738/1489] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:24:22.821552 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc1958-bb78-4575-a5a3-7f127ab3eb78 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:24:22.823085 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f3bc1958-bb78-4575-a5a3-7f127ab3eb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:24:22.860752 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:24:22.929423 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc1958-bb78-4575-a5a3-7f127ab3eb78 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:24:23.004875 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0691331-e94a-4020-a8fc-85fc86b79a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:24:23.005480 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0691331-e94a-4020-a8fc-85fc86b79a6e service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:24:23.005751 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0691331-e94a-4020-a8fc-85fc86b79a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:24:23.006014 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0691331-e94a-4020-a8fc-85fc86b79a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:24:23.007733 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b0691331-e94a-4020-a8fc-85fc86b79a6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:24:23.091053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:24:23.119724 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0691331-e94a-4020-a8fc-85fc86b79a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:24:23.121169 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0691331-e94a-4020-a8fc-85fc86b79a6e service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:24:23.140353 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 752/1490] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:24:25.630790 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9035458-99f3-44c6-a2f5-11f1212b3654 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:24:25.631420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9035458-99f3-44c6-a2f5-11f1212b3654 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:24:25.631420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9035458-99f3-44c6-a2f5-11f1212b3654 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:24:25.632711 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 739/1491] 10.222.0.62 () {54 vars in 927 bytes} [Tue Oct 4 14:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:24:25.639048 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0ba0c-83a9-4a5e-9540-92c72d8325ab None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:24:25.639497 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0ba0c-83a9-4a5e-9540-92c72d8325ab None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:24:25.639606 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0ba0c-83a9-4a5e-9540-92c72d8325ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:24:25.709237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-3ef0ba0c-83a9-4a5e-9540-92c72d8325ab None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:24:25.710539 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3ef0ba0c-83a9-4a5e-9540-92c72d8325ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:24:25.813619 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 753/1492] 10.222.0.62 () {58 vars in 1024 bytes} [Tue Oct 4 14:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:24:26.110220 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9035458-99f3-44c6-a2f5-11f1212b3654 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:24:26.111816 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b9035458-99f3-44c6-a2f5-11f1212b3654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:24:26.214284 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9035458-99f3-44c6-a2f5-11f1212b3654 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:24:26.287876 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb567b8-29ec-492b-8f09-21ed375b6105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:24:26.288486 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb567b8-29ec-492b-8f09-21ed375b6105 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:24:26.288761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb567b8-29ec-492b-8f09-21ed375b6105 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:24:26.289032 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb567b8-29ec-492b-8f09-21ed375b6105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:24:26.290638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-dbb567b8-29ec-492b-8f09-21ed375b6105 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:24:26.299501 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:24:26.404273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb567b8-29ec-492b-8f09-21ed375b6105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:24:26.405637 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb567b8-29ec-492b-8f09-21ed375b6105 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:24:26.423739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 740/1493] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:24:35.812066 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=82 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:24:36.421521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=50 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:25:41.489479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d8392-7002-42db-b2dc-410f5281fda0 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:25:41.490128 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d8392-7002-42db-b2dc-410f5281fda0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:25:41.490128 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d8392-7002-42db-b2dc-410f5281fda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:25:41.578565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-664d8392-7002-42db-b2dc-410f5281fda0 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:25:41.579826 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-664d8392-7002-42db-b2dc-410f5281fda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:25:41.695380 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 754/1494] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:25:41.704372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a85dcd-53e8-4864-906c-a2fde671b4aa None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:25:41.704990 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a85dcd-53e8-4864-906c-a2fde671b4aa None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:25:41.704990 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a85dcd-53e8-4864-906c-a2fde671b4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:25:41.792958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-b3a85dcd-53e8-4864-906c-a2fde671b4aa None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:25:41.794181 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b3a85dcd-53e8-4864-906c-a2fde671b4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:25:41.901779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 741/1495] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:25:41.906817 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d8392-7002-42db-b2dc-410f5281fda0 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:25:41.908067 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-664d8392-7002-42db-b2dc-410f5281fda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:25:41.920645 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d8392-7002-42db-b2dc-410f5281fda0 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:25:41.992413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:25:42.034700 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a39cf-9f60-45ad-8388-8deec77a6c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:25:42.035326 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a39cf-9f60-45ad-8388-8deec77a6c26 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:25:42.035607 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a39cf-9f60-45ad-8388-8deec77a6c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:25:42.035910 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a39cf-9f60-45ad-8388-8deec77a6c26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:25:42.036577 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a39cf-9f60-45ad-8388-8deec77a6c26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:25:42.036879 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a39cf-9f60-45ad-8388-8deec77a6c26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:25:42.037907 dv-cinder-860260-1-smb devstack@keystone.service[81467]: WARNING py.warnings [None req-9e3a39cf-9f60-45ad-8388-8deec77a6c26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 14:25:42.037907 dv-cinder-860260-1-smb devstack@keystone.service[81467]: warnings.warn(msg) Oct 04 14:25:42.037907 dv-cinder-860260-1-smb devstack@keystone.service[81467]: Oct 04 14:25:42.038823 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a39cf-9f60-45ad-8388-8deec77a6c26 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:25:42.051812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 755/1496] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:25:42.061148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a85dcd-53e8-4864-906c-a2fde671b4aa None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:25:42.071096 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a85dcd-53e8-4864-906c-a2fde671b4aa None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:25:42.156093 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:25:42.198446 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb944428-0eeb-4f11-be20-138256c1ba89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:25:42.199077 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb944428-0eeb-4f11-be20-138256c1ba89 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:25:42.199359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb944428-0eeb-4f11-be20-138256c1ba89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:25:42.199633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb944428-0eeb-4f11-be20-138256c1ba89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:25:42.200352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb944428-0eeb-4f11-be20-138256c1ba89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:25:42.202149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: WARNING py.warnings [None req-eb944428-0eeb-4f11-be20-138256c1ba89 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 14:25:42.202149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: warnings.warn(msg) Oct 04 14:25:42.202149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: Oct 04 14:25:42.203377 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb944428-0eeb-4f11-be20-138256c1ba89 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:25:42.266507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 742/1497] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:25:42 2022] POST /identity/v3/projects => generated 379 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:25:42.273224 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a39cf-9f60-45ad-8388-8deec77a6c26 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:25:42.276069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9e3a39cf-9f60-45ad-8388-8deec77a6c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:25:42.319586 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a39cf-9f60-45ad-8388-8deec77a6c26 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:25:42.418223 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c46b6c-cf06-454f-a304-5419c35ec2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:25:42.418750 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c46b6c-cf06-454f-a304-5419c35ec2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:25:42.419056 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c46b6c-cf06-454f-a304-5419c35ec2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:25:42.419329 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c46b6c-cf06-454f-a304-5419c35ec2d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:25:42.420001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c46b6c-cf06-454f-a304-5419c35ec2d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:25:42.421030 dv-cinder-860260-1-smb devstack@keystone.service[81467]: WARNING py.warnings [None req-59c46b6c-cf06-454f-a304-5419c35ec2d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 14:25:42.421030 dv-cinder-860260-1-smb devstack@keystone.service[81467]: warnings.warn(msg) Oct 04 14:25:42.421030 dv-cinder-860260-1-smb devstack@keystone.service[81467]: Oct 04 14:25:42.422235 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c46b6c-cf06-454f-a304-5419c35ec2d7 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:25:42.472067 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 756/1498] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:25:42 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:25:42.473485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb944428-0eeb-4f11-be20-138256c1ba89 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:25:42.475125 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-eb944428-0eeb-4f11-be20-138256c1ba89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:25:42.553686 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb944428-0eeb-4f11-be20-138256c1ba89 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:25:42.643248 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:25:42.655987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4171732-5e07-4cae-9f79-e339ebd22f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:25:42.656603 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4171732-5e07-4cae-9f79-e339ebd22f7d admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:25:42.656883 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4171732-5e07-4cae-9f79-e339ebd22f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:25:42.657153 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4171732-5e07-4cae-9f79-e339ebd22f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:25:42.657799 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4171732-5e07-4cae-9f79-e339ebd22f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:25:42.658816 dv-cinder-860260-1-smb devstack@keystone.service[81468]: WARNING py.warnings [None req-e4171732-5e07-4cae-9f79-e339ebd22f7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 14:25:42.658816 dv-cinder-860260-1-smb devstack@keystone.service[81468]: warnings.warn(msg) Oct 04 14:25:42.658816 dv-cinder-860260-1-smb devstack@keystone.service[81468]: Oct 04 14:25:42.659884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4171732-5e07-4cae-9f79-e339ebd22f7d admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:25:42.673261 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 743/1499] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:25:42.677333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c46b6c-cf06-454f-a304-5419c35ec2d7 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:25:42.678857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-59c46b6c-cf06-454f-a304-5419c35ec2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:25:42.691100 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c46b6c-cf06-454f-a304-5419c35ec2d7 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:25:42.717060 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:25:42.789113 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af507e50-4bd1-4be8-a9e3-47b19409bf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:25:42.789720 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af507e50-4bd1-4be8-a9e3-47b19409bf9c admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:25:42.789992 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af507e50-4bd1-4be8-a9e3-47b19409bf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:25:42.790253 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af507e50-4bd1-4be8-a9e3-47b19409bf9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:25:42.791634 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af507e50-4bd1-4be8-a9e3-47b19409bf9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:25:42.792765 dv-cinder-860260-1-smb devstack@keystone.service[81467]: WARNING py.warnings [None req-af507e50-4bd1-4be8-a9e3-47b19409bf9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 14:25:42.792765 dv-cinder-860260-1-smb devstack@keystone.service[81467]: warnings.warn(msg) Oct 04 14:25:42.792765 dv-cinder-860260-1-smb devstack@keystone.service[81467]: Oct 04 14:25:42.793640 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af507e50-4bd1-4be8-a9e3-47b19409bf9c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:25:42.806501 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 757/1500] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:25:42.810797 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4171732-5e07-4cae-9f79-e339ebd22f7d admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:25:42.812374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e4171732-5e07-4cae-9f79-e339ebd22f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:25:42.847530 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4171732-5e07-4cae-9f79-e339ebd22f7d admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:25:42.947520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a3ee3-8247-43bf-92bf-0bc87b873b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:25:42.948275 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a3ee3-8247-43bf-92bf-0bc87b873b71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:25:42.948618 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a3ee3-8247-43bf-92bf-0bc87b873b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:25:42.948890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a3ee3-8247-43bf-92bf-0bc87b873b71 admin admin] PATH_INFO: `/v3/projects/329b68ef2cb743a4a08d87ce35ef0efe/users/2df552b41664460493b516a57b707dc9/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:25:42.974718 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a3ee3-8247-43bf-92bf-0bc87b873b71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=329b68ef2cb743a4a08d87ce35ef0efe, user_id=2df552b41664460493b516a57b707dc9, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:25:42.975967 dv-cinder-860260-1-smb devstack@keystone.service[81468]: WARNING py.warnings [None req-055a3ee3-8247-43bf-92bf-0bc87b873b71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 14:25:42.975967 dv-cinder-860260-1-smb devstack@keystone.service[81468]: warnings.warn(msg) Oct 04 14:25:42.975967 dv-cinder-860260-1-smb devstack@keystone.service[81468]: Oct 04 14:25:42.977938 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a3ee3-8247-43bf-92bf-0bc87b873b71 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:25:43.006846 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 744/1501] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:25:42 2022] PUT /identity/v3/projects/329b68ef2cb743a4a08d87ce35ef0efe/users/2df552b41664460493b516a57b707dc9/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:25:43.020274 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63a980-2687-4ba3-9587-2037f948c5bc None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:25:43.020554 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63a980-2687-4ba3-9587-2037f948c5bc None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:25:43.020831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63a980-2687-4ba3-9587-2037f948c5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:25:43.089013 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-bd63a980-2687-4ba3-9587-2037f948c5bc None None] MFA Rules not processed for user `2df552b41664460493b516a57b707dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:25:43.090248 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bd63a980-2687-4ba3-9587-2037f948c5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:25:43.176394 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 758/1502] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:25:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:25:43.189865 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6611b7-003e-4032-9559-8563ae2b54df None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:25:43.190405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6611b7-003e-4032-9559-8563ae2b54df None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:25:43.190675 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6611b7-003e-4032-9559-8563ae2b54df None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:25:43.192057 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 745/1503] 10.222.0.62 () {54 vars in 963 bytes} [Tue Oct 4 14:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:25:43.199481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec89b4-194d-45f0-a268-0a3df80ad8cb None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:25:43.199481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec89b4-194d-45f0-a268-0a3df80ad8cb None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:25:43.200082 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec89b4-194d-45f0-a268-0a3df80ad8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:25:43.260691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:25:43.322428 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-2eec89b4-194d-45f0-a268-0a3df80ad8cb None None] MFA Rules not processed for user `c5d3bf1c2d944d51a0fd0ff84be1c7e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:25:43.324534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2eec89b4-194d-45f0-a268-0a3df80ad8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:25:43.404457 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 759/1504] 10.222.0.62 () {58 vars in 1060 bytes} [Tue Oct 4 14:25:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:25:43.414172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6611b7-003e-4032-9559-8563ae2b54df None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:25:43.415796 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-9c6611b7-003e-4032-9559-8563ae2b54df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:25:43.480447 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:25:43.551579 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6611b7-003e-4032-9559-8563ae2b54df None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:25:43.637830 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807c501-d24e-4dd8-918a-910e383e7b15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:25:43.638547 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807c501-d24e-4dd8-918a-910e383e7b15 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:25:43.638837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807c501-d24e-4dd8-918a-910e383e7b15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:25:43.639138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807c501-d24e-4dd8-918a-910e383e7b15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:25:43.641150 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d807c501-d24e-4dd8-918a-910e383e7b15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:25:43.760394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807c501-d24e-4dd8-918a-910e383e7b15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:25:43.761867 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807c501-d24e-4dd8-918a-910e383e7b15 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:25:43.765890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:25:43.787305 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 746/1505] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:25:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:25:43.840577 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea63930-4bdf-4b7e-b3aa-cdb677c2c1dc None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:25:43.841117 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea63930-4bdf-4b7e-b3aa-cdb677c2c1dc None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:25:43.841117 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea63930-4bdf-4b7e-b3aa-cdb677c2c1dc None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:25:43.842410 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 760/1506] 10.222.0.62 () {52 vars in 830 bytes} [Tue Oct 4 14:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:25:43.846636 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807c501-d24e-4dd8-918a-910e383e7b15 service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:25:43.847915 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d807c501-d24e-4dd8-918a-910e383e7b15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:25:43.958815 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807c501-d24e-4dd8-918a-910e383e7b15 service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:25:44.066328 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7fe7a-7780-4f4e-ad21-55f25a7043f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:25:44.066884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7fe7a-7780-4f4e-ad21-55f25a7043f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:25:44.067163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7fe7a-7780-4f4e-ad21-55f25a7043f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:25:44.067583 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7fe7a-7780-4f4e-ad21-55f25a7043f2 admin admin] PATH_INFO: `/v3/users/2df552b41664460493b516a57b707dc9` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:25:44.085759 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be7fe7a-7780-4f4e-ad21-55f25a7043f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2df552b41664460493b516a57b707dc9)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:25:44.086795 dv-cinder-860260-1-smb devstack@keystone.service[81468]: WARNING py.warnings [None req-5be7fe7a-7780-4f4e-ad21-55f25a7043f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 14:25:44.086795 dv-cinder-860260-1-smb devstack@keystone.service[81468]: warnings.warn(msg) Oct 04 14:25:44.086795 dv-cinder-860260-1-smb devstack@keystone.service[81468]: Oct 04 14:25:44.088116 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be7fe7a-7780-4f4e-ad21-55f25a7043f2 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:25:44.101890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:25:44.167778 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-5be7fe7a-7780-4f4e-ad21-55f25a7043f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2df552b41664460493b516a57b707dc9'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:25:44.168327 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-5be7fe7a-7780-4f4e-ad21-55f25a7043f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2df552b41664460493b516a57b707dc9'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:25:44.195949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-5be7fe7a-7780-4f4e-ad21-55f25a7043f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2df552b41664460493b516a57b707dc9'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:25:44.207199 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-5be7fe7a-7780-4f4e-ad21-55f25a7043f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2df552b41664460493b516a57b707dc9'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:25:44.223465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-5be7fe7a-7780-4f4e-ad21-55f25a7043f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2df552b41664460493b516a57b707dc9'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:25:44.230177 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 747/1507] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:25:43 2022] DELETE /identity/v3/users/2df552b41664460493b516a57b707dc9 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:25:44.234709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa21411-b937-4831-bb02-0c349ce5a836 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:25:44.234991 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa21411-b937-4831-bb02-0c349ce5a836 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:25:44.235307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa21411-b937-4831-bb02-0c349ce5a836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:25:44.298536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-0fa21411-b937-4831-bb02-0c349ce5a836 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:25:44.299810 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0fa21411-b937-4831-bb02-0c349ce5a836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:25:44.394745 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:25:44.408383 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 761/1508] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:25:44.419979 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7fe7a-7780-4f4e-ad21-55f25a7043f2 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:25:44.421403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-5be7fe7a-7780-4f4e-ad21-55f25a7043f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:25:44.542267 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7fe7a-7780-4f4e-ad21-55f25a7043f2 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:25:44.603734 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:25:44.629300 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d7b98-dff2-438d-a8b1-4ad2d48166d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:25:44.629911 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d7b98-dff2-438d-a8b1-4ad2d48166d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:25:44.630186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d7b98-dff2-438d-a8b1-4ad2d48166d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:25:44.630453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d7b98-dff2-438d-a8b1-4ad2d48166d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:25:44.632119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-ba0d7b98-dff2-438d-a8b1-4ad2d48166d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:25:44.763919 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d7b98-dff2-438d-a8b1-4ad2d48166d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:25:44.765595 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d7b98-dff2-438d-a8b1-4ad2d48166d5 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:25:44.786997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 748/1509] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:25:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:25:45.189327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa21411-b937-4831-bb02-0c349ce5a836 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:25:45.191991 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0fa21411-b937-4831-bb02-0c349ce5a836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:25:45.209793 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa21411-b937-4831-bb02-0c349ce5a836 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:25:45.317438 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea007d-5a7f-4e26-ad3e-7da83dde9547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:25:45.317993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea007d-5a7f-4e26-ad3e-7da83dde9547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:25:45.318269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea007d-5a7f-4e26-ad3e-7da83dde9547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:25:45.318546 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea007d-5a7f-4e26-ad3e-7da83dde9547 admin admin] PATH_INFO: `/v3/projects/329b68ef2cb743a4a08d87ce35ef0efe` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:25:45.333721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea007d-5a7f-4e26-ad3e-7da83dde9547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=329b68ef2cb743a4a08d87ce35ef0efe)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:25:45.336012 dv-cinder-860260-1-smb devstack@keystone.service[81467]: WARNING py.warnings [None req-9eea007d-5a7f-4e26-ad3e-7da83dde9547 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 14:25:45.336012 dv-cinder-860260-1-smb devstack@keystone.service[81467]: warnings.warn(msg) Oct 04 14:25:45.336012 dv-cinder-860260-1-smb devstack@keystone.service[81467]: Oct 04 14:25:45.339530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea007d-5a7f-4e26-ad3e-7da83dde9547 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:25:45.409316 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9eea007d-5a7f-4e26-ad3e-7da83dde9547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '329b68ef2cb743a4a08d87ce35ef0efe', 'request_id': 'req-9eea007d-5a7f-4e26-ad3e-7da83dde9547'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:25:45.421702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9eea007d-5a7f-4e26-ad3e-7da83dde9547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '329b68ef2cb743a4a08d87ce35ef0efe', 'request_id': 'req-9eea007d-5a7f-4e26-ad3e-7da83dde9547'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:25:45.442947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9eea007d-5a7f-4e26-ad3e-7da83dde9547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '329b68ef2cb743a4a08d87ce35ef0efe', 'request_id': 'req-9eea007d-5a7f-4e26-ad3e-7da83dde9547'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:25:45.471773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9eea007d-5a7f-4e26-ad3e-7da83dde9547 admin admin] The token cache is being invalidate because project 329b68ef2cb743a4a08d87ce35ef0efe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:25:45.472062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9eea007d-5a7f-4e26-ad3e-7da83dde9547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:25:45.472618 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9eea007d-5a7f-4e26-ad3e-7da83dde9547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:25:45.474030 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 762/1510] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:25:45 2022] DELETE /identity/v3/projects/329b68ef2cb743a4a08d87ce35ef0efe => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:25:54.784575 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=62 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:25:55.469574 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:27:22.881397 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8932d-a708-4eef-a2d8-06f422f69544 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:22.881978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8932d-a708-4eef-a2d8-06f422f69544 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:22.881978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8932d-a708-4eef-a2d8-06f422f69544 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:22.883243 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 14:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:27:22.888455 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d70ab-e12b-4624-b982-05a68adc64e9 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:22.888921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d70ab-e12b-4624-b982-05a68adc64e9 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:22.889019 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d70ab-e12b-4624-b982-05a68adc64e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:22.976285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-265d70ab-e12b-4624-b982-05a68adc64e9 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:27:22.977483 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-265d70ab-e12b-4624-b982-05a68adc64e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:27:23.079733 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 14:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:27:23.235228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8932d-a708-4eef-a2d8-06f422f69544 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:27:23.237435 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-05b8932d-a708-4eef-a2d8-06f422f69544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:27:23.359992 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8932d-a708-4eef-a2d8-06f422f69544 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:27:23.365543 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349cc116-8b53-498e-8b9a-12549a0713f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:27:23.366150 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349cc116-8b53-498e-8b9a-12549a0713f4 service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:23.366430 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349cc116-8b53-498e-8b9a-12549a0713f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:23.366701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349cc116-8b53-498e-8b9a-12549a0713f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:23.375292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349cc116-8b53-498e-8b9a-12549a0713f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:27:23.376905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349cc116-8b53-498e-8b9a-12549a0713f4 service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:27:23.386130 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 750/1513] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:27:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:27:24.473059 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036552d-8390-49af-b27d-b27171a80c1a None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:24.473655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036552d-8390-49af-b27d-b27171a80c1a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:24.473655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036552d-8390-49af-b27d-b27171a80c1a None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:24.474940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 14:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:27:24.481117 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea5681-49da-4214-ad9c-1933155e7601 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:24.481569 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea5681-49da-4214-ad9c-1933155e7601 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:24.481680 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea5681-49da-4214-ad9c-1933155e7601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:24.501567 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-cdea5681-49da-4214-ad9c-1933155e7601 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:27:24.502747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-cdea5681-49da-4214-ad9c-1933155e7601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:27:24.510531 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 14:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:27:24.675842 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036552d-8390-49af-b27d-b27171a80c1a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:27:24.691860 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036552d-8390-49af-b27d-b27171a80c1a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:27:24.697373 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fad3b-f284-4958-bf7f-63d7a12f14bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:27:24.697977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fad3b-f284-4958-bf7f-63d7a12f14bf service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:24.698254 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fad3b-f284-4958-bf7f-63d7a12f14bf service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:24.698525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fad3b-f284-4958-bf7f-63d7a12f14bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:24.707220 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500fad3b-f284-4958-bf7f-63d7a12f14bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:27:24.708896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500fad3b-f284-4958-bf7f-63d7a12f14bf service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:27:24.718132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 765/1516] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:27:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:27:25.189266 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd57a31-7e38-4c88-bfe0-c9f4b11e4272 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:25.189486 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd57a31-7e38-4c88-bfe0-c9f4b11e4272 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:25.189733 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd57a31-7e38-4c88-bfe0-c9f4b11e4272 None None] PATH_INFO: `/v3` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:25.191276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 752/1517] 10.222.0.30 () {54 vars in 925 bytes} [Tue Oct 4 14:27:25 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:27:25.197728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77686ce2-b1a3-40ac-ad29-52c9e7313dc4 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:25.198001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77686ce2-b1a3-40ac-ad29-52c9e7313dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:25.198269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77686ce2-b1a3-40ac-ad29-52c9e7313dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:25.261186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-77686ce2-b1a3-40ac-ad29-52c9e7313dc4 None None] MFA Rules not processed for user `6f98c07455a241398784d221df273aba`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:27:25.262404 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-77686ce2-b1a3-40ac-ad29-52c9e7313dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:27:25.279755 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:27:25.336802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 766/1518] 10.222.0.30 () {58 vars in 1015 bytes} [Tue Oct 4 14:27:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:27:34.496116 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=56 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:27:34.675263 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9cabf-fc56-433f-b201-9d13f3a1cc1e None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:34.675543 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9cabf-fc56-433f-b201-9d13f3a1cc1e None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:34.675847 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9cabf-fc56-433f-b201-9d13f3a1cc1e None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:34.677197 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 753/1519] 10.222.0.62 () {54 vars in 961 bytes} [Tue Oct 4 14:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:27:34.682420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2df13-f884-4e04-826d-d4b683720d14 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:34.682945 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2df13-f884-4e04-826d-d4b683720d14 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:34.682945 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2df13-f884-4e04-826d-d4b683720d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:34.703765 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-b6b2df13-f884-4e04-826d-d4b683720d14 None None] MFA Rules not processed for user `6f98c07455a241398784d221df273aba`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:27:34.704973 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b6b2df13-f884-4e04-826d-d4b683720d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:27:34.713539 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 767/1520] 10.222.0.62 () {58 vars in 1058 bytes} [Tue Oct 4 14:27:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:27:34.722031 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9cabf-fc56-433f-b201-9d13f3a1cc1e None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:27:34.736075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9cabf-fc56-433f-b201-9d13f3a1cc1e None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:27:34.740923 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4614b0-9650-4c13-b62c-249e0fa2b6ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f98c07455a241398784d221df273aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:27:34.741519 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4614b0-9650-4c13-b62c-249e0fa2b6ed service placement] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:34.741796 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4614b0-9650-4c13-b62c-249e0fa2b6ed service placement] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:34.742065 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4614b0-9650-4c13-b62c-249e0fa2b6ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:34.751141 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4614b0-9650-4c13-b62c-249e0fa2b6ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:27:34.752688 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4614b0-9650-4c13-b62c-249e0fa2b6ed service placement] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:27:34.762098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 754/1521] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:27:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:27:36.212810 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b350b90-6015-49a5-9c28-06e1fe2d4e5c None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:36.213390 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b350b90-6015-49a5-9c28-06e1fe2d4e5c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:36.213390 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b350b90-6015-49a5-9c28-06e1fe2d4e5c None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:36.214690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 14:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:27:36.220899 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3e029-542d-4286-9962-91be6c271cc8 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:36.221396 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3e029-542d-4286-9962-91be6c271cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:36.221495 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3e029-542d-4286-9962-91be6c271cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:36.241234 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-19e3e029-542d-4286-9962-91be6c271cc8 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:27:36.242590 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-19e3e029-542d-4286-9962-91be6c271cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:27:36.251270 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 14:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:27:36.401715 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b350b90-6015-49a5-9c28-06e1fe2d4e5c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:27:36.417576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b350b90-6015-49a5-9c28-06e1fe2d4e5c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:27:36.424020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f307e-73f8-46fd-b3a9-541b458ae6b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:27:36.424618 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f307e-73f8-46fd-b3a9-541b458ae6b3 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:36.424897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f307e-73f8-46fd-b3a9-541b458ae6b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:36.425169 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f307e-73f8-46fd-b3a9-541b458ae6b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:36.433341 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f307e-73f8-46fd-b3a9-541b458ae6b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:27:36.434942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f307e-73f8-46fd-b3a9-541b458ae6b3 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:27:36.444955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 769/1524] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:27:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:27:37.519728 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dc75a-8ea3-4b53-8e7e-a799f2bcf43b None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:37.520309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dc75a-8ea3-4b53-8e7e-a799f2bcf43b None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:37.520309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dc75a-8ea3-4b53-8e7e-a799f2bcf43b None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:37.521621 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 14:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:27:37.527887 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb1dcb-afc8-4253-b7ac-ea10afbf0e1c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:37.528416 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb1dcb-afc8-4253-b7ac-ea10afbf0e1c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:37.528527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb1dcb-afc8-4253-b7ac-ea10afbf0e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:37.548506 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-66eb1dcb-afc8-4253-b7ac-ea10afbf0e1c None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:27:37.549691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-66eb1dcb-afc8-4253-b7ac-ea10afbf0e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:27:37.557805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 14:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:27:37.709142 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dc75a-8ea3-4b53-8e7e-a799f2bcf43b None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:27:37.724442 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dc75a-8ea3-4b53-8e7e-a799f2bcf43b None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:27:37.730434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bbaa3-a12b-45d5-ada2-66b34920475d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:27:37.731083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bbaa3-a12b-45d5-ada2-66b34920475d service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:37.731367 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bbaa3-a12b-45d5-ada2-66b34920475d service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:37.731656 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bbaa3-a12b-45d5-ada2-66b34920475d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:37.740846 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bbaa3-a12b-45d5-ada2-66b34920475d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:27:37.742427 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bbaa3-a12b-45d5-ada2-66b34920475d service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:27:37.752713 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 757/1527] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:27:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:27:41.805046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf844ed-d6d6-4fb8-824a-d3e5b298683d None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:41.805673 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf844ed-d6d6-4fb8-824a-d3e5b298683d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:41.805673 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf844ed-d6d6-4fb8-824a-d3e5b298683d None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:41.806901 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 14:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:27:41.812740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419aa5d-7cb7-4b9c-bfd3-6c90137ef3d4 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:41.813180 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419aa5d-7cb7-4b9c-bfd3-6c90137ef3d4 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:41.813285 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419aa5d-7cb7-4b9c-bfd3-6c90137ef3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:41.833823 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-e419aa5d-7cb7-4b9c-bfd3-6c90137ef3d4 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:27:41.835047 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e419aa5d-7cb7-4b9c-bfd3-6c90137ef3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:27:41.843322 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 14:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:27:42.134617 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf844ed-d6d6-4fb8-824a-d3e5b298683d None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:27:42.136353 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-baf844ed-d6d6-4fb8-824a-d3e5b298683d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:27:42.218336 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf844ed-d6d6-4fb8-824a-d3e5b298683d None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:27:42.221955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50828a2-84ec-4b90-9c5d-f0630f4571a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:27:42.222561 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50828a2-84ec-4b90-9c5d-f0630f4571a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:42.222838 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50828a2-84ec-4b90-9c5d-f0630f4571a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:42.223107 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50828a2-84ec-4b90-9c5d-f0630f4571a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:42.233063 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50828a2-84ec-4b90-9c5d-f0630f4571a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:27:42.234505 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50828a2-84ec-4b90-9c5d-f0630f4571a7 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:27:42.245590 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 772/1530] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:27:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:27:44.382674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b827e-6a91-4f8a-bdd5-fc654ed42678 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:44.383250 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b827e-6a91-4f8a-bdd5-fc654ed42678 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:44.383250 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b827e-6a91-4f8a-bdd5-fc654ed42678 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:44.384580 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 14:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:27:44.390435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917ab84-473c-4af9-b06b-0810dd887cbf None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:44.390865 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917ab84-473c-4af9-b06b-0810dd887cbf None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:44.390981 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917ab84-473c-4af9-b06b-0810dd887cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:44.411949 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-1917ab84-473c-4af9-b06b-0810dd887cbf None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:27:44.413138 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1917ab84-473c-4af9-b06b-0810dd887cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:27:44.420956 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 14:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:27:44.709709 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b827e-6a91-4f8a-bdd5-fc654ed42678 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:27:44.720472 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b827e-6a91-4f8a-bdd5-fc654ed42678 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:27:44.723878 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5357da-f2ea-44f1-afe3-581b480390f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:27:44.724466 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5357da-f2ea-44f1-afe3-581b480390f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:44.724740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5357da-f2ea-44f1-afe3-581b480390f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:44.725007 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5357da-f2ea-44f1-afe3-581b480390f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:44.734023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5357da-f2ea-44f1-afe3-581b480390f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:27:44.735457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5357da-f2ea-44f1-afe3-581b480390f8 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:27:44.745054 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 760/1533] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:27:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:27:48.544425 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe02f2-af97-4f70-a5ac-cf7bf738f93d None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:48.545028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe02f2-af97-4f70-a5ac-cf7bf738f93d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:48.545028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe02f2-af97-4f70-a5ac-cf7bf738f93d None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:48.546291 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 14:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:27:48.551664 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f0be8-b4f3-4784-a010-4256506500ae None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:48.552174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f0be8-b4f3-4784-a010-4256506500ae None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:48.552274 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f0be8-b4f3-4784-a010-4256506500ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:48.572641 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-421f0be8-b4f3-4784-a010-4256506500ae None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:27:48.573831 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-421f0be8-b4f3-4784-a010-4256506500ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:27:48.582351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 14:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:27:48.898426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe02f2-af97-4f70-a5ac-cf7bf738f93d None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:27:48.900192 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-40fe02f2-af97-4f70-a5ac-cf7bf738f93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:27:48.978639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:27:48.992491 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe02f2-af97-4f70-a5ac-cf7bf738f93d None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:27:48.996062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51549358-e1f2-4f72-a1cd-0807ae042335 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:27:48.996677 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51549358-e1f2-4f72-a1cd-0807ae042335 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:48.996954 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51549358-e1f2-4f72-a1cd-0807ae042335 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:48.997812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51549358-e1f2-4f72-a1cd-0807ae042335 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:49.007363 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51549358-e1f2-4f72-a1cd-0807ae042335 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:27:49.008821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51549358-e1f2-4f72-a1cd-0807ae042335 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:27:49.018705 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 775/1536] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:27:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:27:51.298269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdfbf6-8411-4c19-bc5d-aace5e1db6bf None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:51.298880 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdfbf6-8411-4c19-bc5d-aace5e1db6bf None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:51.298880 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdfbf6-8411-4c19-bc5d-aace5e1db6bf None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:51.300219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 14:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:27:51.305672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a79128-a579-4196-9640-5275bd66e2c0 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:51.306164 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a79128-a579-4196-9640-5275bd66e2c0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:51.306275 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a79128-a579-4196-9640-5275bd66e2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:51.327546 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f4a79128-a579-4196-9640-5275bd66e2c0 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:27:51.328751 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f4a79128-a579-4196-9640-5275bd66e2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:27:51.337070 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 14:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:27:51.643380 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdfbf6-8411-4c19-bc5d-aace5e1db6bf None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:27:51.645086 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-cbfdfbf6-8411-4c19-bc5d-aace5e1db6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:27:51.658107 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdfbf6-8411-4c19-bc5d-aace5e1db6bf None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:27:51.661732 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5661800-a395-4d5b-be4d-1b8e2ab2601d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:27:51.662330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5661800-a395-4d5b-be4d-1b8e2ab2601d service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:27:51.662607 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5661800-a395-4d5b-be4d-1b8e2ab2601d service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:27:51.662873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5661800-a395-4d5b-be4d-1b8e2ab2601d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:27:51.672519 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5661800-a395-4d5b-be4d-1b8e2ab2601d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:27:51.673953 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5661800-a395-4d5b-be4d-1b8e2ab2601d service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:27:51.683613 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 763/1539] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:27:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:28:01.321752 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=11 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:28:01.679290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=33 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:25.083744 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c158929-25e3-48b8-b2ac-b18dda28c0a2 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:25.084412 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c158929-25e3-48b8-b2ac-b18dda28c0a2 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:25.084412 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c158929-25e3-48b8-b2ac-b18dda28c0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:25.111823 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-3c158929-25e3-48b8-b2ac-b18dda28c0a2 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:25.113198 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3c158929-25e3-48b8-b2ac-b18dda28c0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:25.125398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 777/1540] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:25.134981 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c745135-064b-426f-8a18-ad6a3a765296 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:25.136624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c745135-064b-426f-8a18-ad6a3a765296 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:25.137375 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c745135-064b-426f-8a18-ad6a3a765296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:25.165774 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-5c745135-064b-426f-8a18-ad6a3a765296 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:25.166995 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-5c745135-064b-426f-8a18-ad6a3a765296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:25.180135 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 764/1541] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:25.186590 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c158929-25e3-48b8-b2ac-b18dda28c0a2 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:25.189226 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af1322-8263-4186-8e42-fedb9648ac4b None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:25.189511 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af1322-8263-4186-8e42-fedb9648ac4b None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:25.189789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af1322-8263-4186-8e42-fedb9648ac4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:25.203667 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c158929-25e3-48b8-b2ac-b18dda28c0a2 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:25.224091 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-30af1322-8263-4186-8e42-fedb9648ac4b None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:25.227349 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65699ee9-3d01-463d-ac7f-3e5a5b4c9f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:25.228303 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65699ee9-3d01-463d-ac7f-3e5a5b4c9f99 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:25.228670 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65699ee9-3d01-463d-ac7f-3e5a5b4c9f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:25.228943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65699ee9-3d01-463d-ac7f-3e5a5b4c9f99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:25.229720 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65699ee9-3d01-463d-ac7f-3e5a5b4c9f99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:29:25.230019 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65699ee9-3d01-463d-ac7f-3e5a5b4c9f99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:25.231730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65699ee9-3d01-463d-ac7f-3e5a5b4c9f99 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:25.233797 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-30af1322-8263-4186-8e42-fedb9648ac4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:25.253285 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 765/1542] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:29:25.255922 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 778/1543] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:29:25.262469 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0251e4-d903-4059-b2c8-0f61b2f9787a None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:25.262861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0251e4-d903-4059-b2c8-0f61b2f9787a None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:25.263122 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0251e4-d903-4059-b2c8-0f61b2f9787a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:25.271076 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65699ee9-3d01-463d-ac7f-3e5a5b4c9f99 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:25.287313 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65699ee9-3d01-463d-ac7f-3e5a5b4c9f99 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:25.308868 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-fd0251e4-d903-4059-b2c8-0f61b2f9787a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:25.311537 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-fd0251e4-d903-4059-b2c8-0f61b2f9787a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:25.312949 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c97538-d4fa-4191-8f02-b45ab0cdcbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:25.313589 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c97538-d4fa-4191-8f02-b45ab0cdcbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:25.313863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c97538-d4fa-4191-8f02-b45ab0cdcbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:25.314133 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c97538-d4fa-4191-8f02-b45ab0cdcbf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:25.314789 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c97538-d4fa-4191-8f02-b45ab0cdcbf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:25.320292 dv-cinder-860260-1-smb devstack@keystone.service[81467]: WARNING py.warnings [None req-f8c97538-d4fa-4191-8f02-b45ab0cdcbf3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 14:29:25.320292 dv-cinder-860260-1-smb devstack@keystone.service[81467]: warnings.warn(msg) Oct 04 14:29:25.320292 dv-cinder-860260-1-smb devstack@keystone.service[81467]: Oct 04 14:29:25.322913 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c97538-d4fa-4191-8f02-b45ab0cdcbf3 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:25.351781 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 766/1544] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:25.360850 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0251e4-d903-4059-b2c8-0f61b2f9787a None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:25.378432 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0251e4-d903-4059-b2c8-0f61b2f9787a None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:25.394137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4be45-6694-4c91-98cf-14fcc891ac94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:25.394851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4be45-6694-4c91-98cf-14fcc891ac94 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:25.395161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4be45-6694-4c91-98cf-14fcc891ac94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:25.395433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4be45-6694-4c91-98cf-14fcc891ac94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:25.396246 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4be45-6694-4c91-98cf-14fcc891ac94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:29:25.396554 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4be45-6694-4c91-98cf-14fcc891ac94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:25.397715 dv-cinder-860260-1-smb devstack@keystone.service[81468]: WARNING py.warnings [None req-15f4be45-6694-4c91-98cf-14fcc891ac94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 14:29:25.397715 dv-cinder-860260-1-smb devstack@keystone.service[81468]: warnings.warn(msg) Oct 04 14:29:25.397715 dv-cinder-860260-1-smb devstack@keystone.service[81468]: Oct 04 14:29:25.398660 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4be45-6694-4c91-98cf-14fcc891ac94 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:25.409822 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 779/1545] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:29:25 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:25.414302 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c97538-d4fa-4191-8f02-b45ab0cdcbf3 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:25.423563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 767/1546] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:29:25.439152 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4be45-6694-4c91-98cf-14fcc891ac94 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:25.455907 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4be45-6694-4c91-98cf-14fcc891ac94 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:25.545873 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c97538-d4fa-4191-8f02-b45ab0cdcbf3 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:25.562301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cf57c-6eed-4e2f-abca-a8d65aeaa8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:25.563105 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cf57c-6eed-4e2f-abca-a8d65aeaa8e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:25.563386 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cf57c-6eed-4e2f-abca-a8d65aeaa8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:25.563656 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cf57c-6eed-4e2f-abca-a8d65aeaa8e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:25.564327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20cf57c-6eed-4e2f-abca-a8d65aeaa8e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:25.566667 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20cf57c-6eed-4e2f-abca-a8d65aeaa8e7 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:25.574994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8987e8-f43b-41f7-ad3a-7d8e464a444f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:25.576218 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8987e8-f43b-41f7-ad3a-7d8e464a444f admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:25.576511 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8987e8-f43b-41f7-ad3a-7d8e464a444f admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:25.576774 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8987e8-f43b-41f7-ad3a-7d8e464a444f admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:25.577407 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8987e8-f43b-41f7-ad3a-7d8e464a444f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:25.579310 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8987e8-f43b-41f7-ad3a-7d8e464a444f admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:25.615495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 780/1547] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:29:25 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:29:25.617494 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cf57c-6eed-4e2f-abca-a8d65aeaa8e7 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:25.638847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cf57c-6eed-4e2f-abca-a8d65aeaa8e7 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:25.645090 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 768/1548] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:29:25 2022] POST /identity/v3/projects => generated 373 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:25.649670 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94b961-e22d-4eb4-9e86-16b6fa4eeeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:25.650315 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94b961-e22d-4eb4-9e86-16b6fa4eeeed admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:25.650600 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94b961-e22d-4eb4-9e86-16b6fa4eeeed admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:25.650869 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94b961-e22d-4eb4-9e86-16b6fa4eeeed admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:25.651511 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94b961-e22d-4eb4-9e86-16b6fa4eeeed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:25.653155 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94b961-e22d-4eb4-9e86-16b6fa4eeeed admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:25.653526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8987e8-f43b-41f7-ad3a-7d8e464a444f admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:25.679069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 781/1549] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:25.689919 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe08fce-5f4d-442e-83c6-c55ce9d8acad None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:25.690259 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe08fce-5f4d-442e-83c6-c55ce9d8acad None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:25.691440 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe08fce-5f4d-442e-83c6-c55ce9d8acad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:25.721173 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-2fe08fce-5f4d-442e-83c6-c55ce9d8acad None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:25.723282 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2fe08fce-5f4d-442e-83c6-c55ce9d8acad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:25.748734 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8987e8-f43b-41f7-ad3a-7d8e464a444f admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:25.756439 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c6494-c6fc-40fc-9ee3-eadbc6a56fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:25.757072 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c6494-c6fc-40fc-9ee3-eadbc6a56fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:25.757740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c6494-c6fc-40fc-9ee3-eadbc6a56fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:25.758016 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c6494-c6fc-40fc-9ee3-eadbc6a56fd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:25.758660 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c6494-c6fc-40fc-9ee3-eadbc6a56fd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:25.759870 dv-cinder-860260-1-smb devstack@keystone.service[81468]: WARNING py.warnings [None req-236c6494-c6fc-40fc-9ee3-eadbc6a56fd7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 14:29:25.759870 dv-cinder-860260-1-smb devstack@keystone.service[81468]: warnings.warn(msg) Oct 04 14:29:25.759870 dv-cinder-860260-1-smb devstack@keystone.service[81468]: Oct 04 14:29:25.761069 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c6494-c6fc-40fc-9ee3-eadbc6a56fd7 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:25.784480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 769/1550] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:29:25 2022] POST /identity/v3/users => generated 287 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:25.785819 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff32a6-cc57-4377-a388-23802a9e0eb2 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:25.786110 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff32a6-cc57-4377-a388-23802a9e0eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:25.786382 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff32a6-cc57-4377-a388-23802a9e0eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:25.794005 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 782/1551] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:25.800974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe08fce-5f4d-442e-83c6-c55ce9d8acad None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:25.806017 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe08fce-5f4d-442e-83c6-c55ce9d8acad None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:25.811156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd39fc-363e-4b52-81a3-cdcada80eb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:25.811845 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd39fc-363e-4b52-81a3-cdcada80eb2b admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:25.812120 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd39fc-363e-4b52-81a3-cdcada80eb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:25.812389 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd39fc-363e-4b52-81a3-cdcada80eb2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:25.812551 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-d7ff32a6-cc57-4377-a388-23802a9e0eb2 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:25.813024 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd39fc-363e-4b52-81a3-cdcada80eb2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:25.813677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d7ff32a6-cc57-4377-a388-23802a9e0eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:25.814605 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd39fc-363e-4b52-81a3-cdcada80eb2b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:25.822573 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 770/1552] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:25.823531 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbd6d2-0eb3-489d-afdc-6780ec1168e4 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:25.823848 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbd6d2-0eb3-489d-afdc-6780ec1168e4 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:25.824122 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbd6d2-0eb3-489d-afdc-6780ec1168e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:25.829497 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 783/1553] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:25.830749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf0bb1-e047-4d10-8de8-e622d90a9de3 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:25.831154 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf0bb1-e047-4d10-8de8-e622d90a9de3 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:25.831496 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf0bb1-e047-4d10-8de8-e622d90a9de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:25.845030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-65cbd6d2-0eb3-489d-afdc-6780ec1168e4 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:25.846225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-65cbd6d2-0eb3-489d-afdc-6780ec1168e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:25.851594 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-8ddf0bb1-e047-4d10-8de8-e622d90a9de3 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:25.852845 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8ddf0bb1-e047-4d10-8de8-e622d90a9de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:25.854073 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 771/1554] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:25.861601 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507c758-5fd7-4ca9-8ec6-498d04a59b85 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:25.861601 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507c758-5fd7-4ca9-8ec6-498d04a59b85 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:25.861601 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507c758-5fd7-4ca9-8ec6-498d04a59b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:25.865045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 784/1555] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:25.866349 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2f5f0-f017-4c1d-97b5-ebcb868e8e99 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:25.866563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2f5f0-f017-4c1d-97b5-ebcb868e8e99 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:25.866833 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2f5f0-f017-4c1d-97b5-ebcb868e8e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:25.884495 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-2507c758-5fd7-4ca9-8ec6-498d04a59b85 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:25.885730 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-2507c758-5fd7-4ca9-8ec6-498d04a59b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:25.892917 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-dbd2f5f0-f017-4c1d-97b5-ebcb868e8e99 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:25.894183 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-dbd2f5f0-f017-4c1d-97b5-ebcb868e8e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:25.895748 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 772/1556] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:25.896495 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507c758-5fd7-4ca9-8ec6-498d04a59b85 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:25.906359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507c758-5fd7-4ca9-8ec6-498d04a59b85 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:25.909198 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 785/1557] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:25.910586 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32705ebb-4dc3-4e7f-be8a-7736e5cd9b8c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:25.910868 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32705ebb-4dc3-4e7f-be8a-7736e5cd9b8c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:25.911165 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32705ebb-4dc3-4e7f-be8a-7736e5cd9b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:25.917043 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b63561-4bfe-4adc-9adb-e5dfd0c318ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:25.917666 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b63561-4bfe-4adc-9adb-e5dfd0c318ae admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:25.917943 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b63561-4bfe-4adc-9adb-e5dfd0c318ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:25.918216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b63561-4bfe-4adc-9adb-e5dfd0c318ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:25.918890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b63561-4bfe-4adc-9adb-e5dfd0c318ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:25.920549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b63561-4bfe-4adc-9adb-e5dfd0c318ae admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:25.922737 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:25.932141 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 773/1558] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:25.933172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b63561-4bfe-4adc-9adb-e5dfd0c318ae admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:25.936662 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-32705ebb-4dc3-4e7f-be8a-7736e5cd9b8c None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:25.937873 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-32705ebb-4dc3-4e7f-be8a-7736e5cd9b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:25.944989 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b63561-4bfe-4adc-9adb-e5dfd0c318ae admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:25.946154 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 786/1559] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:25.947259 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9accf-d004-4ae3-bc53-99077e612100 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:25.947531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9accf-d004-4ae3-bc53-99077e612100 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:25.947853 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9accf-d004-4ae3-bc53-99077e612100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:25.950415 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832b8b4-a687-4655-94ae-93592895cb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:25.951806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832b8b4-a687-4655-94ae-93592895cb0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:25.952090 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832b8b4-a687-4655-94ae-93592895cb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:25.952362 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832b8b4-a687-4655-94ae-93592895cb0c admin admin] PATH_INFO: `/v3/projects/a27288b8a2aa47f5ac8dd00277fe91f0/users/f16d427fee2b4acd8832bee31d6603e2/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:25.961889 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:25.969510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832b8b4-a687-4655-94ae-93592895cb0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27288b8a2aa47f5ac8dd00277fe91f0, user_id=f16d427fee2b4acd8832bee31d6603e2, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:25.969879 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-2cb9accf-d004-4ae3-bc53-99077e612100 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:25.971095 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2cb9accf-d004-4ae3-bc53-99077e612100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:25.972670 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832b8b4-a687-4655-94ae-93592895cb0c admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:25.983605 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 787/1560] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:25.987240 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 774/1561] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:29:25 2022] PUT /identity/v3/projects/a27288b8a2aa47f5ac8dd00277fe91f0/users/f16d427fee2b4acd8832bee31d6603e2/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:25.988636 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c86d2-afb5-4276-b9f9-b1817bae8a3e None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:25.989033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c86d2-afb5-4276-b9f9-b1817bae8a3e None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:25.989426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c86d2-afb5-4276-b9f9-b1817bae8a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:25.989594 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de915bd-b4e9-481c-9966-929619274d6a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:25.989713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de915bd-b4e9-481c-9966-929619274d6a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:25.989953 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de915bd-b4e9-481c-9966-929619274d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:26.009496 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-a03c86d2-afb5-4276-b9f9-b1817bae8a3e None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:26.010695 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a03c86d2-afb5-4276-b9f9-b1817bae8a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:26.012071 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-4de915bd-b4e9-481c-9966-929619274d6a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:26.013790 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4de915bd-b4e9-481c-9966-929619274d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:26.073387 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 775/1562] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:26.078944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d4b6f-d1ef-4af8-af38-50e55b7d2d68 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:26.079238 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d4b6f-d1ef-4af8-af38-50e55b7d2d68 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:26.079515 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d4b6f-d1ef-4af8-af38-50e55b7d2d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:26.081277 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 788/1563] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:26.082576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24188e8-c227-4975-b252-7dc2654859b0 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:26.082862 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24188e8-c227-4975-b252-7dc2654859b0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:26.083130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24188e8-c227-4975-b252-7dc2654859b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:26.103012 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-c16d4b6f-d1ef-4af8-af38-50e55b7d2d68 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:26.104327 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-c16d4b6f-d1ef-4af8-af38-50e55b7d2d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:26.105504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f24188e8-c227-4975-b252-7dc2654859b0 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:26.106678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f24188e8-c227-4975-b252-7dc2654859b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:26.113420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 776/1564] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:26.114299 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d4b6f-d1ef-4af8-af38-50e55b7d2d68 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:26.118559 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 789/1565] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:26.119615 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24188e8-c227-4975-b252-7dc2654859b0 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:26.128337 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d4b6f-d1ef-4af8-af38-50e55b7d2d68 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:26.132004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24188e8-c227-4975-b252-7dc2654859b0 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:26.132995 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f922bd-7a54-4615-a911-b3b6e7c5bc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:26.133705 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f922bd-7a54-4615-a911-b3b6e7c5bc06 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:26.133892 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f922bd-7a54-4615-a911-b3b6e7c5bc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:26.134166 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f922bd-7a54-4615-a911-b3b6e7c5bc06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:26.134840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f922bd-7a54-4615-a911-b3b6e7c5bc06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:26.136478 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f922bd-7a54-4615-a911-b3b6e7c5bc06 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:26.137103 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04927ee9-cec0-409e-8138-b2f2344492a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:26.137700 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04927ee9-cec0-409e-8138-b2f2344492a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:26.138531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04927ee9-cec0-409e-8138-b2f2344492a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:26.138784 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04927ee9-cec0-409e-8138-b2f2344492a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:26.139624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04927ee9-cec0-409e-8138-b2f2344492a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:29:26.139981 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04927ee9-cec0-409e-8138-b2f2344492a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:26.141567 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04927ee9-cec0-409e-8138-b2f2344492a4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:26.148127 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 777/1566] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:26.151539 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f922bd-7a54-4615-a911-b3b6e7c5bc06 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:26.160567 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 790/1567] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:29:26.160567 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f5edc-80c1-49b4-8803-9ea4ee182432 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:26.160567 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f5edc-80c1-49b4-8803-9ea4ee182432 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:26.160567 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f5edc-80c1-49b4-8803-9ea4ee182432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:26.164688 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f922bd-7a54-4615-a911-b3b6e7c5bc06 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:26.169971 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4f02d-1431-4c88-ba2a-b51afa9aff43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:26.170579 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4f02d-1431-4c88-ba2a-b51afa9aff43 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:26.170944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4f02d-1431-4c88-ba2a-b51afa9aff43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:26.171218 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4f02d-1431-4c88-ba2a-b51afa9aff43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:26.171931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4f02d-1431-4c88-ba2a-b51afa9aff43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:29:26.172235 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4f02d-1431-4c88-ba2a-b51afa9aff43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:26.173832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4f02d-1431-4c88-ba2a-b51afa9aff43 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:26.178559 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c56f5edc-80c1-49b4-8803-9ea4ee182432 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:26.179781 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c56f5edc-80c1-49b4-8803-9ea4ee182432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:26.187008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 778/1568] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:29:26.187860 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4f02d-1431-4c88-ba2a-b51afa9aff43 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:26.188423 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 791/1569] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:26.189265 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f5edc-80c1-49b4-8803-9ea4ee182432 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:26.202509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4f02d-1431-4c88-ba2a-b51afa9aff43 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:26.203918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f5edc-80c1-49b4-8803-9ea4ee182432 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:26.207214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e520fe1-5f4b-48be-aad5-43682fa488e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:26.207901 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e520fe1-5f4b-48be-aad5-43682fa488e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:26.208281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e520fe1-5f4b-48be-aad5-43682fa488e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:26.208455 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e520fe1-5f4b-48be-aad5-43682fa488e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:26.208797 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd40b1-4fce-47fd-9c75-2a06c858ec30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:26.209443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd40b1-4fce-47fd-9c75-2a06c858ec30 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:26.209564 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e520fe1-5f4b-48be-aad5-43682fa488e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:29:26.209725 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e520fe1-5f4b-48be-aad5-43682fa488e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:26.210586 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd40b1-4fce-47fd-9c75-2a06c858ec30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:26.210864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd40b1-4fce-47fd-9c75-2a06c858ec30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:26.211333 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e520fe1-5f4b-48be-aad5-43682fa488e2 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:26.211503 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd40b1-4fce-47fd-9c75-2a06c858ec30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:29:26.211839 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd40b1-4fce-47fd-9c75-2a06c858ec30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:26.213467 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd40b1-4fce-47fd-9c75-2a06c858ec30 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:26.224143 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 779/1570] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:29:26.225010 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e520fe1-5f4b-48be-aad5-43682fa488e2 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:26.233614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 792/1571] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:29:26.234707 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd40b1-4fce-47fd-9c75-2a06c858ec30 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:26.242641 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e520fe1-5f4b-48be-aad5-43682fa488e2 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:26.244808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd40b1-4fce-47fd-9c75-2a06c858ec30 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:26.247301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd3a77-9b18-4187-9969-d90f97be437a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:26.248681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd3a77-9b18-4187-9969-d90f97be437a admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:26.249074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd3a77-9b18-4187-9969-d90f97be437a admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:26.249501 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd3a77-9b18-4187-9969-d90f97be437a admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:26.250220 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd3a77-9b18-4187-9969-d90f97be437a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:29:26.250347 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f476125-1faf-4ab6-87c3-ea33fb9c72c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:26.250556 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd3a77-9b18-4187-9969-d90f97be437a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:26.250841 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f476125-1faf-4ab6-87c3-ea33fb9c72c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:26.251117 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f476125-1faf-4ab6-87c3-ea33fb9c72c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:26.251386 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f476125-1faf-4ab6-87c3-ea33fb9c72c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:26.252050 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f476125-1faf-4ab6-87c3-ea33fb9c72c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:29:26.252162 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd3a77-9b18-4187-9969-d90f97be437a admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:26.252350 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f476125-1faf-4ab6-87c3-ea33fb9c72c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:26.254164 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f476125-1faf-4ab6-87c3-ea33fb9c72c3 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:26.264376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 780/1572] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:29:26.265331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd3a77-9b18-4187-9969-d90f97be437a admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:26.271028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 793/1573] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:29:26.272373 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f476125-1faf-4ab6-87c3-ea33fb9c72c3 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:26.275762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd3a77-9b18-4187-9969-d90f97be437a admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:26.281837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068f20c-3404-46a7-880e-130481c19ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:26.282495 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068f20c-3404-46a7-880e-130481c19ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:26.282769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068f20c-3404-46a7-880e-130481c19ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:26.283042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068f20c-3404-46a7-880e-130481c19ce0 admin admin] PATH_INFO: `/v3/projects/a4cb87d43329485094a983a67dfeb35a/users/d18b4afcdb954e5cb3eac680cda77b40/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:26.283409 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f476125-1faf-4ab6-87c3-ea33fb9c72c3 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:26.288089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d86d8f-a064-423c-b398-fcfa624db34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:26.288720 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d86d8f-a064-423c-b398-fcfa624db34a admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:26.288997 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d86d8f-a064-423c-b398-fcfa624db34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:26.289281 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d86d8f-a064-423c-b398-fcfa624db34a admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:26.289912 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d86d8f-a064-423c-b398-fcfa624db34a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:26.291841 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d86d8f-a064-423c-b398-fcfa624db34a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:26.299969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068f20c-3404-46a7-880e-130481c19ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4cb87d43329485094a983a67dfeb35a, user_id=d18b4afcdb954e5cb3eac680cda77b40, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:26.302826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068f20c-3404-46a7-880e-130481c19ce0 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:26.317550 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 781/1574] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:29:26 2022] PUT /identity/v3/projects/a4cb87d43329485094a983a67dfeb35a/users/d18b4afcdb954e5cb3eac680cda77b40/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:26.318562 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068f20c-3404-46a7-880e-130481c19ce0 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:26.325431 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 794/1575] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:29:26 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:26.326582 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d86d8f-a064-423c-b398-fcfa624db34a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:26.383385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d86d8f-a064-423c-b398-fcfa624db34a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:26.386099 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068f20c-3404-46a7-880e-130481c19ce0 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:26.386930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cd30b-4cc5-4427-8e0e-ebc0af700d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:26.387536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cd30b-4cc5-4427-8e0e-ebc0af700d54 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:26.387846 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cd30b-4cc5-4427-8e0e-ebc0af700d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:26.388157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cd30b-4cc5-4427-8e0e-ebc0af700d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:26.396551 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:26.420840 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:26.448591 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab66b65-917a-4ee5-872e-f53ad1257bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:26.449294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab66b65-917a-4ee5-872e-f53ad1257bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:26.449569 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab66b65-917a-4ee5-872e-f53ad1257bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:26.449847 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab66b65-917a-4ee5-872e-f53ad1257bb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:26.450514 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab66b65-917a-4ee5-872e-f53ad1257bb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:26.452666 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab66b65-917a-4ee5-872e-f53ad1257bb0 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:26.455381 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cd30b-4cc5-4427-8e0e-ebc0af700d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:26.456850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cd30b-4cc5-4427-8e0e-ebc0af700d54 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:26.466974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 795/1576] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:26.467822 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cd30b-4cc5-4427-8e0e-ebc0af700d54 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:26.477937 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cd30b-4cc5-4427-8e0e-ebc0af700d54 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:26.486540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 782/1577] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:29:26 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:26.486540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab66b65-917a-4ee5-872e-f53ad1257bb0 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:26.487209 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d2d09-2055-4a27-b878-61418a68c3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:26.487867 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d2d09-2055-4a27-b878-61418a68c3cf admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:26.488226 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d2d09-2055-4a27-b878-61418a68c3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:26.488678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d2d09-2055-4a27-b878-61418a68c3cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:26.489427 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d2d09-2055-4a27-b878-61418a68c3cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:26.491903 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d2d09-2055-4a27-b878-61418a68c3cf admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:26.522191 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 796/1578] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:29:26 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:26.523114 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d2d09-2055-4a27-b878-61418a68c3cf admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:26.559584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab66b65-917a-4ee5-872e-f53ad1257bb0 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:26.607740 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d2d09-2055-4a27-b878-61418a68c3cf admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:26.615248 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de899eb-528e-4955-a68f-b7afa2b230cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:26.616090 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de899eb-528e-4955-a68f-b7afa2b230cd admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:26.617147 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de899eb-528e-4955-a68f-b7afa2b230cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:26.617532 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de899eb-528e-4955-a68f-b7afa2b230cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:26.618580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de899eb-528e-4955-a68f-b7afa2b230cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:26.622434 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de899eb-528e-4955-a68f-b7afa2b230cd admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:26.640937 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4429209-bd28-4338-a74c-416600439c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:26.642013 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4429209-bd28-4338-a74c-416600439c7b admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:26.642302 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4429209-bd28-4338-a74c-416600439c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:26.642575 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4429209-bd28-4338-a74c-416600439c7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:26.643248 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4429209-bd28-4338-a74c-416600439c7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:26.645485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4429209-bd28-4338-a74c-416600439c7b admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:26.659506 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 797/1579] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:29:26 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:26.660595 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de899eb-528e-4955-a68f-b7afa2b230cd admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:26.684350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 783/1580] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:29:26 2022] POST /identity/v3/projects => generated 365 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:26.685829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4429209-bd28-4338-a74c-416600439c7b admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:26.735763 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:26.750785 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de899eb-528e-4955-a68f-b7afa2b230cd admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:26.774768 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4429209-bd28-4338-a74c-416600439c7b admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:26.781191 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05a5f5-9085-4c9c-953d-14b99239437b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:26.781816 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05a5f5-9085-4c9c-953d-14b99239437b admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:26.782103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05a5f5-9085-4c9c-953d-14b99239437b admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:26.782375 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05a5f5-9085-4c9c-953d-14b99239437b admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:26.783138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05a5f5-9085-4c9c-953d-14b99239437b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:26.785301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05a5f5-9085-4c9c-953d-14b99239437b admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:26.791971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:26.814882 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 784/1581] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:29:26 2022] POST /identity/v3/users => generated 296 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:26.817186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc634b1-77ba-4c41-aa05-77c769136e2c None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:26.817589 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc634b1-77ba-4c41-aa05-77c769136e2c None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:26.817893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc634b1-77ba-4c41-aa05-77c769136e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:26.821919 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0288567-4d89-468c-b09c-68cdd28bfb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:26.822612 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0288567-4d89-468c-b09c-68cdd28bfb31 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:26.830721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0288567-4d89-468c-b09c-68cdd28bfb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:26.830721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0288567-4d89-468c-b09c-68cdd28bfb31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:26.831426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0288567-4d89-468c-b09c-68cdd28bfb31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:26.833753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0288567-4d89-468c-b09c-68cdd28bfb31 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:26.870125 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-cdc634b1-77ba-4c41-aa05-77c769136e2c None None] MFA Rules not processed for user `d18b4afcdb954e5cb3eac680cda77b40`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:26.871773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-cdc634b1-77ba-4c41-aa05-77c769136e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:26.878565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 798/1582] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:29:26 2022] POST /identity/v3/projects => generated 375 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:26.879733 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0288567-4d89-468c-b09c-68cdd28bfb31 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:26.946957 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 785/1583] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:26.952626 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc634b1-77ba-4c41-aa05-77c769136e2c None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:26.964305 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc634b1-77ba-4c41-aa05-77c769136e2c None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:26.994229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0288567-4d89-468c-b09c-68cdd28bfb31 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:27.001038 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f01486-a4c6-439c-91ab-251c9be71acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:27.001723 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f01486-a4c6-439c-91ab-251c9be71acb admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.002018 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f01486-a4c6-439c-91ab-251c9be71acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.006500 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f01486-a4c6-439c-91ab-251c9be71acb admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:27.007357 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f01486-a4c6-439c-91ab-251c9be71acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:27.009518 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f01486-a4c6-439c-91ab-251c9be71acb admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:27.034408 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df70b5-9a13-4e26-a402-3f77cfd80e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:27.035018 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df70b5-9a13-4e26-a402-3f77cfd80e86 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.035295 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df70b5-9a13-4e26-a402-3f77cfd80e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.035561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df70b5-9a13-4e26-a402-3f77cfd80e86 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:27.036643 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df70b5-9a13-4e26-a402-3f77cfd80e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:27.037952 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 799/1584] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:29:26 2022] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:27.038557 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df70b5-9a13-4e26-a402-3f77cfd80e86 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:27.038777 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f01486-a4c6-439c-91ab-251c9be71acb admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:27.049801 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f01486-a4c6-439c-91ab-251c9be71acb admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:27.055658 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a68a9-9703-4613-b220-9c66a6438d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:27.056408 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a68a9-9703-4613-b220-9c66a6438d1e admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.056902 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a68a9-9703-4613-b220-9c66a6438d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.057195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a68a9-9703-4613-b220-9c66a6438d1e admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:27.057964 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a68a9-9703-4613-b220-9c66a6438d1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:27.061739 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a68a9-9703-4613-b220-9c66a6438d1e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:27.069392 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 786/1585] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:29:26 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:27.069392 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df70b5-9a13-4e26-a402-3f77cfd80e86 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:27.084767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df70b5-9a13-4e26-a402-3f77cfd80e86 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:27.090387 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c34b56-03e2-41e2-920d-1b3cc4f8c22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:27.091526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c34b56-03e2-41e2-920d-1b3cc4f8c22d admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.091839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c34b56-03e2-41e2-920d-1b3cc4f8c22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.092311 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c34b56-03e2-41e2-920d-1b3cc4f8c22d admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:27.093002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c34b56-03e2-41e2-920d-1b3cc4f8c22d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:27.094957 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c34b56-03e2-41e2-920d-1b3cc4f8c22d admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:27.095571 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 800/1586] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:29:27 2022] POST /identity/v3/users => generated 290 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:27.096460 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a68a9-9703-4613-b220-9c66a6438d1e admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:27.111123 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a68a9-9703-4613-b220-9c66a6438d1e admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:27.119694 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707e55c-bfec-4e16-9d70-7d1c96b766aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:27.120700 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707e55c-bfec-4e16-9d70-7d1c96b766aa admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.125351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 787/1587] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:29:27 2022] POST /identity/v3/users => generated 283 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:27.125351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c34b56-03e2-41e2-920d-1b3cc4f8c22d admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:27.125611 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707e55c-bfec-4e16-9d70-7d1c96b766aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.125611 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707e55c-bfec-4e16-9d70-7d1c96b766aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:27.125611 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707e55c-bfec-4e16-9d70-7d1c96b766aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:27.127365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707e55c-bfec-4e16-9d70-7d1c96b766aa admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:27.140936 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c34b56-03e2-41e2-920d-1b3cc4f8c22d admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:27.144138 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 801/1588] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:27.144138 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f94c3-6236-4794-92cc-100691c9c9e3 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.144138 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f94c3-6236-4794-92cc-100691c9c9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.144138 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f94c3-6236-4794-92cc-100691c9c9e3 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:27.147783 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 802/1589] 10.222.0.62 () {54 vars in 961 bytes} [Tue Oct 4 14:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:29:27.149095 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f94c3-6236-4794-92cc-100691c9c9e3 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:27.149499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee51f9-2c55-420d-aa9e-a98e7a7b6f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:27.150223 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee51f9-2c55-420d-aa9e-a98e7a7b6f39 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.150693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee51f9-2c55-420d-aa9e-a98e7a7b6f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.151111 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee51f9-2c55-420d-aa9e-a98e7a7b6f39 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:27.151902 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee51f9-2c55-420d-aa9e-a98e7a7b6f39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:27.154471 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee51f9-2c55-420d-aa9e-a98e7a7b6f39 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:27.165693 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f94c3-6236-4794-92cc-100691c9c9e3 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:27.173126 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45681f-3bcd-45a8-93f5-fe502a5c100d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:27.173396 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45681f-3bcd-45a8-93f5-fe502a5c100d admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.173729 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45681f-3bcd-45a8-93f5-fe502a5c100d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.173913 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45681f-3bcd-45a8-93f5-fe502a5c100d admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:27.174558 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45681f-3bcd-45a8-93f5-fe502a5c100d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:27.176186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45681f-3bcd-45a8-93f5-fe502a5c100d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:27.183050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 788/1590] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:29:27 2022] POST /identity/v3/users => generated 288 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:27.184620 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee51f9-2c55-420d-aa9e-a98e7a7b6f39 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:27.189362 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 803/1591] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:27.193296 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45681f-3bcd-45a8-93f5-fe502a5c100d admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:27.196324 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:27.201026 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee51f9-2c55-420d-aa9e-a98e7a7b6f39 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:27.208313 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bb038-e551-4818-bd72-0f6884b96296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:27.208851 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45681f-3bcd-45a8-93f5-fe502a5c100d admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:27.208973 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bb038-e551-4818-bd72-0f6884b96296 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.209199 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bb038-e551-4818-bd72-0f6884b96296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.209470 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bb038-e551-4818-bd72-0f6884b96296 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:27.210127 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207bb038-e551-4818-bd72-0f6884b96296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:27.211895 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207bb038-e551-4818-bd72-0f6884b96296 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:27.215038 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc01387-42cf-4ece-a0e2-511a7c49f091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:27.215651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc01387-42cf-4ece-a0e2-511a7c49f091 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.215956 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc01387-42cf-4ece-a0e2-511a7c49f091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.216811 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc01387-42cf-4ece-a0e2-511a7c49f091 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:27.217448 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc01387-42cf-4ece-a0e2-511a7c49f091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:27.219103 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc01387-42cf-4ece-a0e2-511a7c49f091 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:27.223504 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 789/1592] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:27.224460 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bb038-e551-4818-bd72-0f6884b96296 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:27.233605 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 804/1593] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:27.234676 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc01387-42cf-4ece-a0e2-511a7c49f091 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:27.239552 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bb038-e551-4818-bd72-0f6884b96296 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:27.245428 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2395e-5dd3-4b19-b0a5-745f9d1c51de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:27.246096 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2395e-5dd3-4b19-b0a5-745f9d1c51de admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.246250 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc01387-42cf-4ece-a0e2-511a7c49f091 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:27.246360 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2395e-5dd3-4b19-b0a5-745f9d1c51de admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.246640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2395e-5dd3-4b19-b0a5-745f9d1c51de admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:27.247287 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2395e-5dd3-4b19-b0a5-745f9d1c51de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:27.249139 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2395e-5dd3-4b19-b0a5-745f9d1c51de admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:27.251054 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd25ec-bd76-49a0-a065-64b6b9717266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:27.251663 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd25ec-bd76-49a0-a065-64b6b9717266 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.251976 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd25ec-bd76-49a0-a065-64b6b9717266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.252241 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd25ec-bd76-49a0-a065-64b6b9717266 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:27.252877 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd25ec-bd76-49a0-a065-64b6b9717266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:27.254573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd25ec-bd76-49a0-a065-64b6b9717266 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:27.260553 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 790/1594] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:27.262452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2a37f-26be-478b-8629-23445d724941 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.262731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2a37f-26be-478b-8629-23445d724941 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.263050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2a37f-26be-478b-8629-23445d724941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:27.269489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 805/1595] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:27.269489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd25ec-bd76-49a0-a065-64b6b9717266 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:27.277913 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd25ec-bd76-49a0-a065-64b6b9717266 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:27.284646 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c982a-d102-4fa7-81ef-774591ccb5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:27.285359 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c982a-d102-4fa7-81ef-774591ccb5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.285630 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c982a-d102-4fa7-81ef-774591ccb5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.286013 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c982a-d102-4fa7-81ef-774591ccb5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:27.286881 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c982a-d102-4fa7-81ef-774591ccb5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:27.288582 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c982a-d102-4fa7-81ef-774591ccb5c6 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:27.304066 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 806/1596] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:27.305118 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c982a-d102-4fa7-81ef-774591ccb5c6 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:27.316541 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c982a-d102-4fa7-81ef-774591ccb5c6 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:27.317211 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-29d2a37f-26be-478b-8629-23445d724941 None None] MFA Rules not processed for user `151e7b9c7a7b46d58dc2f563d05775e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:27.318470 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-29d2a37f-26be-478b-8629-23445d724941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:27.321242 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f95bc-850a-48c0-8842-99b6c17e88d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:27.321933 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f95bc-850a-48c0-8842-99b6c17e88d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.322472 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f95bc-850a-48c0-8842-99b6c17e88d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.322834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f95bc-850a-48c0-8842-99b6c17e88d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:27.323858 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f95bc-850a-48c0-8842-99b6c17e88d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:27.326222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f95bc-850a-48c0-8842-99b6c17e88d5 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:27.338628 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 807/1597] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:27.339496 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f95bc-850a-48c0-8842-99b6c17e88d5 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:27.350363 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f95bc-850a-48c0-8842-99b6c17e88d5 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:27.359533 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179044c5-cafd-43ba-bd50-a077cdcaa3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:27.360267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179044c5-cafd-43ba-bd50-a077cdcaa3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.361685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179044c5-cafd-43ba-bd50-a077cdcaa3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.361959 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179044c5-cafd-43ba-bd50-a077cdcaa3e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:27.362600 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179044c5-cafd-43ba-bd50-a077cdcaa3e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:27.367162 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179044c5-cafd-43ba-bd50-a077cdcaa3e7 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:27.381157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 808/1598] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:27.382124 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179044c5-cafd-43ba-bd50-a077cdcaa3e7 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:27.394116 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179044c5-cafd-43ba-bd50-a077cdcaa3e7 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:27.398974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff5098-3552-4e49-a118-eef04ec2a840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:27.399634 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff5098-3552-4e49-a118-eef04ec2a840 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.400002 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff5098-3552-4e49-a118-eef04ec2a840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.400255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff5098-3552-4e49-a118-eef04ec2a840 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:27.400960 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff5098-3552-4e49-a118-eef04ec2a840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:27.402601 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff5098-3552-4e49-a118-eef04ec2a840 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:27.413908 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 809/1599] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:27.414841 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff5098-3552-4e49-a118-eef04ec2a840 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:27.432841 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff5098-3552-4e49-a118-eef04ec2a840 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:27.433836 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 791/1600] 10.222.0.62 () {58 vars in 1058 bytes} [Tue Oct 4 14:29:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:27.441316 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a8250-0c3b-43c9-8866-d1e3b57ce580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:27.442070 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a8250-0c3b-43c9-8866-d1e3b57ce580 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.442411 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a8250-0c3b-43c9-8866-d1e3b57ce580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.442966 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a8250-0c3b-43c9-8866-d1e3b57ce580 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:27.443950 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a8250-0c3b-43c9-8866-d1e3b57ce580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:27.444457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2a37f-26be-478b-8629-23445d724941 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:27.445667 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a8250-0c3b-43c9-8866-d1e3b57ce580 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:27.447965 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:27.466841 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 810/1601] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:27.469001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a8250-0c3b-43c9-8866-d1e3b57ce580 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:27.478304 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2a37f-26be-478b-8629-23445d724941 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:27.486922 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a8250-0c3b-43c9-8866-d1e3b57ce580 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:27.491639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca59dd8-b9c1-4984-aa37-b450f4264c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:27.492374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca59dd8-b9c1-4984-aa37-b450f4264c8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.492651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e6f93-20fd-42e6-a44a-57004ab47c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:27.492785 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca59dd8-b9c1-4984-aa37-b450f4264c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.493014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca59dd8-b9c1-4984-aa37-b450f4264c8c admin admin] PATH_INFO: `/v3/projects/f836e0afa05b487eb066e7ce02d57154/users/62d720a284ad493bb8393289e9e38140/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:27.493381 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e6f93-20fd-42e6-a44a-57004ab47c96 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.493660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e6f93-20fd-42e6-a44a-57004ab47c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.494409 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e6f93-20fd-42e6-a44a-57004ab47c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:27.495309 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e6f93-20fd-42e6-a44a-57004ab47c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:27.496936 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e6f93-20fd-42e6-a44a-57004ab47c96 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:27.514006 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 811/1602] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:27.514006 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e6f93-20fd-42e6-a44a-57004ab47c96 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:27.529784 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e6f93-20fd-42e6-a44a-57004ab47c96 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:27.540168 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca59dd8-b9c1-4984-aa37-b450f4264c8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f836e0afa05b487eb066e7ce02d57154, user_id=62d720a284ad493bb8393289e9e38140, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:27.543370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca59dd8-b9c1-4984-aa37-b450f4264c8c admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:27.546595 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1496f50-4e71-4ac8-8804-e52c454cfcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:27.547297 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1496f50-4e71-4ac8-8804-e52c454cfcc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.547575 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1496f50-4e71-4ac8-8804-e52c454cfcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.547874 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1496f50-4e71-4ac8-8804-e52c454cfcc2 admin admin] PATH_INFO: `/v3/projects/ff1d781a0f0146da87d2370eba6c3599/users/61af523e48ec4687918b3f3f19490577/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:27.579387 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1496f50-4e71-4ac8-8804-e52c454cfcc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1d781a0f0146da87d2370eba6c3599, user_id=61af523e48ec4687918b3f3f19490577, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:27.580465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: WARNING py.warnings [None req-d1496f50-4e71-4ac8-8804-e52c454cfcc2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 14:29:27.580465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: warnings.warn(msg) Oct 04 14:29:27.580465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: Oct 04 14:29:27.580941 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 792/1603] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:29:27 2022] PUT /identity/v3/projects/f836e0afa05b487eb066e7ce02d57154/users/62d720a284ad493bb8393289e9e38140/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:27.581766 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca59dd8-b9c1-4984-aa37-b450f4264c8c admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:27.582671 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1496f50-4e71-4ac8-8804-e52c454cfcc2 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:27.601065 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 812/1604] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:29:27 2022] PUT /identity/v3/projects/ff1d781a0f0146da87d2370eba6c3599/users/61af523e48ec4687918b3f3f19490577/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:27.602164 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1496f50-4e71-4ac8-8804-e52c454cfcc2 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:27.695267 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca59dd8-b9c1-4984-aa37-b450f4264c8c admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:27.698920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1496f50-4e71-4ac8-8804-e52c454cfcc2 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:27.704877 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37406df-83c2-4ae0-8de6-c9e38ea71712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:27.705687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37406df-83c2-4ae0-8de6-c9e38ea71712 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.705975 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37406df-83c2-4ae0-8de6-c9e38ea71712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.706165 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac13ab8-8d26-4d67-a42a-b7aa24ea25f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:27.706303 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37406df-83c2-4ae0-8de6-c9e38ea71712 admin admin] PATH_INFO: `/v3/projects/da54569a370b44b195e7cd713cce2369/users/45687f3cf65c4876a94fafbf220ca92d/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:27.706981 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac13ab8-8d26-4d67-a42a-b7aa24ea25f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.707323 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac13ab8-8d26-4d67-a42a-b7aa24ea25f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.707669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac13ab8-8d26-4d67-a42a-b7aa24ea25f6 admin admin] PATH_INFO: `/v3/projects/74b102eccada4cdc9e63421e0e0bac9b/users/fb6aad317d3c45cf8aa023eb88ff50e7/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:27.724808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac13ab8-8d26-4d67-a42a-b7aa24ea25f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b102eccada4cdc9e63421e0e0bac9b, user_id=fb6aad317d3c45cf8aa023eb88ff50e7, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:27.727456 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac13ab8-8d26-4d67-a42a-b7aa24ea25f6 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:27.732434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37406df-83c2-4ae0-8de6-c9e38ea71712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da54569a370b44b195e7cd713cce2369, user_id=45687f3cf65c4876a94fafbf220ca92d, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:27.735583 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37406df-83c2-4ae0-8de6-c9e38ea71712 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:27.753386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 793/1606] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:29:27 2022] PUT /identity/v3/projects/da54569a370b44b195e7cd713cce2369/users/45687f3cf65c4876a94fafbf220ca92d/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:27.756011 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37406df-83c2-4ae0-8de6-c9e38ea71712 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:27.756136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 813/1606] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:29:27 2022] PUT /identity/v3/projects/74b102eccada4cdc9e63421e0e0bac9b/users/fb6aad317d3c45cf8aa023eb88ff50e7/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:27.757244 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac13ab8-8d26-4d67-a42a-b7aa24ea25f6 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:27.790227 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:27.845972 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac13ab8-8d26-4d67-a42a-b7aa24ea25f6 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:27.874646 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37406df-83c2-4ae0-8de6-c9e38ea71712 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:27.881585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb88ca-efd3-47fd-ad63-9ba53ece8d00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:27.882368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb88ca-efd3-47fd-ad63-9ba53ece8d00 service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.882647 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb88ca-efd3-47fd-ad63-9ba53ece8d00 service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.882918 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb88ca-efd3-47fd-ad63-9ba53ece8d00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:27.913288 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:27.928813 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662fa90-eff7-4a99-892b-444be5a9a137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:27.929591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662fa90-eff7-4a99-892b-444be5a9a137 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.929896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662fa90-eff7-4a99-892b-444be5a9a137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.937851 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662fa90-eff7-4a99-892b-444be5a9a137 admin admin] PATH_INFO: `/v3/projects/2d4debc9ece04e788b75d7f28ee78969/users/4405580700c843709c2037270d20666d/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:27.962237 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb88ca-efd3-47fd-ad63-9ba53ece8d00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:27.963237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662fa90-eff7-4a99-892b-444be5a9a137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d4debc9ece04e788b75d7f28ee78969, user_id=4405580700c843709c2037270d20666d, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:27.963886 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb88ca-efd3-47fd-ad63-9ba53ece8d00 service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:27.965906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662fa90-eff7-4a99-892b-444be5a9a137 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:27.986473 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 814/1607] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:29:27 2022] PUT /identity/v3/projects/2d4debc9ece04e788b75d7f28ee78969/users/4405580700c843709c2037270d20666d/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:27.987385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662fa90-eff7-4a99-892b-444be5a9a137 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:27.988683 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 794/1608] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:27.992756 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a05a78-0532-4b93-b505-8a3f8b5d6b2b None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:27.993113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a05a78-0532-4b93-b505-8a3f8b5d6b2b None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:27.993431 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a05a78-0532-4b93-b505-8a3f8b5d6b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:28.037204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-75a05a78-0532-4b93-b505-8a3f8b5d6b2b None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:28.038461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-75a05a78-0532-4b93-b505-8a3f8b5d6b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:28.074112 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662fa90-eff7-4a99-892b-444be5a9a137 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:28.080161 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fe439-0d05-47cd-9683-34cc7d508029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:28.081093 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fe439-0d05-47cd-9683-34cc7d508029 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:28.081371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fe439-0d05-47cd-9683-34cc7d508029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:28.081666 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fe439-0d05-47cd-9683-34cc7d508029 admin admin] PATH_INFO: `/v3/projects/d84c5f42b0ec44e08dbdd1fffafb3cc1/users/7eaef5f6ca21428a9c87bb7dffc2017d/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:28.108182 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fe439-0d05-47cd-9683-34cc7d508029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84c5f42b0ec44e08dbdd1fffafb3cc1, user_id=7eaef5f6ca21428a9c87bb7dffc2017d, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:28.111072 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fe439-0d05-47cd-9683-34cc7d508029 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:28.133598 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 815/1609] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:29:27 2022] PUT /identity/v3/projects/d84c5f42b0ec44e08dbdd1fffafb3cc1/users/7eaef5f6ca21428a9c87bb7dffc2017d/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:28.137578 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c78a6f-d123-43d8-b9aa-d8d09643e782 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:28.138160 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c78a6f-d123-43d8-b9aa-d8d09643e782 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:28.138478 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c78a6f-d123-43d8-b9aa-d8d09643e782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:28.138710 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 795/1610] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:28.139994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a548e9-aff8-48b7-9620-d69c1e98812d None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:28.140281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a548e9-aff8-48b7-9620-d69c1e98812d None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:28.140552 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a548e9-aff8-48b7-9620-d69c1e98812d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:28.171855 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f0c78a6f-d123-43d8-b9aa-d8d09643e782 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:28.173224 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f0c78a6f-d123-43d8-b9aa-d8d09643e782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:28.213992 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-d9a548e9-aff8-48b7-9620-d69c1e98812d None None] MFA Rules not processed for user `fb6aad317d3c45cf8aa023eb88ff50e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:28.215908 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d9a548e9-aff8-48b7-9620-d69c1e98812d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:28.277039 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 816/1611] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:28.278538 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11df3c-45e9-4760-a359-88489bed4818 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:28.280691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11df3c-45e9-4760-a359-88489bed4818 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:28.281114 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11df3c-45e9-4760-a359-88489bed4818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:28.336382 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:28.339324 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-cd11df3c-45e9-4760-a359-88489bed4818 None None] MFA Rules not processed for user `45687f3cf65c4876a94fafbf220ca92d`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:28.342028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-cd11df3c-45e9-4760-a359-88489bed4818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:28.359785 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 796/1612] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:28.361296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703fc9e-fd33-4c4a-837f-6256e29b4e1d None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:28.361664 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703fc9e-fd33-4c4a-837f-6256e29b4e1d None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:28.361997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703fc9e-fd33-4c4a-837f-6256e29b4e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:28.397805 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-4703fc9e-fd33-4c4a-837f-6256e29b4e1d None None] MFA Rules not processed for user `4405580700c843709c2037270d20666d`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:28.399056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-4703fc9e-fd33-4c4a-837f-6256e29b4e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:28.418481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:28.461218 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 817/1613] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:28.464096 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90776c0-7901-4780-b209-661987b86e7f None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:28.465330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90776c0-7901-4780-b209-661987b86e7f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:28.467397 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90776c0-7901-4780-b209-661987b86e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:28.580279 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 797/1614] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:28.580279 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703fc9e-fd33-4c4a-837f-6256e29b4e1d None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:28.580835 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e90776c0-7901-4780-b209-661987b86e7f None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:28.580835 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e90776c0-7901-4780-b209-661987b86e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:28.580835 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 818/1615] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:28.581433 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90776c0-7901-4780-b209-661987b86e7f None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:28.655993 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703fc9e-fd33-4c4a-837f-6256e29b4e1d None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:28.661423 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654f27d-0198-4759-bfc0-65004143abf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:28.662061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654f27d-0198-4759-bfc0-65004143abf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:28.662334 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654f27d-0198-4759-bfc0-65004143abf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:28.662604 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654f27d-0198-4759-bfc0-65004143abf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:28.679115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654f27d-0198-4759-bfc0-65004143abf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:28.681410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654f27d-0198-4759-bfc0-65004143abf5 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:28.697208 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90776c0-7901-4780-b209-661987b86e7f None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:28.698277 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 798/1616] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:28.699273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654f27d-0198-4759-bfc0-65004143abf5 service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:28.712816 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2068d-30f8-4ff1-8b9d-e657fdf22603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:28.714484 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2068d-30f8-4ff1-8b9d-e657fdf22603 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:28.716109 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2068d-30f8-4ff1-8b9d-e657fdf22603 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:28.716614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2068d-30f8-4ff1-8b9d-e657fdf22603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:28.721277 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654f27d-0198-4759-bfc0-65004143abf5 service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:28.737331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460fa30-bc6a-417a-86f8-6ee65774c17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:28.738064 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2068d-30f8-4ff1-8b9d-e657fdf22603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:28.738197 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460fa30-bc6a-417a-86f8-6ee65774c17a admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:28.738544 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460fa30-bc6a-417a-86f8-6ee65774c17a admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:28.738913 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460fa30-bc6a-417a-86f8-6ee65774c17a admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:28.739642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2068d-30f8-4ff1-8b9d-e657fdf22603 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:28.739880 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460fa30-bc6a-417a-86f8-6ee65774c17a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:28.744390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460fa30-bc6a-417a-86f8-6ee65774c17a admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:28.771311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 819/1617] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:28.773103 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2068d-30f8-4ff1-8b9d-e657fdf22603 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:28.804708 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 799/1618] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:29:28 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:28.805870 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460fa30-bc6a-417a-86f8-6ee65774c17a admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:28.881057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2068d-30f8-4ff1-8b9d-e657fdf22603 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:28.902514 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460fa30-bc6a-417a-86f8-6ee65774c17a admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:28.907447 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44db81-06e4-4787-8c8c-fc85e97f1d5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:28.909040 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44db81-06e4-4787-8c8c-fc85e97f1d5a service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:28.909488 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44db81-06e4-4787-8c8c-fc85e97f1d5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:28.909893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44db81-06e4-4787-8c8c-fc85e97f1d5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:28.925994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:28.992432 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03422bb7-0bfc-43e2-a18b-ff68e6679458 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:28.993330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03422bb7-0bfc-43e2-a18b-ff68e6679458 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:28.993723 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03422bb7-0bfc-43e2-a18b-ff68e6679458 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:28.994110 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03422bb7-0bfc-43e2-a18b-ff68e6679458 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:29.015022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44db81-06e4-4787-8c8c-fc85e97f1d5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:29.016593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44db81-06e4-4787-8c8c-fc85e97f1d5a service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:29.019786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:29.028169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 800/1619] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:29.029894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44db81-06e4-4787-8c8c-fc85e97f1d5a service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:29.093876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03422bb7-0bfc-43e2-a18b-ff68e6679458 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:29.095490 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03422bb7-0bfc-43e2-a18b-ff68e6679458 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:29.103007 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44db81-06e4-4787-8c8c-fc85e97f1d5a service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:29.108606 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b3652-fc18-4afc-95d3-d2cd5a199de7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:29.109405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b3652-fc18-4afc-95d3-d2cd5a199de7 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:29.109792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b3652-fc18-4afc-95d3-d2cd5a199de7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:29.110155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b3652-fc18-4afc-95d3-d2cd5a199de7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:29.135696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 820/1620] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:29.140735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38863442-a498-46ce-8721-6d7be7095eab None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:29.141019 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38863442-a498-46ce-8721-6d7be7095eab None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:29.141289 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38863442-a498-46ce-8721-6d7be7095eab None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:29.146594 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 821/1621] 10.222.0.62 () {54 vars in 961 bytes} [Tue Oct 4 14:29:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:29:29.148472 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38863442-a498-46ce-8721-6d7be7095eab None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:29.204473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b3652-fc18-4afc-95d3-d2cd5a199de7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:29.206210 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b3652-fc18-4afc-95d3-d2cd5a199de7 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:29.234816 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 801/1622] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:29.236716 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cab40-a65e-4636-be31-ca7bd0f9acd8 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:29.236919 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cab40-a65e-4636-be31-ca7bd0f9acd8 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:29.237190 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cab40-a65e-4636-be31-ca7bd0f9acd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:29.273766 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-0d8cab40-a65e-4636-be31-ca7bd0f9acd8 None None] MFA Rules not processed for user `151e7b9c7a7b46d58dc2f563d05775e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:29.273766 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-0d8cab40-a65e-4636-be31-ca7bd0f9acd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:29.302920 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 802/1623] 10.222.0.62 () {58 vars in 1058 bytes} [Tue Oct 4 14:29:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:29.306023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9579d-80b5-4acd-a957-f2c2ca152837 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:29.306306 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9579d-80b5-4acd-a957-f2c2ca152837 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:29.307995 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9579d-80b5-4acd-a957-f2c2ca152837 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:29.310051 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38863442-a498-46ce-8721-6d7be7095eab None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:29.311416 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 803/1624] 10.222.0.62 () {54 vars in 912 bytes} [Tue Oct 4 14:29:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:29:29.312759 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a94bd-55d2-49a6-81fc-43ee64b42741 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:29.313510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a94bd-55d2-49a6-81fc-43ee64b42741 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:29.313510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a94bd-55d2-49a6-81fc-43ee64b42741 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:29.315518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 804/1625] 10.222.0.62 () {54 vars in 912 bytes} [Tue Oct 4 14:29:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:29:29.319949 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75739fb5-ec49-4c49-8d57-3c88e8abcdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:29.320519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75739fb5-ec49-4c49-8d57-3c88e8abcdee admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:29.320799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75739fb5-ec49-4c49-8d57-3c88e8abcdee admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:29.321063 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75739fb5-ec49-4c49-8d57-3c88e8abcdee admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:29.321702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75739fb5-ec49-4c49-8d57-3c88e8abcdee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:29.326512 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0194d51-e455-4485-afd1-0fe2d8a05a33 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:29.326512 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0194d51-e455-4485-afd1-0fe2d8a05a33 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:29.326512 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0194d51-e455-4485-afd1-0fe2d8a05a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:29.332184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75739fb5-ec49-4c49-8d57-3c88e8abcdee admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:29.368972 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-d0194d51-e455-4485-afd1-0fe2d8a05a33 None None] MFA Rules not processed for user `151e7b9c7a7b46d58dc2f563d05775e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:29.373551 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d0194d51-e455-4485-afd1-0fe2d8a05a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:29.386538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 805/1626] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Oct 4 14:29:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:29.388427 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966e32b-4017-4897-ab9a-4ecc17dadd6e None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:29.388721 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966e32b-4017-4897-ab9a-4ecc17dadd6e None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:29.388992 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966e32b-4017-4897-ab9a-4ecc17dadd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:29.414768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 822/1627] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:29:29 2022] POST /identity/v3/users => generated 296 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:29.416996 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75739fb5-ec49-4c49-8d57-3c88e8abcdee admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:29.438311 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-8966e32b-4017-4897-ab9a-4ecc17dadd6e None None] MFA Rules not processed for user `151e7b9c7a7b46d58dc2f563d05775e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:29.439614 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-8966e32b-4017-4897-ab9a-4ecc17dadd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:29.449718 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75739fb5-ec49-4c49-8d57-3c88e8abcdee admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:29.462738 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 806/1628] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Oct 4 14:29:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:29.463886 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966e32b-4017-4897-ab9a-4ecc17dadd6e None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:29.465013 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f1b5e-fa0b-4968-8fc9-fd68b5cd48a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:29.466317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f1b5e-fa0b-4968-8fc9-fd68b5cd48a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:29.468281 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f1b5e-fa0b-4968-8fc9-fd68b5cd48a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:29.469470 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f1b5e-fa0b-4968-8fc9-fd68b5cd48a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:29.480472 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966e32b-4017-4897-ab9a-4ecc17dadd6e None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:29.486968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722eff5-69ea-498f-a43b-d9928022e2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:29.487926 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722eff5-69ea-498f-a43b-d9928022e2de admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:29.488574 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722eff5-69ea-498f-a43b-d9928022e2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:29.488822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722eff5-69ea-498f-a43b-d9928022e2de admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:29.489553 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722eff5-69ea-498f-a43b-d9928022e2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:29.491360 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722eff5-69ea-498f-a43b-d9928022e2de admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:29.496530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f1b5e-fa0b-4968-8fc9-fd68b5cd48a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:29.498979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f1b5e-fa0b-4968-8fc9-fd68b5cd48a1 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:29.519340 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 807/1629] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:29.520744 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722eff5-69ea-498f-a43b-d9928022e2de admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:29.529620 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 823/1630] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:29.554766 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722eff5-69ea-498f-a43b-d9928022e2de admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:29.575769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ef101-76f6-4ee8-a6ff-a7a97ea35e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:29.576642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ef101-76f6-4ee8-a6ff-a7a97ea35e20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:29.576939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ef101-76f6-4ee8-a6ff-a7a97ea35e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:29.577212 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ef101-76f6-4ee8-a6ff-a7a97ea35e20 admin admin] PATH_INFO: `/v3/projects/e13a3783c04b4a609e1b8563119c95f1/users/8eacf8b6db1c42908a92a58c5a02f54e/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:29.611013 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ef101-76f6-4ee8-a6ff-a7a97ea35e20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e13a3783c04b4a609e1b8563119c95f1, user_id=8eacf8b6db1c42908a92a58c5a02f54e, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:29.613907 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ef101-76f6-4ee8-a6ff-a7a97ea35e20 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:29.636236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 808/1631] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:29:29 2022] PUT /identity/v3/projects/e13a3783c04b4a609e1b8563119c95f1/users/8eacf8b6db1c42908a92a58c5a02f54e/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:29.640947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f1b5e-fa0b-4968-8fc9-fd68b5cd48a1 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:29.659754 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f1b5e-fa0b-4968-8fc9-fd68b5cd48a1 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:29.819890 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462c98b-0db1-4699-88ea-f69fd14c608c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:29.821618 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462c98b-0db1-4699-88ea-f69fd14c608c admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:29.822001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462c98b-0db1-4699-88ea-f69fd14c608c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:29.822723 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462c98b-0db1-4699-88ea-f69fd14c608c admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:29.825335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462c98b-0db1-4699-88ea-f69fd14c608c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:29.830138 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462c98b-0db1-4699-88ea-f69fd14c608c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:29.858725 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ef101-76f6-4ee8-a6ff-a7a97ea35e20 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:29.860394 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 824/1632] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:29.874414 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ef101-76f6-4ee8-a6ff-a7a97ea35e20 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:29.891532 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca0e98-ebf2-4aeb-ba96-d03c21b7e82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:29.892925 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca0e98-ebf2-4aeb-ba96-d03c21b7e82e admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:29.893209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca0e98-ebf2-4aeb-ba96-d03c21b7e82e admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:29.893485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca0e98-ebf2-4aeb-ba96-d03c21b7e82e admin admin] PATH_INFO: `/v3/projects/e13a3783c04b4a609e1b8563119c95f1/users/8eacf8b6db1c42908a92a58c5a02f54e/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:29.906012 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca0e98-ebf2-4aeb-ba96-d03c21b7e82e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e13a3783c04b4a609e1b8563119c95f1, user_id=8eacf8b6db1c42908a92a58c5a02f54e, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:29.915884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca0e98-ebf2-4aeb-ba96-d03c21b7e82e admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:29.918560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:29.948977 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 809/1633] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:29:29 2022] PUT /identity/v3/projects/e13a3783c04b4a609e1b8563119c95f1/users/8eacf8b6db1c42908a92a58c5a02f54e/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:29.961963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3398c0-c699-41ff-af69-4602067402da None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:29.962324 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3398c0-c699-41ff-af69-4602067402da None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:29.962520 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3398c0-c699-41ff-af69-4602067402da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:30.006245 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-4e3398c0-c699-41ff-af69-4602067402da None None] MFA Rules not processed for user `8eacf8b6db1c42908a92a58c5a02f54e`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:30.007612 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4e3398c0-c699-41ff-af69-4602067402da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:30.043614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:30.211809 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca0e98-ebf2-4aeb-ba96-d03c21b7e82e admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:30.224034 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 825/1634] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:29 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:30.345714 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca0e98-ebf2-4aeb-ba96-d03c21b7e82e admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:30.351955 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436e424-40ad-41d7-a862-bd1523c03246 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:30.352593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436e424-40ad-41d7-a862-bd1523c03246 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:30.352875 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436e424-40ad-41d7-a862-bd1523c03246 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:30.353145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436e424-40ad-41d7-a862-bd1523c03246 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:30.504830 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436e424-40ad-41d7-a862-bd1523c03246 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:30.506393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436e424-40ad-41d7-a862-bd1523c03246 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:30.534859 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 810/1635] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:29:30.635876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3398c0-c699-41ff-af69-4602067402da None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:30.654170 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3398c0-c699-41ff-af69-4602067402da None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:30.664357 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4325d-9786-425c-a8d6-e1b1762aedc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:30.665002 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4325d-9786-425c-a8d6-e1b1762aedc7 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:30.665280 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4325d-9786-425c-a8d6-e1b1762aedc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:30.665552 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4325d-9786-425c-a8d6-e1b1762aedc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:30.706702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4325d-9786-425c-a8d6-e1b1762aedc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:30.708209 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4325d-9786-425c-a8d6-e1b1762aedc7 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:30.740858 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 826/1636] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:30 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:30.973675 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436e424-40ad-41d7-a862-bd1523c03246 service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:30.983042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436e424-40ad-41d7-a862-bd1523c03246 service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:30.995133 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb2692-24f9-4961-8a31-02a9fb85923b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:30.995787 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb2692-24f9-4961-8a31-02a9fb85923b service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:30.996106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb2692-24f9-4961-8a31-02a9fb85923b service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:30.996372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb2692-24f9-4961-8a31-02a9fb85923b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:31.135510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb2692-24f9-4961-8a31-02a9fb85923b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:31.137245 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb2692-24f9-4961-8a31-02a9fb85923b service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:31.161360 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 811/1637] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:31.182744 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4325d-9786-425c-a8d6-e1b1762aedc7 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:31.350254 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4325d-9786-425c-a8d6-e1b1762aedc7 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:31.385248 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7dd27a-25ec-45c1-b4ca-1fc958a6f8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:31.387555 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dd27a-25ec-45c1-b4ca-1fc958a6f8b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:31.388780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dd27a-25ec-45c1-b4ca-1fc958a6f8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:31.390743 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dd27a-25ec-45c1-b4ca-1fc958a6f8b9 admin admin] PATH_INFO: `/v3/users/d18b4afcdb954e5cb3eac680cda77b40` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:31.394482 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7dd27a-25ec-45c1-b4ca-1fc958a6f8b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d18b4afcdb954e5cb3eac680cda77b40)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:31.398975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: WARNING py.warnings [None req-ea7dd27a-25ec-45c1-b4ca-1fc958a6f8b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 14:29:31.398975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: warnings.warn(msg) Oct 04 14:29:31.398975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: Oct 04 14:29:31.406280 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7dd27a-25ec-45c1-b4ca-1fc958a6f8b9 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:31.623061 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ea7dd27a-25ec-45c1-b4ca-1fc958a6f8b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd18b4afcdb954e5cb3eac680cda77b40'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:31.623726 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ea7dd27a-25ec-45c1-b4ca-1fc958a6f8b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd18b4afcdb954e5cb3eac680cda77b40'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:31.641451 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ea7dd27a-25ec-45c1-b4ca-1fc958a6f8b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd18b4afcdb954e5cb3eac680cda77b40'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:31.677450 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ea7dd27a-25ec-45c1-b4ca-1fc958a6f8b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd18b4afcdb954e5cb3eac680cda77b40'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:31.702473 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ea7dd27a-25ec-45c1-b4ca-1fc958a6f8b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd18b4afcdb954e5cb3eac680cda77b40'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:31.726663 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c07514-5720-4025-a30d-ae39f16cb1d9 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:31.727877 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c07514-5720-4025-a30d-ae39f16cb1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:31.727877 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c07514-5720-4025-a30d-ae39f16cb1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:31.730820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 827/1638] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:29:31 2022] DELETE /identity/v3/users/d18b4afcdb954e5cb3eac680cda77b40 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:31.767005 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-a8c07514-5720-4025-a30d-ae39f16cb1d9 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:31.770286 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a8c07514-5720-4025-a30d-ae39f16cb1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:31.845899 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:31.910269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 812/1639] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:31.923164 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7dd27a-25ec-45c1-b4ca-1fc958a6f8b9 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:31.924789 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ea7dd27a-25ec-45c1-b4ca-1fc958a6f8b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:31.981386 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:32.060343 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7dd27a-25ec-45c1-b4ca-1fc958a6f8b9 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:32.073412 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01033445-2198-4dd8-b264-5d0606be4d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:32.074218 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01033445-2198-4dd8-b264-5d0606be4d20 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:32.074501 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01033445-2198-4dd8-b264-5d0606be4d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:32.074776 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01033445-2198-4dd8-b264-5d0606be4d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:32.096404 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01033445-2198-4dd8-b264-5d0606be4d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:32.102040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01033445-2198-4dd8-b264-5d0606be4d20 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:32.124782 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 828/1640] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:33.783778 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c07514-5720-4025-a30d-ae39f16cb1d9 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:33.786023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a8c07514-5720-4025-a30d-ae39f16cb1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:33.821575 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c07514-5720-4025-a30d-ae39f16cb1d9 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:33.831571 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01033445-2198-4dd8-b264-5d0606be4d20 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:33.834021 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-01033445-2198-4dd8-b264-5d0606be4d20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:33.838826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bea8cb-4302-493e-90e9-27a0291992db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:33.839479 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bea8cb-4302-493e-90e9-27a0291992db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:33.843595 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bea8cb-4302-493e-90e9-27a0291992db admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:33.844004 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bea8cb-4302-493e-90e9-27a0291992db admin admin] PATH_INFO: `/v3/users/45687f3cf65c4876a94fafbf220ca92d` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:33.849111 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bea8cb-4302-493e-90e9-27a0291992db admin admin] RBAC: Authorizing `identity:delete_user(user_id=45687f3cf65c4876a94fafbf220ca92d)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:33.850479 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bea8cb-4302-493e-90e9-27a0291992db admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:33.894099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01033445-2198-4dd8-b264-5d0606be4d20 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:33.926793 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e65979-bfa0-4756-bbfe-fdfd30ae9c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:33.930545 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e65979-bfa0-4756-bbfe-fdfd30ae9c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:33.932365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e65979-bfa0-4756-bbfe-fdfd30ae9c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:33.932949 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e65979-bfa0-4756-bbfe-fdfd30ae9c58 admin admin] PATH_INFO: `/v3/projects/a4cb87d43329485094a983a67dfeb35a` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:33.939940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e65979-bfa0-4756-bbfe-fdfd30ae9c58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4cb87d43329485094a983a67dfeb35a)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:33.949468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e65979-bfa0-4756-bbfe-fdfd30ae9c58 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:33.974958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b6bea8cb-4302-493e-90e9-27a0291992db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45687f3cf65c4876a94fafbf220ca92d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:33.976141 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b6bea8cb-4302-493e-90e9-27a0291992db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45687f3cf65c4876a94fafbf220ca92d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:34.010019 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b6bea8cb-4302-493e-90e9-27a0291992db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45687f3cf65c4876a94fafbf220ca92d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:34.027027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b6bea8cb-4302-493e-90e9-27a0291992db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45687f3cf65c4876a94fafbf220ca92d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:34.037316 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b6bea8cb-4302-493e-90e9-27a0291992db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45687f3cf65c4876a94fafbf220ca92d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:34.066058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 813/1641] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:29:33 2022] DELETE /identity/v3/users/45687f3cf65c4876a94fafbf220ca92d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:34.071995 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405dd93-ca28-4f06-8b06-f610b14da68a None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:34.074475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405dd93-ca28-4f06-8b06-f610b14da68a None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:34.076224 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405dd93-ca28-4f06-8b06-f610b14da68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:34.104881 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b7e65979-bfa0-4756-bbfe-fdfd30ae9c58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4cb87d43329485094a983a67dfeb35a', 'request_id': 'req-b7e65979-bfa0-4756-bbfe-fdfd30ae9c58'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:34.139882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b7e65979-bfa0-4756-bbfe-fdfd30ae9c58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4cb87d43329485094a983a67dfeb35a', 'request_id': 'req-b7e65979-bfa0-4756-bbfe-fdfd30ae9c58'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:34.155999 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b7e65979-bfa0-4756-bbfe-fdfd30ae9c58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4cb87d43329485094a983a67dfeb35a', 'request_id': 'req-b7e65979-bfa0-4756-bbfe-fdfd30ae9c58'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:34.181095 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-0405dd93-ca28-4f06-8b06-f610b14da68a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:34.182818 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-0405dd93-ca28-4f06-8b06-f610b14da68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:34.187192 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b7e65979-bfa0-4756-bbfe-fdfd30ae9c58 admin admin] The token cache is being invalidate because project a4cb87d43329485094a983a67dfeb35a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:29:34.187835 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b7e65979-bfa0-4756-bbfe-fdfd30ae9c58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:34.188846 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b7e65979-bfa0-4756-bbfe-fdfd30ae9c58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:34.191934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 829/1642] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:29:33 2022] DELETE /identity/v3/projects/a4cb87d43329485094a983a67dfeb35a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:29:34.198503 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e0372-02c2-4eec-b98e-0b86936ad2c0 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:34.199078 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e0372-02c2-4eec-b98e-0b86936ad2c0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:34.199575 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e0372-02c2-4eec-b98e-0b86936ad2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:34.228413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-0b2e0372-02c2-4eec-b98e-0b86936ad2c0 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:34.230005 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0b2e0372-02c2-4eec-b98e-0b86936ad2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:34.445671 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 830/1643] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:34.455755 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e300e9d-4d46-4791-ae9c-fea374863fee None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:34.458711 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e300e9d-4d46-4791-ae9c-fea374863fee None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:34.458994 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e300e9d-4d46-4791-ae9c-fea374863fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:34.524113 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-8e300e9d-4d46-4791-ae9c-fea374863fee None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:34.527440 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8e300e9d-4d46-4791-ae9c-fea374863fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:34.559035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 831/1644] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:34.562425 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e300e9d-4d46-4791-ae9c-fea374863fee None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:34.564755 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 814/1645] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:34.590214 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e300e9d-4d46-4791-ae9c-fea374863fee None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:34.596088 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405dd93-ca28-4f06-8b06-f610b14da68a None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:34.598404 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-0405dd93-ca28-4f06-8b06-f610b14da68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:34.611909 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba79b0e-b7be-4bec-8c24-a24359294254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:34.612613 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba79b0e-b7be-4bec-8c24-a24359294254 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:34.612891 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba79b0e-b7be-4bec-8c24-a24359294254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:34.613164 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba79b0e-b7be-4bec-8c24-a24359294254 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:34.616858 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba79b0e-b7be-4bec-8c24-a24359294254 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:29:34.617183 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba79b0e-b7be-4bec-8c24-a24359294254 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:34.618845 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba79b0e-b7be-4bec-8c24-a24359294254 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:34.655629 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 832/1646] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:29:34.664506 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba79b0e-b7be-4bec-8c24-a24359294254 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:34.710861 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba79b0e-b7be-4bec-8c24-a24359294254 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:34.731135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24290790-99bf-45e8-90d8-6ccca2757cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:34.731960 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24290790-99bf-45e8-90d8-6ccca2757cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:34.732464 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24290790-99bf-45e8-90d8-6ccca2757cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:34.732819 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24290790-99bf-45e8-90d8-6ccca2757cc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:34.733488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24290790-99bf-45e8-90d8-6ccca2757cc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:34.735490 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24290790-99bf-45e8-90d8-6ccca2757cc5 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:34.861483 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 833/1647] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:29:34 2022] POST /identity/v3/projects => generated 355 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:29:34.867646 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24290790-99bf-45e8-90d8-6ccca2757cc5 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:34.895562 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:34.901632 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:34.920789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405dd93-ca28-4f06-8b06-f610b14da68a None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:35.116541 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5fa2c-2bff-4c3e-880a-ad50f1875ecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:35.117183 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5fa2c-2bff-4c3e-880a-ad50f1875ecc service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:35.117460 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5fa2c-2bff-4c3e-880a-ad50f1875ecc service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:35.117733 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5fa2c-2bff-4c3e-880a-ad50f1875ecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:35.135514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24290790-99bf-45e8-90d8-6ccca2757cc5 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:35.162082 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66db43-d183-4a89-bf29-603f0401645d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:35.163394 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66db43-d183-4a89-bf29-603f0401645d admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:35.163690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66db43-d183-4a89-bf29-603f0401645d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:35.165264 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66db43-d183-4a89-bf29-603f0401645d admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:35.167797 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66db43-d183-4a89-bf29-603f0401645d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:35.168783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5fa2c-2bff-4c3e-880a-ad50f1875ecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:35.174128 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66db43-d183-4a89-bf29-603f0401645d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:35.176432 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5fa2c-2bff-4c3e-880a-ad50f1875ecc service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:35.199548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 815/1648] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:29:35.253397 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 834/1649] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:29:34 2022] POST /identity/v3/users => generated 278 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:35.255060 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5fa2c-2bff-4c3e-880a-ad50f1875ecc service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:35.276526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5fa2c-2bff-4c3e-880a-ad50f1875ecc service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:35.309260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083b6ba-92ec-46ae-a82e-e0125472da53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:35.316511 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083b6ba-92ec-46ae-a82e-e0125472da53 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:35.316511 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083b6ba-92ec-46ae-a82e-e0125472da53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:35.316511 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083b6ba-92ec-46ae-a82e-e0125472da53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:35.316511 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083b6ba-92ec-46ae-a82e-e0125472da53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:35.323703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083b6ba-92ec-46ae-a82e-e0125472da53 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:35.348795 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 816/1650] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:35.350314 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66db43-d183-4a89-bf29-603f0401645d admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:35.365514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66db43-d183-4a89-bf29-603f0401645d admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:35.391626 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df26ed-d964-456f-afa1-5062987d06d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:35.392325 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df26ed-d964-456f-afa1-5062987d06d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:35.392603 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df26ed-d964-456f-afa1-5062987d06d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:35.392874 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df26ed-d964-456f-afa1-5062987d06d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:35.393825 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df26ed-d964-456f-afa1-5062987d06d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:35.395470 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df26ed-d964-456f-afa1-5062987d06d6 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:35.444039 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 835/1651] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:35.449245 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083b6ba-92ec-46ae-a82e-e0125472da53 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:35.470736 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083b6ba-92ec-46ae-a82e-e0125472da53 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:35.501295 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1dc7b-9d44-448b-a874-1360b69a2a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:35.501985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1dc7b-9d44-448b-a874-1360b69a2a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:35.504712 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1dc7b-9d44-448b-a874-1360b69a2a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:35.505046 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1dc7b-9d44-448b-a874-1360b69a2a6e admin admin] PATH_INFO: `/v3/projects/e08e8cad494b4199bd8260e90bbd6772/users/6584e9869c194bf2942e251d70a0fc4e/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:35.580749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1dc7b-9d44-448b-a874-1360b69a2a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08e8cad494b4199bd8260e90bbd6772, user_id=6584e9869c194bf2942e251d70a0fc4e, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:35.583461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1dc7b-9d44-448b-a874-1360b69a2a6e admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:35.616545 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 817/1652] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:29:35 2022] PUT /identity/v3/projects/e08e8cad494b4199bd8260e90bbd6772/users/6584e9869c194bf2942e251d70a0fc4e/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:35.629311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173fc80-e201-4288-8ff5-ad3fb4cdf5f3 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:35.629604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173fc80-e201-4288-8ff5-ad3fb4cdf5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:35.629879 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173fc80-e201-4288-8ff5-ad3fb4cdf5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:35.699513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c173fc80-e201-4288-8ff5-ad3fb4cdf5f3 None None] MFA Rules not processed for user `6584e9869c194bf2942e251d70a0fc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:35.701654 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c173fc80-e201-4288-8ff5-ad3fb4cdf5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:35.793495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 836/1653] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:35.798500 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1dc7b-9d44-448b-a874-1360b69a2a6e admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:35.959276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1dc7b-9d44-448b-a874-1360b69a2a6e admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:35.969165 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7129809-6cb1-46b7-beef-418ce50db493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:35.969900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7129809-6cb1-46b7-beef-418ce50db493 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:35.970192 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7129809-6cb1-46b7-beef-418ce50db493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:35.970453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7129809-6cb1-46b7-beef-418ce50db493 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:35.971196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7129809-6cb1-46b7-beef-418ce50db493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:35.974783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7129809-6cb1-46b7-beef-418ce50db493 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:36.024741 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 818/1654] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:29:35 2022] POST /identity/v3/projects => generated 357 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:36.026639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173fc80-e201-4288-8ff5-ad3fb4cdf5f3 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:36.041864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173fc80-e201-4288-8ff5-ad3fb4cdf5f3 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:36.160909 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c3c4e-ed5b-40f9-8dfe-fcd43130e80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:36.161754 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c3c4e-ed5b-40f9-8dfe-fcd43130e80a admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:36.162206 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c3c4e-ed5b-40f9-8dfe-fcd43130e80a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:36.162767 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c3c4e-ed5b-40f9-8dfe-fcd43130e80a admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:36.169534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c3c4e-ed5b-40f9-8dfe-fcd43130e80a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:36.173292 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c3c4e-ed5b-40f9-8dfe-fcd43130e80a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:36.212794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 837/1655] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:29:36 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:29:36.222290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7129809-6cb1-46b7-beef-418ce50db493 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:36.239209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7129809-6cb1-46b7-beef-418ce50db493 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:36.255845 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c23033-cea0-48f8-941a-74f97de756b6 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:36.256610 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c23033-cea0-48f8-941a-74f97de756b6 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:36.256886 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c23033-cea0-48f8-941a-74f97de756b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:36.258281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f1d76-5a61-48b4-af11-04941eb19157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:36.259282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f1d76-5a61-48b4-af11-04941eb19157 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:36.260415 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f1d76-5a61-48b4-af11-04941eb19157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:36.260819 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f1d76-5a61-48b4-af11-04941eb19157 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:36.262139 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f1d76-5a61-48b4-af11-04941eb19157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:36.271381 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:36.273262 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f1d76-5a61-48b4-af11-04941eb19157 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:36.297012 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 819/1656] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:36.298012 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f1d76-5a61-48b4-af11-04941eb19157 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:36.305034 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-14c23033-cea0-48f8-941a-74f97de756b6 None None] MFA Rules not processed for user `f16d427fee2b4acd8832bee31d6603e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:36.306644 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-14c23033-cea0-48f8-941a-74f97de756b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:36.310728 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f1d76-5a61-48b4-af11-04941eb19157 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:36.317395 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244d7df-3e44-4bb2-a26a-1d3c4d2ea68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:36.318300 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244d7df-3e44-4bb2-a26a-1d3c4d2ea68b admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:36.318672 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244d7df-3e44-4bb2-a26a-1d3c4d2ea68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:36.319036 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244d7df-3e44-4bb2-a26a-1d3c4d2ea68b admin admin] PATH_INFO: `/v3/projects/f503aef0fdcb4570baddd0f99a8f9e67/users/a1487fbbb545444a9c61e352d1c8d0b2/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:36.350263 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244d7df-3e44-4bb2-a26a-1d3c4d2ea68b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f503aef0fdcb4570baddd0f99a8f9e67, user_id=a1487fbbb545444a9c61e352d1c8d0b2, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:36.355618 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244d7df-3e44-4bb2-a26a-1d3c4d2ea68b admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:36.397635 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 820/1657] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:29:36 2022] PUT /identity/v3/projects/f503aef0fdcb4570baddd0f99a8f9e67/users/a1487fbbb545444a9c61e352d1c8d0b2/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:36.400376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244d7df-3e44-4bb2-a26a-1d3c4d2ea68b admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:36.431753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 838/1658] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:36.447046 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:36.448773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c23033-cea0-48f8-941a-74f97de756b6 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:36.451216 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-14c23033-cea0-48f8-941a-74f97de756b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:36.549866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244d7df-3e44-4bb2-a26a-1d3c4d2ea68b admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:36.556951 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f4537-1098-45e3-923d-e2345b0db59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:36.558613 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f4537-1098-45e3-923d-e2345b0db59d admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:36.558894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f4537-1098-45e3-923d-e2345b0db59d admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:36.559165 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f4537-1098-45e3-923d-e2345b0db59d admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:36.559889 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f4537-1098-45e3-923d-e2345b0db59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:36.562270 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f4537-1098-45e3-923d-e2345b0db59d admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:36.611581 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 821/1659] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:36.613951 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f4537-1098-45e3-923d-e2345b0db59d admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:36.637692 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f4537-1098-45e3-923d-e2345b0db59d admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:36.656516 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0d75c-3150-41d7-b1c5-eb7a46670366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:36.657209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0d75c-3150-41d7-b1c5-eb7a46670366 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:36.657492 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0d75c-3150-41d7-b1c5-eb7a46670366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:36.657768 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0d75c-3150-41d7-b1c5-eb7a46670366 admin admin] PATH_INFO: `/v3/projects/f503aef0fdcb4570baddd0f99a8f9e67/users/a1487fbbb545444a9c61e352d1c8d0b2/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:36.659600 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c23033-cea0-48f8-941a-74f97de756b6 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:36.667461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0d75c-3150-41d7-b1c5-eb7a46670366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f503aef0fdcb4570baddd0f99a8f9e67, user_id=a1487fbbb545444a9c61e352d1c8d0b2, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:36.671300 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0d75c-3150-41d7-b1c5-eb7a46670366 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:36.706358 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 822/1660] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:29:36 2022] PUT /identity/v3/projects/f503aef0fdcb4570baddd0f99a8f9e67/users/a1487fbbb545444a9c61e352d1c8d0b2/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:36.706358 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737ce7a-ea42-4ed8-aaf7-9af7ad7d0557 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:36.706358 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737ce7a-ea42-4ed8-aaf7-9af7ad7d0557 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:36.706358 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737ce7a-ea42-4ed8-aaf7-9af7ad7d0557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:36.771836 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-d737ce7a-ea42-4ed8-aaf7-9af7ad7d0557 None None] MFA Rules not processed for user `a1487fbbb545444a9c61e352d1c8d0b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:36.773220 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d737ce7a-ea42-4ed8-aaf7-9af7ad7d0557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:36.810736 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6476ea-a586-439b-acbe-a44179897bff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:36.811799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6476ea-a586-439b-acbe-a44179897bff service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:36.812278 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6476ea-a586-439b-acbe-a44179897bff service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:36.812737 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6476ea-a586-439b-acbe-a44179897bff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:36.896533 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:36.946309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 823/1661] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:36 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:29:36.975169 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6476ea-a586-439b-acbe-a44179897bff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:36.977083 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6476ea-a586-439b-acbe-a44179897bff service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:36.991544 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 839/1662] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:37.040795 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737ce7a-ea42-4ed8-aaf7-9af7ad7d0557 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:37.043209 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d737ce7a-ea42-4ed8-aaf7-9af7ad7d0557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:37.146686 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6476ea-a586-439b-acbe-a44179897bff service nova] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:37.148948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5d6476ea-a586-439b-acbe-a44179897bff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:37.182348 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6476ea-a586-439b-acbe-a44179897bff service nova] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:37.196007 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737ce7a-ea42-4ed8-aaf7-9af7ad7d0557 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:37.215059 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e41f54-210e-4732-9165-5501f76427de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:37.216434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e41f54-210e-4732-9165-5501f76427de service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:37.216730 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e41f54-210e-4732-9165-5501f76427de service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:37.217072 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e41f54-210e-4732-9165-5501f76427de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:37.247695 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e41f54-210e-4732-9165-5501f76427de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:37.250765 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e41f54-210e-4732-9165-5501f76427de service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:37.289909 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 824/1663] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:37 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:37.335145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd098c-c2f8-4b88-9fce-3701699b5cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:37.335960 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd098c-c2f8-4b88-9fce-3701699b5cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:37.336330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd098c-c2f8-4b88-9fce-3701699b5cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:37.336788 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd098c-c2f8-4b88-9fce-3701699b5cf4 admin admin] PATH_INFO: `/v3/projects/da54569a370b44b195e7cd713cce2369` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:37.339189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd098c-c2f8-4b88-9fce-3701699b5cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da54569a370b44b195e7cd713cce2369)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:37.343359 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd098c-c2f8-4b88-9fce-3701699b5cf4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:37.454258 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e41f54-210e-4732-9165-5501f76427de service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:37.464495 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e41f54-210e-4732-9165-5501f76427de service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:37.480911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-84dd098c-c2f8-4b88-9fce-3701699b5cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da54569a370b44b195e7cd713cce2369', 'request_id': 'req-84dd098c-c2f8-4b88-9fce-3701699b5cf4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:37.498364 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-84dd098c-c2f8-4b88-9fce-3701699b5cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da54569a370b44b195e7cd713cce2369', 'request_id': 'req-84dd098c-c2f8-4b88-9fce-3701699b5cf4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:37.510065 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-84dd098c-c2f8-4b88-9fce-3701699b5cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da54569a370b44b195e7cd713cce2369', 'request_id': 'req-84dd098c-c2f8-4b88-9fce-3701699b5cf4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:37.538253 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:37.538817 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-84dd098c-c2f8-4b88-9fce-3701699b5cf4 admin admin] The token cache is being invalidate because project da54569a370b44b195e7cd713cce2369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:29:37.539188 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-84dd098c-c2f8-4b88-9fce-3701699b5cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:37.540019 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-84dd098c-c2f8-4b88-9fce-3701699b5cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:37.542739 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 840/1664] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:29:37 2022] DELETE /identity/v3/projects/da54569a370b44b195e7cd713cce2369 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:29:37.551292 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215b1b8-50d9-412b-9d28-0c54c4778e36 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:37.551292 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215b1b8-50d9-412b-9d28-0c54c4778e36 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:37.551292 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215b1b8-50d9-412b-9d28-0c54c4778e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:37.571951 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd834fc7-3e61-44ad-9f25-5b6bf34eea9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:37.573905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd834fc7-3e61-44ad-9f25-5b6bf34eea9d service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:37.574240 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd834fc7-3e61-44ad-9f25-5b6bf34eea9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:37.574590 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd834fc7-3e61-44ad-9f25-5b6bf34eea9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:37.577636 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-dd834fc7-3e61-44ad-9f25-5b6bf34eea9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:37.595623 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-2215b1b8-50d9-412b-9d28-0c54c4778e36 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:37.596902 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2215b1b8-50d9-412b-9d28-0c54c4778e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:37.706285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:37.707583 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd834fc7-3e61-44ad-9f25-5b6bf34eea9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:37.709094 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd834fc7-3e61-44ad-9f25-5b6bf34eea9d service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:37.724338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 841/1665] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:37.733224 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6685f-0155-4012-9505-4261e489285b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:37.733978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6685f-0155-4012-9505-4261e489285b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:37.734393 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6685f-0155-4012-9505-4261e489285b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:37.738646 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 825/1666] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:37.798257 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-15a6685f-0155-4012-9505-4261e489285b None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:37.799227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-15a6685f-0155-4012-9505-4261e489285b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:37.826052 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 842/1667] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:37.830489 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd834fc7-3e61-44ad-9f25-5b6bf34eea9d service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:37.855090 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd834fc7-3e61-44ad-9f25-5b6bf34eea9d service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:37.871883 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e836155-8c48-4a3e-b653-ce41ae7041e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:37.872777 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e836155-8c48-4a3e-b653-ce41ae7041e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:37.873342 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e836155-8c48-4a3e-b653-ce41ae7041e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:37.873767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e836155-8c48-4a3e-b653-ce41ae7041e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:37.874723 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e836155-8c48-4a3e-b653-ce41ae7041e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:29:37.875167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e836155-8c48-4a3e-b653-ce41ae7041e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:37.877348 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e836155-8c48-4a3e-b653-ce41ae7041e8 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:37.905436 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 826/1668] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:29:37.906873 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6685f-0155-4012-9505-4261e489285b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:37.923259 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6685f-0155-4012-9505-4261e489285b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:37.947688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049dbf25-3d1d-42b6-977a-bcb0376236cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:37.948654 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dbf25-3d1d-42b6-977a-bcb0376236cd admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:37.948941 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dbf25-3d1d-42b6-977a-bcb0376236cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:37.949306 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dbf25-3d1d-42b6-977a-bcb0376236cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:37.952227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049dbf25-3d1d-42b6-977a-bcb0376236cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:37.956721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049dbf25-3d1d-42b6-977a-bcb0376236cd admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:38.054249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 843/1669] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:29:37 2022] POST /identity/v3/projects => generated 371 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:38.058817 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e836155-8c48-4a3e-b653-ce41ae7041e8 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:38.076850 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e836155-8c48-4a3e-b653-ce41ae7041e8 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:38.260893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf140e-ea13-4d41-8978-f4989258ddf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:38.263374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf140e-ea13-4d41-8978-f4989258ddf6 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:38.263666 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf140e-ea13-4d41-8978-f4989258ddf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:38.263979 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf140e-ea13-4d41-8978-f4989258ddf6 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:38.265684 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf140e-ea13-4d41-8978-f4989258ddf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:38.267648 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf140e-ea13-4d41-8978-f4989258ddf6 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:38.342787 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 827/1670] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:29:38 2022] POST /identity/v3/users => generated 286 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:38.343973 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049dbf25-3d1d-42b6-977a-bcb0376236cd admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:38.358486 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049dbf25-3d1d-42b6-977a-bcb0376236cd admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:38.363734 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f1cd3-e8fc-4530-a88c-681cc36c3250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:38.364800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f1cd3-e8fc-4530-a88c-681cc36c3250 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:38.365288 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f1cd3-e8fc-4530-a88c-681cc36c3250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:38.366035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f1cd3-e8fc-4530-a88c-681cc36c3250 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:38.366884 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f1cd3-e8fc-4530-a88c-681cc36c3250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:38.369264 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f1cd3-e8fc-4530-a88c-681cc36c3250 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:38.401939 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 844/1671] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:38.407906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf140e-ea13-4d41-8978-f4989258ddf6 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:38.420696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf140e-ea13-4d41-8978-f4989258ddf6 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:38.428383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240ebd0-0e78-4cc4-9926-12a02f3647e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:38.429117 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240ebd0-0e78-4cc4-9926-12a02f3647e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:38.429863 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240ebd0-0e78-4cc4-9926-12a02f3647e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:38.430205 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240ebd0-0e78-4cc4-9926-12a02f3647e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:38.430935 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240ebd0-0e78-4cc4-9926-12a02f3647e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:38.433894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240ebd0-0e78-4cc4-9926-12a02f3647e1 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:38.449002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 828/1672] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:38.453880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f1cd3-e8fc-4530-a88c-681cc36c3250 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:38.488354 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f1cd3-e8fc-4530-a88c-681cc36c3250 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:38.511086 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061552b4-901b-4ab3-affb-411fcaa41bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:38.511797 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061552b4-901b-4ab3-affb-411fcaa41bef admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:38.512082 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061552b4-901b-4ab3-affb-411fcaa41bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:38.512343 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061552b4-901b-4ab3-affb-411fcaa41bef admin admin] PATH_INFO: `/v3/projects/d0a7b62d09074214a8440d66209357af/users/53a1c76305374db7a61b028d347618a7/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:38.569378 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061552b4-901b-4ab3-affb-411fcaa41bef admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a7b62d09074214a8440d66209357af, user_id=53a1c76305374db7a61b028d347618a7, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:38.572906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061552b4-901b-4ab3-affb-411fcaa41bef admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:38.614476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 845/1673] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:29:38 2022] PUT /identity/v3/projects/d0a7b62d09074214a8440d66209357af/users/53a1c76305374db7a61b028d347618a7/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:29:38.627454 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b1b04-4749-4924-9bcb-5fd86cf4aee6 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:38.628104 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b1b04-4749-4924-9bcb-5fd86cf4aee6 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:38.628746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b1b04-4749-4924-9bcb-5fd86cf4aee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:38.683317 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-d12b1b04-4749-4924-9bcb-5fd86cf4aee6 None None] MFA Rules not processed for user `53a1c76305374db7a61b028d347618a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:38.684800 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d12b1b04-4749-4924-9bcb-5fd86cf4aee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:38.752106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:38.793587 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 829/1674] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:38.801251 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061552b4-901b-4ab3-affb-411fcaa41bef admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:38.907629 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061552b4-901b-4ab3-affb-411fcaa41bef admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:38.914148 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa960e-01fe-4a06-9899-9cdfa81ab1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:38.915048 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa960e-01fe-4a06-9899-9cdfa81ab1fd admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:38.915413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa960e-01fe-4a06-9899-9cdfa81ab1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:38.915930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa960e-01fe-4a06-9899-9cdfa81ab1fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:38.916654 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa960e-01fe-4a06-9899-9cdfa81ab1fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:38.920790 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa960e-01fe-4a06-9899-9cdfa81ab1fd admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:39.008386 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 846/1675] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:29:38 2022] POST /identity/v3/projects => generated 373 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:39.012725 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b1b04-4749-4924-9bcb-5fd86cf4aee6 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:39.027097 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b1b04-4749-4924-9bcb-5fd86cf4aee6 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:39.162262 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d48a12-5d9b-4cb0-b689-9803e951dd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:39.164098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d48a12-5d9b-4cb0-b689-9803e951dd96 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:39.164789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d48a12-5d9b-4cb0-b689-9803e951dd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:39.166437 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d48a12-5d9b-4cb0-b689-9803e951dd96 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:39.167477 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d48a12-5d9b-4cb0-b689-9803e951dd96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:39.182031 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d48a12-5d9b-4cb0-b689-9803e951dd96 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:39.221058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 830/1676] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:29:39 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:39.224662 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa960e-01fe-4a06-9899-9cdfa81ab1fd admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:39.241582 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa960e-01fe-4a06-9899-9cdfa81ab1fd admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:39.265041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e45c5-34dd-4db2-aa90-13d292ab132d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:39.268852 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e45c5-34dd-4db2-aa90-13d292ab132d admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:39.269847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e45c5-34dd-4db2-aa90-13d292ab132d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:39.272603 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e45c5-34dd-4db2-aa90-13d292ab132d admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:39.274329 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e45c5-34dd-4db2-aa90-13d292ab132d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:39.287100 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e45c5-34dd-4db2-aa90-13d292ab132d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:39.325163 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 847/1677] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:39.330335 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d48a12-5d9b-4cb0-b689-9803e951dd96 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:39.350123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d48a12-5d9b-4cb0-b689-9803e951dd96 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:39.367745 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c8a4c-cc05-4512-882f-b8ff096d22b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:39.367745 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c8a4c-cc05-4512-882f-b8ff096d22b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:39.368018 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c8a4c-cc05-4512-882f-b8ff096d22b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:39.369150 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c8a4c-cc05-4512-882f-b8ff096d22b0 admin admin] PATH_INFO: `/v3/projects/b0cff5bbc75647c29268ce48757bf0c1/users/6c2cb1a0cd8843ff8217d71aa1d9890c/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:39.404373 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c8a4c-cc05-4512-882f-b8ff096d22b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0cff5bbc75647c29268ce48757bf0c1, user_id=6c2cb1a0cd8843ff8217d71aa1d9890c, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:39.411777 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c8a4c-cc05-4512-882f-b8ff096d22b0 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:39.454075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 831/1678] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:29:39 2022] PUT /identity/v3/projects/b0cff5bbc75647c29268ce48757bf0c1/users/6c2cb1a0cd8843ff8217d71aa1d9890c/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:39.455528 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e45c5-34dd-4db2-aa90-13d292ab132d admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:39.470907 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e45c5-34dd-4db2-aa90-13d292ab132d admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:39.687673 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df3fd7-ee8c-4482-a0b3-a83caa0c8d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:39.688773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df3fd7-ee8c-4482-a0b3-a83caa0c8d21 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:39.689197 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df3fd7-ee8c-4482-a0b3-a83caa0c8d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:39.690165 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df3fd7-ee8c-4482-a0b3-a83caa0c8d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:39.691245 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df3fd7-ee8c-4482-a0b3-a83caa0c8d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:39.698201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df3fd7-ee8c-4482-a0b3-a83caa0c8d21 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:39.736431 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c8a4c-cc05-4512-882f-b8ff096d22b0 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:39.738569 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 848/1679] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:39.758074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c8a4c-cc05-4512-882f-b8ff096d22b0 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:39.773381 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678e621-40fa-4281-b89c-aa8b1509cd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:39.777960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678e621-40fa-4281-b89c-aa8b1509cd34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:39.779252 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678e621-40fa-4281-b89c-aa8b1509cd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:39.780641 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678e621-40fa-4281-b89c-aa8b1509cd34 admin admin] PATH_INFO: `/v3/projects/b0cff5bbc75647c29268ce48757bf0c1/users/6c2cb1a0cd8843ff8217d71aa1d9890c/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:39.788962 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678e621-40fa-4281-b89c-aa8b1509cd34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0cff5bbc75647c29268ce48757bf0c1, user_id=6c2cb1a0cd8843ff8217d71aa1d9890c, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:39.806511 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678e621-40fa-4281-b89c-aa8b1509cd34 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:39.829737 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 832/1680] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:29:39 2022] PUT /identity/v3/projects/b0cff5bbc75647c29268ce48757bf0c1/users/6c2cb1a0cd8843ff8217d71aa1d9890c/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:39.840953 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08609ee6-33ac-4d04-b3d2-43602d5821d5 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:39.841477 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08609ee6-33ac-4d04-b3d2-43602d5821d5 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:39.841924 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08609ee6-33ac-4d04-b3d2-43602d5821d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:39.869155 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:39.916736 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-08609ee6-33ac-4d04-b3d2-43602d5821d5 None None] MFA Rules not processed for user `6c2cb1a0cd8843ff8217d71aa1d9890c`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:39.918059 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-08609ee6-33ac-4d04-b3d2-43602d5821d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:40.118331 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 849/1681] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:40.174463 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678e621-40fa-4281-b89c-aa8b1509cd34 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:40.177075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f678e621-40fa-4281-b89c-aa8b1509cd34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:40.316725 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678e621-40fa-4281-b89c-aa8b1509cd34 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:40.329778 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ef915-8b7d-42dc-bcd8-e3ed67667131 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:40.331210 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ef915-8b7d-42dc-bcd8-e3ed67667131 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:40.331210 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ef915-8b7d-42dc-bcd8-e3ed67667131 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:40.331210 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ef915-8b7d-42dc-bcd8-e3ed67667131 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:40.367780 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ef915-8b7d-42dc-bcd8-e3ed67667131 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:40.373008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ef915-8b7d-42dc-bcd8-e3ed67667131 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:40.428719 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 833/1682] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:41.804482 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08609ee6-33ac-4d04-b3d2-43602d5821d5 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:41.997804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08609ee6-33ac-4d04-b3d2-43602d5821d5 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:42.014661 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06c64d-0594-423f-b3b9-940cd4ca3d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:42.015320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06c64d-0594-423f-b3b9-940cd4ca3d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:42.015595 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06c64d-0594-423f-b3b9-940cd4ca3d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:42.015890 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06c64d-0594-423f-b3b9-940cd4ca3d2f admin admin] PATH_INFO: `/v3/users/53a1c76305374db7a61b028d347618a7` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:42.018515 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06c64d-0594-423f-b3b9-940cd4ca3d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=53a1c76305374db7a61b028d347618a7)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:42.021382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06c64d-0594-423f-b3b9-940cd4ca3d2f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:42.145276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ed06c64d-0594-423f-b3b9-940cd4ca3d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53a1c76305374db7a61b028d347618a7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:42.147140 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ed06c64d-0594-423f-b3b9-940cd4ca3d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53a1c76305374db7a61b028d347618a7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:42.163805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ed06c64d-0594-423f-b3b9-940cd4ca3d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53a1c76305374db7a61b028d347618a7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:42.179621 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ef915-8b7d-42dc-bcd8-e3ed67667131 service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:42.181475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d59ef915-8b7d-42dc-bcd8-e3ed67667131 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:42.213053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ed06c64d-0594-423f-b3b9-940cd4ca3d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53a1c76305374db7a61b028d347618a7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:42.214763 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ef915-8b7d-42dc-bcd8-e3ed67667131 service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:42.228833 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c2576-afc2-447a-a96b-b758c8f38725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:42.229665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c2576-afc2-447a-a96b-b758c8f38725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:42.230043 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c2576-afc2-447a-a96b-b758c8f38725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:42.230413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c2576-afc2-447a-a96b-b758c8f38725 admin admin] PATH_INFO: `/v3/users/fb6aad317d3c45cf8aa023eb88ff50e7` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:42.233217 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c2576-afc2-447a-a96b-b758c8f38725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb6aad317d3c45cf8aa023eb88ff50e7)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:42.233714 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ed06c64d-0594-423f-b3b9-940cd4ca3d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53a1c76305374db7a61b028d347618a7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:42.236069 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c2576-afc2-447a-a96b-b758c8f38725 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:42.246381 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 850/1683] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:29:41 2022] DELETE /identity/v3/users/53a1c76305374db7a61b028d347618a7 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:42.250874 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e6257-e229-4f84-8827-b5f7d3821e89 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:42.251172 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e6257-e229-4f84-8827-b5f7d3821e89 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:42.251418 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e6257-e229-4f84-8827-b5f7d3821e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:42.292646 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e77e6257-e229-4f84-8827-b5f7d3821e89 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:42.296464 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e77e6257-e229-4f84-8827-b5f7d3821e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:42.312535 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:42.319480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:42.366289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a73c2576-afc2-447a-a96b-b758c8f38725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb6aad317d3c45cf8aa023eb88ff50e7'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:42.367361 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a73c2576-afc2-447a-a96b-b758c8f38725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb6aad317d3c45cf8aa023eb88ff50e7'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:42.395991 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a73c2576-afc2-447a-a96b-b758c8f38725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb6aad317d3c45cf8aa023eb88ff50e7'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:42.416451 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a73c2576-afc2-447a-a96b-b758c8f38725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb6aad317d3c45cf8aa023eb88ff50e7'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:42.432909 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a73c2576-afc2-447a-a96b-b758c8f38725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb6aad317d3c45cf8aa023eb88ff50e7'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:42.451419 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 834/1684] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:29:42 2022] DELETE /identity/v3/users/fb6aad317d3c45cf8aa023eb88ff50e7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:42.454013 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb44ef-47e9-4e3f-8dc9-48abfc097adb None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:42.454301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb44ef-47e9-4e3f-8dc9-48abfc097adb None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:42.454574 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb44ef-47e9-4e3f-8dc9-48abfc097adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:42.472496 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 851/1685] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:29:42.519505 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-04bb44ef-47e9-4e3f-8dc9-48abfc097adb None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:42.528549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-04bb44ef-47e9-4e3f-8dc9-48abfc097adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:42.534299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e6257-e229-4f84-8827-b5f7d3821e89 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:42.535942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e77e6257-e229-4f84-8827-b5f7d3821e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:42.762043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e6257-e229-4f84-8827-b5f7d3821e89 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:42.828385 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 835/1686] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:42.830291 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb44ef-47e9-4e3f-8dc9-48abfc097adb None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:42.838392 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-04bb44ef-47e9-4e3f-8dc9-48abfc097adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:42.887994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb44ef-47e9-4e3f-8dc9-48abfc097adb None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:42.903941 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a136e-5172-4cbb-9f70-de79ac669d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:42.905517 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a136e-5172-4cbb-9f70-de79ac669d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:42.907005 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a136e-5172-4cbb-9f70-de79ac669d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:42.910161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a136e-5172-4cbb-9f70-de79ac669d36 admin admin] PATH_INFO: `/v3/users/4405580700c843709c2037270d20666d` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:42.916775 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a136e-5172-4cbb-9f70-de79ac669d36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4405580700c843709c2037270d20666d)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:42.920428 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a136e-5172-4cbb-9f70-de79ac669d36 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:42.990241 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d2ebc-f7d7-488a-8e37-e7801a097f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:42.993655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d2ebc-f7d7-488a-8e37-e7801a097f95 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:42.993974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d2ebc-f7d7-488a-8e37-e7801a097f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:42.995986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d2ebc-f7d7-488a-8e37-e7801a097f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:43.030079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-4c0a136e-5172-4cbb-9f70-de79ac669d36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4405580700c843709c2037270d20666d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:43.036705 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-4c0a136e-5172-4cbb-9f70-de79ac669d36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4405580700c843709c2037270d20666d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:43.053801 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d2ebc-f7d7-488a-8e37-e7801a097f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:43.055385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d2ebc-f7d7-488a-8e37-e7801a097f95 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:43.083684 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-4c0a136e-5172-4cbb-9f70-de79ac669d36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4405580700c843709c2037270d20666d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:43.100351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-4c0a136e-5172-4cbb-9f70-de79ac669d36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4405580700c843709c2037270d20666d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:43.104369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 852/1687] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:29:43.105377 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d2ebc-f7d7-488a-8e37-e7801a097f95 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:43.117750 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2c6d2ebc-f7d7-488a-8e37-e7801a097f95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:43.147754 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-4c0a136e-5172-4cbb-9f70-de79ac669d36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4405580700c843709c2037270d20666d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:43.154137 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d2ebc-f7d7-488a-8e37-e7801a097f95 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:43.165255 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 836/1688] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:29:42 2022] DELETE /identity/v3/users/4405580700c843709c2037270d20666d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:43.173014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba01fbb-e2f2-48f2-813f-7862e98495d2 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:43.173708 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba01fbb-e2f2-48f2-813f-7862e98495d2 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:43.176401 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba01fbb-e2f2-48f2-813f-7862e98495d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:43.234305 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-dba01fbb-e2f2-48f2-813f-7862e98495d2 None None] MFA Rules not processed for user `f16d427fee2b4acd8832bee31d6603e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:43.237534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-dba01fbb-e2f2-48f2-813f-7862e98495d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:43.288377 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:43.329433 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111cd2b-6e6c-40d7-a07a-f6534769181d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:43.330132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111cd2b-6e6c-40d7-a07a-f6534769181d service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:43.330416 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111cd2b-6e6c-40d7-a07a-f6534769181d service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:43.330690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111cd2b-6e6c-40d7-a07a-f6534769181d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:43.337435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4111cd2b-6e6c-40d7-a07a-f6534769181d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:43.405524 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 837/1689] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:43.409891 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7766ea1-e7ea-4c7a-bf0c-4d4fba3f5de3 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:43.410539 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:43.410649 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7766ea1-e7ea-4c7a-bf0c-4d4fba3f5de3 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:43.410918 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7766ea1-e7ea-4c7a-bf0c-4d4fba3f5de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:43.453521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-e7766ea1-e7ea-4c7a-bf0c-4d4fba3f5de3 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:43.454785 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e7766ea1-e7ea-4c7a-bf0c-4d4fba3f5de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:43.514841 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111cd2b-6e6c-40d7-a07a-f6534769181d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:43.516595 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111cd2b-6e6c-40d7-a07a-f6534769181d service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:43.555207 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 853/1690] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:43.598769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 838/1691] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:43.693277 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111cd2b-6e6c-40d7-a07a-f6534769181d service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:43.694890 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4111cd2b-6e6c-40d7-a07a-f6534769181d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:43.716726 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111cd2b-6e6c-40d7-a07a-f6534769181d service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:43.724428 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdde66-e836-4d25-bd25-61ab35e5b4bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:43.725214 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdde66-e836-4d25-bd25-61ab35e5b4bf service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:43.725574 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdde66-e836-4d25-bd25-61ab35e5b4bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:43.726049 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdde66-e836-4d25-bd25-61ab35e5b4bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:43.747001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdde66-e836-4d25-bd25-61ab35e5b4bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:43.748866 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdde66-e836-4d25-bd25-61ab35e5b4bf service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:43.773238 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 854/1692] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:44.391954 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7766ea1-e7ea-4c7a-bf0c-4d4fba3f5de3 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:44.394223 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e7766ea1-e7ea-4c7a-bf0c-4d4fba3f5de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:44.428433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7766ea1-e7ea-4c7a-bf0c-4d4fba3f5de3 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:44.435160 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99491074-8de6-4907-8c63-363688fd6ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:44.435890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99491074-8de6-4907-8c63-363688fd6ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:44.436338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99491074-8de6-4907-8c63-363688fd6ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:44.436588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99491074-8de6-4907-8c63-363688fd6ea3 admin admin] PATH_INFO: `/v3/projects/d0a7b62d09074214a8440d66209357af` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:44.438474 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99491074-8de6-4907-8c63-363688fd6ea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0a7b62d09074214a8440d66209357af)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:44.440133 dv-cinder-860260-1-smb devstack@keystone.service[81468]: WARNING py.warnings [None req-99491074-8de6-4907-8c63-363688fd6ea3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 14:29:44.440133 dv-cinder-860260-1-smb devstack@keystone.service[81468]: warnings.warn(msg) Oct 04 14:29:44.440133 dv-cinder-860260-1-smb devstack@keystone.service[81468]: Oct 04 14:29:44.442319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99491074-8de6-4907-8c63-363688fd6ea3 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:44.589348 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-99491074-8de6-4907-8c63-363688fd6ea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0a7b62d09074214a8440d66209357af', 'request_id': 'req-99491074-8de6-4907-8c63-363688fd6ea3'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:44.635007 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-99491074-8de6-4907-8c63-363688fd6ea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0a7b62d09074214a8440d66209357af', 'request_id': 'req-99491074-8de6-4907-8c63-363688fd6ea3'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:44.650250 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-99491074-8de6-4907-8c63-363688fd6ea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0a7b62d09074214a8440d66209357af', 'request_id': 'req-99491074-8de6-4907-8c63-363688fd6ea3'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:44.695412 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-99491074-8de6-4907-8c63-363688fd6ea3 admin admin] The token cache is being invalidate because project d0a7b62d09074214a8440d66209357af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:29:44.695658 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-99491074-8de6-4907-8c63-363688fd6ea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:44.696854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-99491074-8de6-4907-8c63-363688fd6ea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:44.703187 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 839/1693] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:29:44 2022] DELETE /identity/v3/projects/d0a7b62d09074214a8440d66209357af => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:44.705203 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdde66-e836-4d25-bd25-61ab35e5b4bf service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:44.729165 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdde66-e836-4d25-bd25-61ab35e5b4bf service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:44.836055 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d9ec3-cc90-46dd-8a09-0c03d945b6d6 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:44.836422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d9ec3-cc90-46dd-8a09-0c03d945b6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:44.836603 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d9ec3-cc90-46dd-8a09-0c03d945b6d6 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:44.847767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 840/1694] 10.222.0.62 () {54 vars in 912 bytes} [Tue Oct 4 14:29:44 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:29:44.855729 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ee31c-6b90-47cd-8043-081badca5c28 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:44.856012 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ee31c-6b90-47cd-8043-081badca5c28 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:44.856334 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ee31c-6b90-47cd-8043-081badca5c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:44.990035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1406c2-2b1c-4466-b896-c4663f7c2f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:44.990860 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1406c2-2b1c-4466-b896-c4663f7c2f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:44.991244 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1406c2-2b1c-4466-b896-c4663f7c2f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:44.991612 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1406c2-2b1c-4466-b896-c4663f7c2f88 admin admin] PATH_INFO: `/v3/users/6c2cb1a0cd8843ff8217d71aa1d9890c` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:44.993328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1406c2-2b1c-4466-b896-c4663f7c2f88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c2cb1a0cd8843ff8217d71aa1d9890c)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:44.995393 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1406c2-2b1c-4466-b896-c4663f7c2f88 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:45.010091 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-9c1ee31c-6b90-47cd-8043-081badca5c28 None None] MFA Rules not processed for user `624487005e4f4180a9d56a29a7daad1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:45.011358 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-9c1ee31c-6b90-47cd-8043-081badca5c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:45.104434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:45.125965 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6b1406c2-2b1c-4466-b896-c4663f7c2f88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c2cb1a0cd8843ff8217d71aa1d9890c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:45.133066 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6b1406c2-2b1c-4466-b896-c4663f7c2f88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c2cb1a0cd8843ff8217d71aa1d9890c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:45.147835 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6b1406c2-2b1c-4466-b896-c4663f7c2f88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c2cb1a0cd8843ff8217d71aa1d9890c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:45.170378 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 841/1695] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Oct 4 14:29:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:29:45.181290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6b1406c2-2b1c-4466-b896-c4663f7c2f88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c2cb1a0cd8843ff8217d71aa1d9890c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:45.204830 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6b1406c2-2b1c-4466-b896-c4663f7c2f88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c2cb1a0cd8843ff8217d71aa1d9890c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:45.226234 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 855/1696] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:29:44 2022] DELETE /identity/v3/users/6c2cb1a0cd8843ff8217d71aa1d9890c => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:45.276341 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ee31c-6b90-47cd-8043-081badca5c28 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:45.278776 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-9c1ee31c-6b90-47cd-8043-081badca5c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:45.299607 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ee31c-6b90-47cd-8043-081badca5c28 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:45.482602 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d781874-db36-49a9-98c3-b2e3b58957e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:45.484114 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d781874-db36-49a9-98c3-b2e3b58957e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:45.484563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d781874-db36-49a9-98c3-b2e3b58957e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:45.484978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d781874-db36-49a9-98c3-b2e3b58957e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:45.489785 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-2d781874-db36-49a9-98c3-b2e3b58957e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:45.514429 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d781874-db36-49a9-98c3-b2e3b58957e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:45.516645 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d781874-db36-49a9-98c3-b2e3b58957e2 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:45.540683 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 842/1697] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:46.265890 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1406c2-2b1c-4466-b896-c4663f7c2f88 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:46.267765 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6b1406c2-2b1c-4466-b896-c4663f7c2f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:46.361123 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:46.465428 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1406c2-2b1c-4466-b896-c4663f7c2f88 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:46.481842 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddcbd6-9d9b-4089-9a96-cf02e36a1608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:46.482546 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddcbd6-9d9b-4089-9a96-cf02e36a1608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:46.482828 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddcbd6-9d9b-4089-9a96-cf02e36a1608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:46.483102 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddcbd6-9d9b-4089-9a96-cf02e36a1608 admin admin] PATH_INFO: `/v3/projects/2d4debc9ece04e788b75d7f28ee78969` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:46.484793 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddcbd6-9d9b-4089-9a96-cf02e36a1608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d4debc9ece04e788b75d7f28ee78969)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:46.486943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddcbd6-9d9b-4089-9a96-cf02e36a1608 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:46.604066 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-70ddcbd6-9d9b-4089-9a96-cf02e36a1608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d4debc9ece04e788b75d7f28ee78969', 'request_id': 'req-70ddcbd6-9d9b-4089-9a96-cf02e36a1608'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:46.634217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-70ddcbd6-9d9b-4089-9a96-cf02e36a1608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d4debc9ece04e788b75d7f28ee78969', 'request_id': 'req-70ddcbd6-9d9b-4089-9a96-cf02e36a1608'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:46.665755 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-70ddcbd6-9d9b-4089-9a96-cf02e36a1608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d4debc9ece04e788b75d7f28ee78969', 'request_id': 'req-70ddcbd6-9d9b-4089-9a96-cf02e36a1608'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:46.689357 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-70ddcbd6-9d9b-4089-9a96-cf02e36a1608 admin admin] The token cache is being invalidate because project 2d4debc9ece04e788b75d7f28ee78969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:29:46.689648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-70ddcbd6-9d9b-4089-9a96-cf02e36a1608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:46.690330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-70ddcbd6-9d9b-4089-9a96-cf02e36a1608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:46.692413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 856/1698] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:29:46 2022] DELETE /identity/v3/projects/2d4debc9ece04e788b75d7f28ee78969 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:46.703586 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505d14a-a238-4544-8e77-0d44aa613e9a None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:46.704730 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505d14a-a238-4544-8e77-0d44aa613e9a None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:46.705413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505d14a-a238-4544-8e77-0d44aa613e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:46.756952 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-4505d14a-a238-4544-8e77-0d44aa613e9a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:46.762784 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-4505d14a-a238-4544-8e77-0d44aa613e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:46.997682 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 843/1699] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:46.999392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ae782-ff53-4a6f-b507-083dde2bd2d6 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:46.999677 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ae782-ff53-4a6f-b507-083dde2bd2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:46.999979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ae782-ff53-4a6f-b507-083dde2bd2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:47.047162 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-162ae782-ff53-4a6f-b507-083dde2bd2d6 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:47.052197 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-162ae782-ff53-4a6f-b507-083dde2bd2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:47.076281 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 857/1700] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:47.077517 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505d14a-a238-4544-8e77-0d44aa613e9a None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:47.091239 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505d14a-a238-4544-8e77-0d44aa613e9a None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:47.110170 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f210e-ea1e-42fa-9ebc-3a1da4e4786e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:47.110822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f210e-ea1e-42fa-9ebc-3a1da4e4786e admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:47.111259 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f210e-ea1e-42fa-9ebc-3a1da4e4786e admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:47.111547 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f210e-ea1e-42fa-9ebc-3a1da4e4786e admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:47.112426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f210e-ea1e-42fa-9ebc-3a1da4e4786e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:29:47.112744 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f210e-ea1e-42fa-9ebc-3a1da4e4786e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:47.114408 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f210e-ea1e-42fa-9ebc-3a1da4e4786e admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:47.156944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 844/1701] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:29:47.164864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ae782-ff53-4a6f-b507-083dde2bd2d6 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:47.187043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ae782-ff53-4a6f-b507-083dde2bd2d6 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:47.189652 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f210e-ea1e-42fa-9ebc-3a1da4e4786e admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:47.192024 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e10f210e-ea1e-42fa-9ebc-3a1da4e4786e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:47.204471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48ee01-86ba-4b87-a22e-93f4f982317b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:47.205118 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48ee01-86ba-4b87-a22e-93f4f982317b admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:47.205398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48ee01-86ba-4b87-a22e-93f4f982317b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:47.205659 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48ee01-86ba-4b87-a22e-93f4f982317b admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:47.206313 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48ee01-86ba-4b87-a22e-93f4f982317b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:47.208401 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48ee01-86ba-4b87-a22e-93f4f982317b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:47.304628 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 858/1702] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:29:47 2022] POST /identity/v3/projects => generated 403 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:47.313493 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48ee01-86ba-4b87-a22e-93f4f982317b admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:47.318825 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4f48ee01-86ba-4b87-a22e-93f4f982317b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:47.441518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f210e-ea1e-42fa-9ebc-3a1da4e4786e admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:47.473067 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:47.595146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee48a8-6dab-4deb-9a32-da337580e5f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f98c07455a241398784d221df273aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:47.597002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee48a8-6dab-4deb-9a32-da337580e5f7 service placement] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:47.597466 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee48a8-6dab-4deb-9a32-da337580e5f7 service placement] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:47.597945 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee48a8-6dab-4deb-9a32-da337580e5f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:47.602731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-3aee48a8-6dab-4deb-9a32-da337580e5f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:47.621582 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee48a8-6dab-4deb-9a32-da337580e5f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:47.623811 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee48a8-6dab-4deb-9a32-da337580e5f7 service placement] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:47.627154 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48ee01-86ba-4b87-a22e-93f4f982317b admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:47.639979 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 845/1703] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:47.641138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee48a8-6dab-4deb-9a32-da337580e5f7 service placement] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:47.643029 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-3aee48a8-6dab-4deb-9a32-da337580e5f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:47.680969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee48a8-6dab-4deb-9a32-da337580e5f7 service placement] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:47.681891 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bbe03-abbe-4e3f-ab37-1291a1fe7a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:47.682576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bbe03-abbe-4e3f-ab37-1291a1fe7a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:47.682863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bbe03-abbe-4e3f-ab37-1291a1fe7a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:47.683123 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bbe03-abbe-4e3f-ab37-1291a1fe7a46 admin admin] PATH_INFO: `/v3/projects/b0cff5bbc75647c29268ce48757bf0c1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:47.684674 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bbe03-abbe-4e3f-ab37-1291a1fe7a46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0cff5bbc75647c29268ce48757bf0c1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:47.686806 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bbe03-abbe-4e3f-ab37-1291a1fe7a46 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:47.702045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4dac6-6d35-4c21-bbc5-3f254f65872b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:47.707787 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4dac6-6d35-4c21-bbc5-3f254f65872b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:47.708418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4dac6-6d35-4c21-bbc5-3f254f65872b admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:47.708418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4dac6-6d35-4c21-bbc5-3f254f65872b admin admin] PATH_INFO: `/v3/projects/74b102eccada4cdc9e63421e0e0bac9b` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:47.720517 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4dac6-6d35-4c21-bbc5-3f254f65872b admin admin] RBAC: Authorizing `identity:delete_project(project_id=74b102eccada4cdc9e63421e0e0bac9b)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:47.734666 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4dac6-6d35-4c21-bbc5-3f254f65872b admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:47.815301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:47.901320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0a4bbe03-abbe-4e3f-ab37-1291a1fe7a46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0cff5bbc75647c29268ce48757bf0c1', 'request_id': 'req-0a4bbe03-abbe-4e3f-ab37-1291a1fe7a46'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:47.942525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0a4bbe03-abbe-4e3f-ab37-1291a1fe7a46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0cff5bbc75647c29268ce48757bf0c1', 'request_id': 'req-0a4bbe03-abbe-4e3f-ab37-1291a1fe7a46'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:47.953576 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-35d4dac6-6d35-4c21-bbc5-3f254f65872b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74b102eccada4cdc9e63421e0e0bac9b', 'request_id': 'req-35d4dac6-6d35-4c21-bbc5-3f254f65872b'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:47.973352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-35d4dac6-6d35-4c21-bbc5-3f254f65872b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74b102eccada4cdc9e63421e0e0bac9b', 'request_id': 'req-35d4dac6-6d35-4c21-bbc5-3f254f65872b'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:47.990243 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-35d4dac6-6d35-4c21-bbc5-3f254f65872b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74b102eccada4cdc9e63421e0e0bac9b', 'request_id': 'req-35d4dac6-6d35-4c21-bbc5-3f254f65872b'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:48.001109 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0a4bbe03-abbe-4e3f-ab37-1291a1fe7a46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0cff5bbc75647c29268ce48757bf0c1', 'request_id': 'req-0a4bbe03-abbe-4e3f-ab37-1291a1fe7a46'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:48.020027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-35d4dac6-6d35-4c21-bbc5-3f254f65872b admin admin] The token cache is being invalidate because project 74b102eccada4cdc9e63421e0e0bac9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:29:48.020327 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-35d4dac6-6d35-4c21-bbc5-3f254f65872b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:48.021140 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-35d4dac6-6d35-4c21-bbc5-3f254f65872b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:48.023747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 846/1704] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:29:47 2022] DELETE /identity/v3/projects/74b102eccada4cdc9e63421e0e0bac9b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:48.030295 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4dac6-6d35-4c21-bbc5-3f254f65872b admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:48.032242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-35d4dac6-6d35-4c21-bbc5-3f254f65872b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:48.086953 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0a4bbe03-abbe-4e3f-ab37-1291a1fe7a46 admin admin] The token cache is being invalidate because project b0cff5bbc75647c29268ce48757bf0c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:29:48.087406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0a4bbe03-abbe-4e3f-ab37-1291a1fe7a46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:48.090018 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0a4bbe03-abbe-4e3f-ab37-1291a1fe7a46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:48.098247 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 859/1705] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:29:47 2022] DELETE /identity/v3/projects/b0cff5bbc75647c29268ce48757bf0c1 => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:48.106866 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bbe03-abbe-4e3f-ab37-1291a1fe7a46 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:48.117821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0a4bbe03-abbe-4e3f-ab37-1291a1fe7a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:48.157229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4dac6-6d35-4c21-bbc5-3f254f65872b admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:48.162481 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540bf07-67a5-4052-9253-b00bb87716b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:48.163697 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540bf07-67a5-4052-9253-b00bb87716b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:48.163697 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540bf07-67a5-4052-9253-b00bb87716b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:48.163933 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540bf07-67a5-4052-9253-b00bb87716b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:48.165227 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540bf07-67a5-4052-9253-b00bb87716b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:48.167538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540bf07-67a5-4052-9253-b00bb87716b4 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:48.196114 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 847/1706] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:29:48 2022] POST /identity/v3/users => generated 302 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:48.198472 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d396e5b-7423-4a0d-9a99-ac5fcaccb2e9 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:48.199147 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d396e5b-7423-4a0d-9a99-ac5fcaccb2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:48.199598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d396e5b-7423-4a0d-9a99-ac5fcaccb2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:48.225023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-7d396e5b-7423-4a0d-9a99-ac5fcaccb2e9 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:48.226720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-7d396e5b-7423-4a0d-9a99-ac5fcaccb2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:48.241013 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 848/1707] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:48.249828 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d396e5b-7423-4a0d-9a99-ac5fcaccb2e9 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:48.252529 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-7d396e5b-7423-4a0d-9a99-ac5fcaccb2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:48.269666 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d396e5b-7423-4a0d-9a99-ac5fcaccb2e9 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:48.286126 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ccce9-61ca-4314-a33c-b52bcd6838ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:48.289032 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ccce9-61ca-4314-a33c-b52bcd6838ff admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:48.289375 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ccce9-61ca-4314-a33c-b52bcd6838ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:48.289655 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ccce9-61ca-4314-a33c-b52bcd6838ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:48.293612 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ccce9-61ca-4314-a33c-b52bcd6838ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:48.295829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ccce9-61ca-4314-a33c-b52bcd6838ff admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:48.310395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bbe03-abbe-4e3f-ab37-1291a1fe7a46 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:48.318472 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b50b7-0656-4722-9849-91e405ade753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:48.319160 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b50b7-0656-4722-9849-91e405ade753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:48.319439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b50b7-0656-4722-9849-91e405ade753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:48.322220 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b50b7-0656-4722-9849-91e405ade753 admin admin] PATH_INFO: `/v3/users/8eacf8b6db1c42908a92a58c5a02f54e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:48.325586 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b50b7-0656-4722-9849-91e405ade753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eacf8b6db1c42908a92a58c5a02f54e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:48.327072 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 849/1708] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:48.331635 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087f175-bdd1-431c-b6eb-185993092546 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:48.332035 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087f175-bdd1-431c-b6eb-185993092546 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:48.332311 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087f175-bdd1-431c-b6eb-185993092546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:48.333792 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b50b7-0656-4722-9849-91e405ade753 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:48.356312 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:48.386360 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-e087f175-bdd1-431c-b6eb-185993092546 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:48.387166 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e087f175-bdd1-431c-b6eb-185993092546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:48.421559 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 850/1709] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:48.425866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087f175-bdd1-431c-b6eb-185993092546 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:48.450805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8a0b50b7-0656-4722-9849-91e405ade753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eacf8b6db1c42908a92a58c5a02f54e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:48.456042 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8a0b50b7-0656-4722-9849-91e405ade753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eacf8b6db1c42908a92a58c5a02f54e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:48.464204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087f175-bdd1-431c-b6eb-185993092546 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:48.478914 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49c53c-b2bc-47c3-b16c-f8a0ecc57376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:48.479539 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49c53c-b2bc-47c3-b16c-f8a0ecc57376 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:48.479885 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49c53c-b2bc-47c3-b16c-f8a0ecc57376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:48.480265 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49c53c-b2bc-47c3-b16c-f8a0ecc57376 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:48.481019 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49c53c-b2bc-47c3-b16c-f8a0ecc57376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:48.483336 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49c53c-b2bc-47c3-b16c-f8a0ecc57376 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:48.485236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8a0b50b7-0656-4722-9849-91e405ade753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eacf8b6db1c42908a92a58c5a02f54e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:48.506338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8a0b50b7-0656-4722-9849-91e405ade753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eacf8b6db1c42908a92a58c5a02f54e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:48.523059 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8a0b50b7-0656-4722-9849-91e405ade753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eacf8b6db1c42908a92a58c5a02f54e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:48.530274 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 851/1710] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:48.530933 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49c53c-b2bc-47c3-b16c-f8a0ecc57376 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:48.538854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-7a49c53c-b2bc-47c3-b16c-f8a0ecc57376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:48.542580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 860/1711] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:29:48 2022] DELETE /identity/v3/users/8eacf8b6db1c42908a92a58c5a02f54e => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:48.546206 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b50b7-0656-4722-9849-91e405ade753 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:48.550663 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8a0b50b7-0656-4722-9849-91e405ade753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:48.579823 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49c53c-b2bc-47c3-b16c-f8a0ecc57376 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:48.687476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:48.736494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c82c5a-03ae-4e13-9850-68f8364a047f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:48.737410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c82c5a-03ae-4e13-9850-68f8364a047f admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:48.737410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c82c5a-03ae-4e13-9850-68f8364a047f admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:48.737704 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c82c5a-03ae-4e13-9850-68f8364a047f admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:48.738505 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c82c5a-03ae-4e13-9850-68f8364a047f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:29:48.738715 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c82c5a-03ae-4e13-9850-68f8364a047f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:48.740417 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c82c5a-03ae-4e13-9850-68f8364a047f admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:48.751620 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b50b7-0656-4722-9849-91e405ade753 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:48.776149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba0cbe-d660-47a9-9d9c-26e1f1ab8e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:48.776615 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba0cbe-d660-47a9-9d9c-26e1f1ab8e70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:48.776909 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba0cbe-d660-47a9-9d9c-26e1f1ab8e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:48.777160 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba0cbe-d660-47a9-9d9c-26e1f1ab8e70 admin admin] PATH_INFO: `/v3/projects/48d68300909a462cb5d41e49393c0259/users/1f3046fb115345c582e2420bdaf1c549/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:48.787885 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 852/1712] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:29:48.790399 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c82c5a-03ae-4e13-9850-68f8364a047f admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:48.818326 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c82c5a-03ae-4e13-9850-68f8364a047f admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:48.825122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba0cbe-d660-47a9-9d9c-26e1f1ab8e70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48d68300909a462cb5d41e49393c0259, user_id=1f3046fb115345c582e2420bdaf1c549, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:48.849004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba0cbe-d660-47a9-9d9c-26e1f1ab8e70 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:48.855507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99be539-3e4d-4b61-8ff1-a0064bc9cd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:48.858559 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99be539-3e4d-4b61-8ff1-a0064bc9cd74 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:48.859353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99be539-3e4d-4b61-8ff1-a0064bc9cd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:48.860691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99be539-3e4d-4b61-8ff1-a0064bc9cd74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:48.862692 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99be539-3e4d-4b61-8ff1-a0064bc9cd74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:48.872872 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99be539-3e4d-4b61-8ff1-a0064bc9cd74 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:48.913941 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 861/1713] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:29:48 2022] PUT /identity/v3/projects/48d68300909a462cb5d41e49393c0259/users/1f3046fb115345c582e2420bdaf1c549/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:48.932411 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f43ae-ccf9-4cc2-b7b2-5e2d9dc75c50 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:48.932411 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f43ae-ccf9-4cc2-b7b2-5e2d9dc75c50 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:48.932411 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f43ae-ccf9-4cc2-b7b2-5e2d9dc75c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:49.010921 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 853/1714] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:29:48 2022] POST /identity/v3/projects => generated 369 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:29:49.013078 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-488f43ae-ccf9-4cc2-b7b2-5e2d9dc75c50 None None] MFA Rules not processed for user `1f3046fb115345c582e2420bdaf1c549`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:49.014342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-488f43ae-ccf9-4cc2-b7b2-5e2d9dc75c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:49.015749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99be539-3e4d-4b61-8ff1-a0064bc9cd74 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:49.213389 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 862/1715] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:48 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:49.218365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f43ae-ccf9-4cc2-b7b2-5e2d9dc75c50 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:49.271640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99be539-3e4d-4b61-8ff1-a0064bc9cd74 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:49.289961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c09d88-72af-4ec4-9602-54af9dcba6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:49.292051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c09d88-72af-4ec4-9602-54af9dcba6dd admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:49.292691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c09d88-72af-4ec4-9602-54af9dcba6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:49.293280 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c09d88-72af-4ec4-9602-54af9dcba6dd admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:49.321833 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c09d88-72af-4ec4-9602-54af9dcba6dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:49.336285 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c09d88-72af-4ec4-9602-54af9dcba6dd admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:49.411920 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 854/1716] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:29:49 2022] POST /identity/v3/users => generated 285 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:49.416273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c09d88-72af-4ec4-9602-54af9dcba6dd admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:49.421528 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f43ae-ccf9-4cc2-b7b2-5e2d9dc75c50 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:49.441766 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e80ec1-10fe-4397-a9b0-dc1bf50a1d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:49.442573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e80ec1-10fe-4397-a9b0-dc1bf50a1d86 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:49.442954 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e80ec1-10fe-4397-a9b0-dc1bf50a1d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:49.443343 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e80ec1-10fe-4397-a9b0-dc1bf50a1d86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:49.444125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e80ec1-10fe-4397-a9b0-dc1bf50a1d86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:49.448263 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e80ec1-10fe-4397-a9b0-dc1bf50a1d86 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:49.472057 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c09d88-72af-4ec4-9602-54af9dcba6dd admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:49.484548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef8459-0c78-4e69-b6f9-a5e7fabfbab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:49.485193 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef8459-0c78-4e69-b6f9-a5e7fabfbab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:49.485473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef8459-0c78-4e69-b6f9-a5e7fabfbab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:49.485744 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef8459-0c78-4e69-b6f9-a5e7fabfbab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:49.486416 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef8459-0c78-4e69-b6f9-a5e7fabfbab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:49.514307 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef8459-0c78-4e69-b6f9-a5e7fabfbab9 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:49.548740 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 863/1717] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:29:49 2022] POST /identity/v3/projects => generated 405 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:49.549967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e80ec1-10fe-4397-a9b0-dc1bf50a1d86 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:49.565849 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 855/1718] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:49.568755 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef8459-0c78-4e69-b6f9-a5e7fabfbab9 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:49.637369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef8459-0c78-4e69-b6f9-a5e7fabfbab9 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:49.725518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:49.756548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:49.808615 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dfc09-5893-4a05-a6a6-683171c08faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:49.810756 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dfc09-5893-4a05-a6a6-683171c08faa admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:49.811277 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dfc09-5893-4a05-a6a6-683171c08faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:49.811795 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dfc09-5893-4a05-a6a6-683171c08faa admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:49.812670 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469dfc09-5893-4a05-a6a6-683171c08faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:49.814751 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469dfc09-5893-4a05-a6a6-683171c08faa admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:49.818105 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e80ec1-10fe-4397-a9b0-dc1bf50a1d86 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:49.829313 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706d552-06b9-4f8c-b277-43ba29caf919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:49.831836 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706d552-06b9-4f8c-b277-43ba29caf919 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:49.831938 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706d552-06b9-4f8c-b277-43ba29caf919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:49.832246 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706d552-06b9-4f8c-b277-43ba29caf919 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:49.832876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706d552-06b9-4f8c-b277-43ba29caf919 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:49.839332 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706d552-06b9-4f8c-b277-43ba29caf919 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:49.874034 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 856/1719] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:29:49.876077 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dfc09-5893-4a05-a6a6-683171c08faa admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:49.908897 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dfc09-5893-4a05-a6a6-683171c08faa admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:49.933230 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb2cba-9020-4cb1-b21e-e7c8c3184e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:49.934708 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb2cba-9020-4cb1-b21e-e7c8c3184e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:49.935179 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb2cba-9020-4cb1-b21e-e7c8c3184e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:49.935975 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb2cba-9020-4cb1-b21e-e7c8c3184e4c admin admin] PATH_INFO: `/v3/projects/aeaf0ab777f14a6ead5a3f6444e40437/users/14cfc8c9ec1e4f4094c978311462a7ef/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:49.942495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 864/1720] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:29:49 2022] POST /identity/v3/users => generated 309 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:49.961867 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706d552-06b9-4f8c-b277-43ba29caf919 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:49.993463 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb2cba-9020-4cb1-b21e-e7c8c3184e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeaf0ab777f14a6ead5a3f6444e40437, user_id=14cfc8c9ec1e4f4094c978311462a7ef, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:49.997673 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb2cba-9020-4cb1-b21e-e7c8c3184e4c admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:50.009642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706d552-06b9-4f8c-b277-43ba29caf919 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:50.025137 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55333fac-f5db-424a-984a-562a9e6e6fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:50.025991 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55333fac-f5db-424a-984a-562a9e6e6fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:50.027405 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55333fac-f5db-424a-984a-562a9e6e6fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:50.028697 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55333fac-f5db-424a-984a-562a9e6e6fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:50.031677 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55333fac-f5db-424a-984a-562a9e6e6fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:50.035167 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55333fac-f5db-424a-984a-562a9e6e6fc1 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:50.061435 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 857/1721] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:29:49 2022] PUT /identity/v3/projects/aeaf0ab777f14a6ead5a3f6444e40437/users/14cfc8c9ec1e4f4094c978311462a7ef/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:50.081510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb041a-feb7-4f9d-9812-6593b7e2e596 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:50.081796 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb041a-feb7-4f9d-9812-6593b7e2e596 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:50.082113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb041a-feb7-4f9d-9812-6593b7e2e596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:50.136385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 865/1722] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:50.138959 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-58fb041a-feb7-4f9d-9812-6593b7e2e596 None None] MFA Rules not processed for user `14cfc8c9ec1e4f4094c978311462a7ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:50.140323 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-58fb041a-feb7-4f9d-9812-6593b7e2e596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:50.140431 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55333fac-f5db-424a-984a-562a9e6e6fc1 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:50.219787 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55333fac-f5db-424a-984a-562a9e6e6fc1 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:50.354139 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 858/1723] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:50.359884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb041a-feb7-4f9d-9812-6593b7e2e596 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:50.410380 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c29414-94a1-4a7f-950c-f415daf97215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:50.411287 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c29414-94a1-4a7f-950c-f415daf97215 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:50.411893 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c29414-94a1-4a7f-950c-f415daf97215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:50.412325 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c29414-94a1-4a7f-950c-f415daf97215 admin admin] PATH_INFO: `/v3/projects/c6c307ece34041e2b0a3e752aecb3e98/users/1703e504ceac4b4aa8156f2c45602f6a/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:50.466438 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c29414-94a1-4a7f-950c-f415daf97215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c307ece34041e2b0a3e752aecb3e98, user_id=1703e504ceac4b4aa8156f2c45602f6a, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:50.470328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c29414-94a1-4a7f-950c-f415daf97215 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:50.503274 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 866/1724] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:29:50 2022] PUT /identity/v3/projects/c6c307ece34041e2b0a3e752aecb3e98/users/1703e504ceac4b4aa8156f2c45602f6a/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:29:50.504558 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c29414-94a1-4a7f-950c-f415daf97215 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:50.561111 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb041a-feb7-4f9d-9812-6593b7e2e596 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:50.652444 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:50.693854 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c29414-94a1-4a7f-950c-f415daf97215 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:50.694797 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5626f6-8956-4bee-96dd-c43ae8ae4838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:50.696027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5626f6-8956-4bee-96dd-c43ae8ae4838 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:50.696154 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5626f6-8956-4bee-96dd-c43ae8ae4838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:50.696460 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5626f6-8956-4bee-96dd-c43ae8ae4838 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:50.697348 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5626f6-8956-4bee-96dd-c43ae8ae4838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:50.700024 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5626f6-8956-4bee-96dd-c43ae8ae4838 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:50.706980 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a193327-e121-4f63-b2d4-1931688185d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:50.708000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a193327-e121-4f63-b2d4-1931688185d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:50.708419 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a193327-e121-4f63-b2d4-1931688185d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:50.709538 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a193327-e121-4f63-b2d4-1931688185d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:50.710370 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a193327-e121-4f63-b2d4-1931688185d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:50.715080 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a193327-e121-4f63-b2d4-1931688185d4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:50.739980 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 867/1725] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:29:50.741410 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5eac1-61e0-42a4-9d6e-7d604153a628 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:50.741713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5eac1-61e0-42a4-9d6e-7d604153a628 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:50.741966 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5eac1-61e0-42a4-9d6e-7d604153a628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:50.757959 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 859/1726] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:29:50 2022] POST /identity/v3/projects => generated 369 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:29:50.759551 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7fd01-d04e-4209-aac4-55d168f8739c None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:50.759946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7fd01-d04e-4209-aac4-55d168f8739c None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:50.760281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7fd01-d04e-4209-aac4-55d168f8739c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:50.800711 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c3b5eac1-61e0-42a4-9d6e-7d604153a628 None None] MFA Rules not processed for user `61af523e48ec4687918b3f3f19490577`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:50.803295 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c3b5eac1-61e0-42a4-9d6e-7d604153a628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:50.828241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-5de7fd01-d04e-4209-aac4-55d168f8739c None None] MFA Rules not processed for user `62d720a284ad493bb8393289e9e38140`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:50.829693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-5de7fd01-d04e-4209-aac4-55d168f8739c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:50.851960 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:50.975355 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 868/1727] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:50.976287 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5eac1-61e0-42a4-9d6e-7d604153a628 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:51.028813 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 860/1728] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:51.045084 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7fd01-d04e-4209-aac4-55d168f8739c None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:51.200627 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5eac1-61e0-42a4-9d6e-7d604153a628 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:51.216204 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74f8c7-2279-42e2-b664-1f033a4dafdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:51.217755 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74f8c7-2279-42e2-b664-1f033a4dafdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:51.219768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74f8c7-2279-42e2-b664-1f033a4dafdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:51.227687 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74f8c7-2279-42e2-b664-1f033a4dafdc admin admin] PATH_INFO: `/v3/projects/c6c307ece34041e2b0a3e752aecb3e98/users/1703e504ceac4b4aa8156f2c45602f6a/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:51.243009 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74f8c7-2279-42e2-b664-1f033a4dafdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c307ece34041e2b0a3e752aecb3e98, user_id=1703e504ceac4b4aa8156f2c45602f6a, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:51.252105 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74f8c7-2279-42e2-b664-1f033a4dafdc admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:51.288214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7fd01-d04e-4209-aac4-55d168f8739c None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:51.300534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 869/1729] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:29:50 2022] PUT /identity/v3/projects/c6c307ece34041e2b0a3e752aecb3e98/users/1703e504ceac4b4aa8156f2c45602f6a/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:51.302207 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e25c6a-9127-4b93-bd7f-340161eb7d45 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:51.302759 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e25c6a-9127-4b93-bd7f-340161eb7d45 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:51.303158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e25c6a-9127-4b93-bd7f-340161eb7d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:51.341970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c8e25c6a-9127-4b93-bd7f-340161eb7d45 None None] MFA Rules not processed for user `61af523e48ec4687918b3f3f19490577`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:51.343655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c8e25c6a-9127-4b93-bd7f-340161eb7d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:51.489250 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185f3de-3c60-48ac-9370-f6287161714c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:51.490569 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185f3de-3c60-48ac-9370-f6287161714c admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:51.490918 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185f3de-3c60-48ac-9370-f6287161714c admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:51.491262 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185f3de-3c60-48ac-9370-f6287161714c admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:51.492168 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185f3de-3c60-48ac-9370-f6287161714c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:51.494375 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185f3de-3c60-48ac-9370-f6287161714c admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:51.509770 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:51.536191 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 861/1730] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:29:51 2022] POST /identity/v3/users => generated 291 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:51.539089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185f3de-3c60-48ac-9370-f6287161714c admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:51.541298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-9185f3de-3c60-48ac-9370-f6287161714c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:51.548439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 870/1731] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:51.552876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de5a2e-3121-4ba2-b9c9-f25266cd9f1f None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:51.560569 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de5a2e-3121-4ba2-b9c9-f25266cd9f1f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:51.561164 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de5a2e-3121-4ba2-b9c9-f25266cd9f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:51.577669 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185f3de-3c60-48ac-9370-f6287161714c admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:51.594113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953cf73-250c-4fc2-8fb4-a3709dd9d927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:51.595599 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953cf73-250c-4fc2-8fb4-a3709dd9d927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:51.595907 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953cf73-250c-4fc2-8fb4-a3709dd9d927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:51.596183 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953cf73-250c-4fc2-8fb4-a3709dd9d927 admin admin] PATH_INFO: `/v3/projects/e13a3783c04b4a609e1b8563119c95f1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:51.604347 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953cf73-250c-4fc2-8fb4-a3709dd9d927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e13a3783c04b4a609e1b8563119c95f1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:51.608633 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-79de5a2e-3121-4ba2-b9c9-f25266cd9f1f None None] MFA Rules not processed for user `62d720a284ad493bb8393289e9e38140`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:51.611978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-79de5a2e-3121-4ba2-b9c9-f25266cd9f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:51.613160 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953cf73-250c-4fc2-8fb4-a3709dd9d927 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:51.827575 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9953cf73-250c-4fc2-8fb4-a3709dd9d927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e13a3783c04b4a609e1b8563119c95f1', 'request_id': 'req-9953cf73-250c-4fc2-8fb4-a3709dd9d927'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:51.869304 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9953cf73-250c-4fc2-8fb4-a3709dd9d927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e13a3783c04b4a609e1b8563119c95f1', 'request_id': 'req-9953cf73-250c-4fc2-8fb4-a3709dd9d927'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:51.912229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9953cf73-250c-4fc2-8fb4-a3709dd9d927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e13a3783c04b4a609e1b8563119c95f1', 'request_id': 'req-9953cf73-250c-4fc2-8fb4-a3709dd9d927'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:51.938867 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 871/1732] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:51.940489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa1c62-b0bd-4ca4-aa6b-653bf96958fe None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:51.947025 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa1c62-b0bd-4ca4-aa6b-653bf96958fe None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:51.948047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa1c62-b0bd-4ca4-aa6b-653bf96958fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:51.975987 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:51.980994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9953cf73-250c-4fc2-8fb4-a3709dd9d927 admin admin] The token cache is being invalidate because project e13a3783c04b4a609e1b8563119c95f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:29:51.992113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9953cf73-250c-4fc2-8fb4-a3709dd9d927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:51.995100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9953cf73-250c-4fc2-8fb4-a3709dd9d927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:52.019130 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 862/1733] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:29:51 2022] DELETE /identity/v3/projects/e13a3783c04b4a609e1b8563119c95f1 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:52.021281 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-41fa1c62-b0bd-4ca4-aa6b-653bf96958fe None None] MFA Rules not processed for user `1703e504ceac4b4aa8156f2c45602f6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:52.024280 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-41fa1c62-b0bd-4ca4-aa6b-653bf96958fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:52.025536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24006404-2121-4454-9573-1b3d0df68623 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:52.025935 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24006404-2121-4454-9573-1b3d0df68623 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:52.026313 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24006404-2121-4454-9573-1b3d0df68623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:52.135058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-24006404-2121-4454-9573-1b3d0df68623 None None] MFA Rules not processed for user `7eaef5f6ca21428a9c87bb7dffc2017d`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:52.141613 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-24006404-2121-4454-9573-1b3d0df68623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:52.244198 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 872/1734] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:51 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:52.248819 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa1c62-b0bd-4ca4-aa6b-653bf96958fe None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:52.252679 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-41fa1c62-b0bd-4ca4-aa6b-653bf96958fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:52.360013 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 863/1735] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:52.366102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24006404-2121-4454-9573-1b3d0df68623 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:52.366102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-24006404-2121-4454-9573-1b3d0df68623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:52.471981 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa1c62-b0bd-4ca4-aa6b-653bf96958fe None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:52.478809 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bb694-ff8e-4faa-a987-94b943b3fcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:52.479443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bb694-ff8e-4faa-a987-94b943b3fcac admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:52.479849 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bb694-ff8e-4faa-a987-94b943b3fcac admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:52.480151 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bb694-ff8e-4faa-a987-94b943b3fcac admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:52.514011 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bb694-ff8e-4faa-a987-94b943b3fcac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:52.522132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bb694-ff8e-4faa-a987-94b943b3fcac admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:52.554158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 873/1736] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:52.569484 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0178e9f-9fd5-46a7-9a8b-eb69c6f58f62 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:52.569775 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0178e9f-9fd5-46a7-9a8b-eb69c6f58f62 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:52.570203 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0178e9f-9fd5-46a7-9a8b-eb69c6f58f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:52.579512 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24006404-2121-4454-9573-1b3d0df68623 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:52.594301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315b041-0bf2-4646-bc3b-86fb22778812 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:52.594956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315b041-0bf2-4646-bc3b-86fb22778812 service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:52.595239 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315b041-0bf2-4646-bc3b-86fb22778812 service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:52.595512 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315b041-0bf2-4646-bc3b-86fb22778812 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:52.597625 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-5315b041-0bf2-4646-bc3b-86fb22778812 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:52.605411 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:52.631225 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e0178e9f-9fd5-46a7-9a8b-eb69c6f58f62 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:52.633009 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e0178e9f-9fd5-46a7-9a8b-eb69c6f58f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:52.654469 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 874/1737] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:52.655969 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0178e9f-9fd5-46a7-9a8b-eb69c6f58f62 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:52.660818 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e0178e9f-9fd5-46a7-9a8b-eb69c6f58f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:52.698614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0178e9f-9fd5-46a7-9a8b-eb69c6f58f62 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:52.719348 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a032be-849e-4f97-b0c9-0c545ee495fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:52.719910 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a032be-849e-4f97-b0c9-0c545ee495fd service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:52.721674 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a032be-849e-4f97-b0c9-0c545ee495fd service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:52.721674 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a032be-849e-4f97-b0c9-0c545ee495fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:52.726186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-13a032be-849e-4f97-b0c9-0c545ee495fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:52.754436 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315b041-0bf2-4646-bc3b-86fb22778812 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:52.756535 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315b041-0bf2-4646-bc3b-86fb22778812 service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:52.780862 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 864/1738] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:52.782080 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315b041-0bf2-4646-bc3b-86fb22778812 service nova] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:52.784477 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-5315b041-0bf2-4646-bc3b-86fb22778812 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:52.942435 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315b041-0bf2-4646-bc3b-86fb22778812 service nova] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:52.953488 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f94bb7-4e4b-43e0-b08b-f9508b47ffad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:52.954477 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f94bb7-4e4b-43e0-b08b-f9508b47ffad service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:52.954929 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f94bb7-4e4b-43e0-b08b-f9508b47ffad service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:52.955392 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f94bb7-4e4b-43e0-b08b-f9508b47ffad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:52.971563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f94bb7-4e4b-43e0-b08b-f9508b47ffad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:52.974162 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f94bb7-4e4b-43e0-b08b-f9508b47ffad service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:52.980489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a032be-849e-4f97-b0c9-0c545ee495fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:52.985671 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a032be-849e-4f97-b0c9-0c545ee495fd service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:52.994141 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 865/1739] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:52 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:52.995804 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f94bb7-4e4b-43e0-b08b-f9508b47ffad service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:53.019191 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f94bb7-4e4b-43e0-b08b-f9508b47ffad service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:53.036050 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 875/1740] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:53.045590 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6dfcb-2966-4fc3-9b80-ee4dc4fc67fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:53.048384 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980a069-243e-4bb8-afb9-b048303d42c6 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:53.048818 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980a069-243e-4bb8-afb9-b048303d42c6 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:53.049183 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980a069-243e-4bb8-afb9-b048303d42c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:53.049894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6dfcb-2966-4fc3-9b80-ee4dc4fc67fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:53.053559 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6dfcb-2966-4fc3-9b80-ee4dc4fc67fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:53.053886 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6dfcb-2966-4fc3-9b80-ee4dc4fc67fd admin admin] PATH_INFO: `/v3/projects/4366e5d556384d68b82b5a4cc90d8981/users/70565f5c37f5492a978c41f325847dee/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:53.107750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6dfcb-2966-4fc3-9b80-ee4dc4fc67fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4366e5d556384d68b82b5a4cc90d8981, user_id=70565f5c37f5492a978c41f325847dee, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:53.134818 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6dfcb-2966-4fc3-9b80-ee4dc4fc67fd admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:53.179173 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:53.183087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 866/1741] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:29:52 2022] PUT /identity/v3/projects/4366e5d556384d68b82b5a4cc90d8981/users/70565f5c37f5492a978c41f325847dee/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:53.185929 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a458b35-56b1-4290-b075-3e20b1e1fab9 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:53.186390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a458b35-56b1-4290-b075-3e20b1e1fab9 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:53.191525 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a458b35-56b1-4290-b075-3e20b1e1fab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:53.256887 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c980a069-243e-4bb8-afb9-b048303d42c6 None None] MFA Rules not processed for user `c5dc12a8bc2b406b8a148bf609d5d2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:53.258142 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c980a069-243e-4bb8-afb9-b048303d42c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:53.282287 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-9a458b35-56b1-4290-b075-3e20b1e1fab9 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:53.284399 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-9a458b35-56b1-4290-b075-3e20b1e1fab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:53.460326 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 876/1742] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Oct 4 14:29:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:53.473189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980a069-243e-4bb8-afb9-b048303d42c6 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:53.514005 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 867/1743] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:53.519269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a458b35-56b1-4290-b075-3e20b1e1fab9 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:53.533677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-9a458b35-56b1-4290-b075-3e20b1e1fab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:53.580968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a458b35-56b1-4290-b075-3e20b1e1fab9 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:53.596236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ceb085-89e5-47cb-a184-7d46974102a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:53.597222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ceb085-89e5-47cb-a184-7d46974102a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:53.597510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ceb085-89e5-47cb-a184-7d46974102a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:53.597779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ceb085-89e5-47cb-a184-7d46974102a7 admin admin] PATH_INFO: `/v3/users/1f3046fb115345c582e2420bdaf1c549` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:53.604649 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ceb085-89e5-47cb-a184-7d46974102a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f3046fb115345c582e2420bdaf1c549)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:53.607924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ceb085-89e5-47cb-a184-7d46974102a7 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:53.685963 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:53.749450 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-20ceb085-89e5-47cb-a184-7d46974102a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f3046fb115345c582e2420bdaf1c549'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:53.750715 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-20ceb085-89e5-47cb-a184-7d46974102a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f3046fb115345c582e2420bdaf1c549'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:53.783757 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-20ceb085-89e5-47cb-a184-7d46974102a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f3046fb115345c582e2420bdaf1c549'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:53.800990 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-20ceb085-89e5-47cb-a184-7d46974102a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f3046fb115345c582e2420bdaf1c549'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:53.820357 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980a069-243e-4bb8-afb9-b048303d42c6 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:53.826135 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-20ceb085-89e5-47cb-a184-7d46974102a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f3046fb115345c582e2420bdaf1c549'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:53.830010 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7a623-b24c-47aa-8ea2-7f18103a1cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:53.830010 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7a623-b24c-47aa-8ea2-7f18103a1cff admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:53.830254 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7a623-b24c-47aa-8ea2-7f18103a1cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:53.830323 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7a623-b24c-47aa-8ea2-7f18103a1cff admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:53.831092 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f7a623-b24c-47aa-8ea2-7f18103a1cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:53.858200 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f7a623-b24c-47aa-8ea2-7f18103a1cff admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:53.867222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 877/1744] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:53.868508 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7a623-b24c-47aa-8ea2-7f18103a1cff admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:53.870589 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 868/1745] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:29:53 2022] DELETE /identity/v3/users/1f3046fb115345c582e2420bdaf1c549 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:53.878847 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ceb085-89e5-47cb-a184-7d46974102a7 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:53.883288 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e2f7a623-b24c-47aa-8ea2-7f18103a1cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:53.891939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-20ceb085-89e5-47cb-a184-7d46974102a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:53.914146 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7a623-b24c-47aa-8ea2-7f18103a1cff admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:54.055473 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6650a-2ce5-4b52-ad5d-80ac6f56b99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:54.056118 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6650a-2ce5-4b52-ad5d-80ac6f56b99c admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:54.056486 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6650a-2ce5-4b52-ad5d-80ac6f56b99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:54.056762 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6650a-2ce5-4b52-ad5d-80ac6f56b99c admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:54.057437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6650a-2ce5-4b52-ad5d-80ac6f56b99c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:29:54.057744 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6650a-2ce5-4b52-ad5d-80ac6f56b99c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:54.068167 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6650a-2ce5-4b52-ad5d-80ac6f56b99c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:54.097551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 878/1746] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:29:54.098830 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6650a-2ce5-4b52-ad5d-80ac6f56b99c admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:54.106458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-75c6650a-2ce5-4b52-ad5d-80ac6f56b99c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:54.139986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6650a-2ce5-4b52-ad5d-80ac6f56b99c admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:54.154465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177cdec-a767-43cc-bad6-0e2ebf833398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:54.155177 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177cdec-a767-43cc-bad6-0e2ebf833398 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:54.155462 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177cdec-a767-43cc-bad6-0e2ebf833398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:54.155789 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177cdec-a767-43cc-bad6-0e2ebf833398 admin admin] PATH_INFO: `/v3/projects/4366e5d556384d68b82b5a4cc90d8981/users/70565f5c37f5492a978c41f325847dee/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:54.157935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177cdec-a767-43cc-bad6-0e2ebf833398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4366e5d556384d68b82b5a4cc90d8981, user_id=70565f5c37f5492a978c41f325847dee, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:54.160768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177cdec-a767-43cc-bad6-0e2ebf833398 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:54.173006 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ceb085-89e5-47cb-a184-7d46974102a7 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:54.188023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc526534-9fd4-4dc6-8d8c-f5e740ff0923 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4860d5958e724e568576a9067290a27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:54.188854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc526534-9fd4-4dc6-8d8c-f5e740ff0923 service swift] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:54.188975 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc526534-9fd4-4dc6-8d8c-f5e740ff0923 service swift] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:54.189199 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc526534-9fd4-4dc6-8d8c-f5e740ff0923 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:54.196807 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-fc526534-9fd4-4dc6-8d8c-f5e740ff0923 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:54.197058 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 879/1747] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:29:54 2022] PUT /identity/v3/projects/4366e5d556384d68b82b5a4cc90d8981/users/70565f5c37f5492a978c41f325847dee/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:54.198693 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c2f76-bc73-4d3e-8f39-8a24e0f0f034 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:54.206962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c2f76-bc73-4d3e-8f39-8a24e0f0f034 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:54.207242 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c2f76-bc73-4d3e-8f39-8a24e0f0f034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:54.256701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-af7c2f76-bc73-4d3e-8f39-8a24e0f0f034 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:54.258211 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-af7c2f76-bc73-4d3e-8f39-8a24e0f0f034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:54.276867 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:54.309584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc526534-9fd4-4dc6-8d8c-f5e740ff0923 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:54.312218 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc526534-9fd4-4dc6-8d8c-f5e740ff0923 service swift] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:54.336699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 869/1748] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Oct 4 14:29:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 14:29:54.337524 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc526534-9fd4-4dc6-8d8c-f5e740ff0923 service swift] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:54.359509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc526534-9fd4-4dc6-8d8c-f5e740ff0923 service swift] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:54.416457 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 880/1749] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:54.418225 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3db85a-3996-4523-b61b-0d057f680acb None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:54.419196 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3db85a-3996-4523-b61b-0d057f680acb None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:54.423924 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3db85a-3996-4523-b61b-0d057f680acb None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:54.429205 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6380b3e-c178-4ae2-beec-662b1e73130a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:54.430777 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 881/1750] 10.222.0.62 () {54 vars in 912 bytes} [Tue Oct 4 14:29:54 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:29:54.432336 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da282e98-454e-495a-b94a-575653dd1934 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:54.434555 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da282e98-454e-495a-b94a-575653dd1934 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:54.435021 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da282e98-454e-495a-b94a-575653dd1934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:54.435639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6380b3e-c178-4ae2-beec-662b1e73130a admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:54.436941 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6380b3e-c178-4ae2-beec-662b1e73130a admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:54.437963 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6380b3e-c178-4ae2-beec-662b1e73130a admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:54.438125 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6380b3e-c178-4ae2-beec-662b1e73130a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:54.444227 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6380b3e-c178-4ae2-beec-662b1e73130a admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:54.543353 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-da282e98-454e-495a-b94a-575653dd1934 None None] MFA Rules not processed for user `70565f5c37f5492a978c41f325847dee`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:54.545164 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-da282e98-454e-495a-b94a-575653dd1934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:54.609657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:54.700728 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 870/1751] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:29:54 2022] POST /identity/v3/projects => generated 377 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:54.707905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92646f-9a59-477c-b493-0c9dc7670c97 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:54.708316 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92646f-9a59-477c-b493-0c9dc7670c97 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:54.711020 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92646f-9a59-477c-b493-0c9dc7670c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:54.787258 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-cb92646f-9a59-477c-b493-0c9dc7670c97 None None] MFA Rules not processed for user `624487005e4f4180a9d56a29a7daad1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:54.788890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-cb92646f-9a59-477c-b493-0c9dc7670c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:54.849000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 882/1752] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:54.852840 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da282e98-454e-495a-b94a-575653dd1934 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:54.858973 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-da282e98-454e-495a-b94a-575653dd1934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:54.938488 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 871/1753] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Oct 4 14:29:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:54.940263 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92646f-9a59-477c-b493-0c9dc7670c97 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:55.067355 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92646f-9a59-477c-b493-0c9dc7670c97 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:55.084825 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed30d6a-9f02-42d1-8c7d-6991f0f9d674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:55.086092 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed30d6a-9f02-42d1-8c7d-6991f0f9d674 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:55.086388 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed30d6a-9f02-42d1-8c7d-6991f0f9d674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:55.086653 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed30d6a-9f02-42d1-8c7d-6991f0f9d674 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:55.087452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed30d6a-9f02-42d1-8c7d-6991f0f9d674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:55.089647 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed30d6a-9f02-42d1-8c7d-6991f0f9d674 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:55.148775 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 872/1754] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:29:54 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:55.157928 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b25895-8c26-4817-b7ca-f593f0523c9e None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:55.158382 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b25895-8c26-4817-b7ca-f593f0523c9e None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:55.160452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b25895-8c26-4817-b7ca-f593f0523c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:55.182128 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da282e98-454e-495a-b94a-575653dd1934 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:55.211339 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dacb7d-7169-49e7-9457-3945d3c2b4e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:55.212216 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dacb7d-7169-49e7-9457-3945d3c2b4e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:55.213719 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dacb7d-7169-49e7-9457-3945d3c2b4e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:55.218309 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dacb7d-7169-49e7-9457-3945d3c2b4e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:55.249463 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dacb7d-7169-49e7-9457-3945d3c2b4e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:55.255356 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dacb7d-7169-49e7-9457-3945d3c2b4e3 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:55.256414 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-d1b25895-8c26-4817-b7ca-f593f0523c9e None None] MFA Rules not processed for user `624487005e4f4180a9d56a29a7daad1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:55.257880 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d1b25895-8c26-4817-b7ca-f593f0523c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:55.275433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 873/1755] 10.222.0.30 () {58 vars in 1015 bytes} [Tue Oct 4 14:29:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:55.276502 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b25895-8c26-4817-b7ca-f593f0523c9e None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:55.280966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d1b25895-8c26-4817-b7ca-f593f0523c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:55.293839 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 883/1756] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:55.297121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dacb7d-7169-49e7-9457-3945d3c2b4e3 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:55.304252 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-82dacb7d-7169-49e7-9457-3945d3c2b4e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:55.504124 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b25895-8c26-4817-b7ca-f593f0523c9e None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:55.515056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b5867-8949-4ba5-9114-ec10e4dad88e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:55.516457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b5867-8949-4ba5-9114-ec10e4dad88e service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:55.516457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b5867-8949-4ba5-9114-ec10e4dad88e service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:55.516732 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b5867-8949-4ba5-9114-ec10e4dad88e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:55.533629 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:55.650768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dacb7d-7169-49e7-9457-3945d3c2b4e3 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:55.697343 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69e3f6-7fa4-4d66-b2f7-63cfe9fbcacd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:55.698327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69e3f6-7fa4-4d66-b2f7-63cfe9fbcacd service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:55.698803 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69e3f6-7fa4-4d66-b2f7-63cfe9fbcacd service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:55.699296 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69e3f6-7fa4-4d66-b2f7-63cfe9fbcacd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:55.709376 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3c69e3f6-7fa4-4d66-b2f7-63cfe9fbcacd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:55.808527 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:55.966452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b5867-8949-4ba5-9114-ec10e4dad88e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:55.974439 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b5867-8949-4ba5-9114-ec10e4dad88e service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:56.041476 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 874/1757] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 763 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:56.042693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b5867-8949-4ba5-9114-ec10e4dad88e service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:56.055976 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-640b5867-8949-4ba5-9114-ec10e4dad88e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:56.111825 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b5867-8949-4ba5-9114-ec10e4dad88e service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:56.121176 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69e3f6-7fa4-4d66-b2f7-63cfe9fbcacd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:56.126857 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b5d39-609d-44e4-b5b4-5255f1e4469d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:56.128971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69e3f6-7fa4-4d66-b2f7-63cfe9fbcacd service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:56.134539 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b5d39-609d-44e4-b5b4-5255f1e4469d service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:56.135261 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b5d39-609d-44e4-b5b4-5255f1e4469d service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:56.136300 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b5d39-609d-44e4-b5b4-5255f1e4469d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:56.182996 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b5d39-609d-44e4-b5b4-5255f1e4469d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:56.185822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b5d39-609d-44e4-b5b4-5255f1e4469d service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:56.202892 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 875/1759] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:56.204527 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b5d39-609d-44e4-b5b4-5255f1e4469d service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:56.204731 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 884/1759] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 908 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:56.211170 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69e3f6-7fa4-4d66-b2f7-63cfe9fbcacd service nova] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:56.278300 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b5d39-609d-44e4-b5b4-5255f1e4469d service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:56.291594 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69e3f6-7fa4-4d66-b2f7-63cfe9fbcacd service nova] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:56.314611 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca243dd-847e-45e1-9be8-0eb79e68661e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:56.316364 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca243dd-847e-45e1-9be8-0eb79e68661e service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:56.317032 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca243dd-847e-45e1-9be8-0eb79e68661e service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:56.319269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca243dd-847e-45e1-9be8-0eb79e68661e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:56.330165 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369495c2-d96e-4168-a73d-cbe1c9737480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:56.334601 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369495c2-d96e-4168-a73d-cbe1c9737480 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:56.336845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369495c2-d96e-4168-a73d-cbe1c9737480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:56.337148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369495c2-d96e-4168-a73d-cbe1c9737480 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:56.345553 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369495c2-d96e-4168-a73d-cbe1c9737480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:56.354307 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369495c2-d96e-4168-a73d-cbe1c9737480 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:56.381539 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca243dd-847e-45e1-9be8-0eb79e68661e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:56.385766 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca243dd-847e-45e1-9be8-0eb79e68661e service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:56.462050 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 885/1760] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:56.463260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 876/1761] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:56.468566 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369495c2-d96e-4168-a73d-cbe1c9737480 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:56.475129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca243dd-847e-45e1-9be8-0eb79e68661e service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:56.484798 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-369495c2-d96e-4168-a73d-cbe1c9737480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:56.571632 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca243dd-847e-45e1-9be8-0eb79e68661e service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:56.591109 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369495c2-d96e-4168-a73d-cbe1c9737480 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:56.601291 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253ee8a-88c2-430b-b58e-a92ec8550b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:56.603209 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253ee8a-88c2-430b-b58e-a92ec8550b23 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:56.609981 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253ee8a-88c2-430b-b58e-a92ec8550b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:56.612144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253ee8a-88c2-430b-b58e-a92ec8550b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:56.623892 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e24b6-dc5e-4e02-8302-1e76bb325628 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:56.624205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253ee8a-88c2-430b-b58e-a92ec8550b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:56.624355 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e24b6-dc5e-4e02-8302-1e76bb325628 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:56.624355 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e24b6-dc5e-4e02-8302-1e76bb325628 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:56.624355 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e24b6-dc5e-4e02-8302-1e76bb325628 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:56.635189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253ee8a-88c2-430b-b58e-a92ec8550b23 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:56.642305 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-0d6e24b6-dc5e-4e02-8302-1e76bb325628 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:56.744436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 886/1762] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:56.751016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253ee8a-88c2-430b-b58e-a92ec8550b23 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:56.801650 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253ee8a-88c2-430b-b58e-a92ec8550b23 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:56.830782 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90610316-6b47-4708-9895-a28c6608da0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:56.834316 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90610316-6b47-4708-9895-a28c6608da0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:56.834316 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90610316-6b47-4708-9895-a28c6608da0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:56.836613 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90610316-6b47-4708-9895-a28c6608da0b admin admin] PATH_INFO: `/v3/projects/b0e93a9fd17c4bd7a812d624b182121e/users/aef2e9ac82734f51b7946d81c9f94ead/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:56.916188 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90610316-6b47-4708-9895-a28c6608da0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0e93a9fd17c4bd7a812d624b182121e, user_id=aef2e9ac82734f51b7946d81c9f94ead, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:56.974060 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90610316-6b47-4708-9895-a28c6608da0b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:57.114640 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 887/1763] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:29:56 2022] PUT /identity/v3/projects/b0e93a9fd17c4bd7a812d624b182121e/users/aef2e9ac82734f51b7946d81c9f94ead/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:57.149158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90610316-6b47-4708-9895-a28c6608da0b admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:57.165030 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-90610316-6b47-4708-9895-a28c6608da0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:57.229688 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e24b6-dc5e-4e02-8302-1e76bb325628 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:57.231806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e24b6-dc5e-4e02-8302-1e76bb325628 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:57.328703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 877/1764] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:29:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 864 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:29:57.334071 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22350a55-ca49-40b1-8c2d-906914c223ee None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:57.340512 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22350a55-ca49-40b1-8c2d-906914c223ee None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:57.347185 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22350a55-ca49-40b1-8c2d-906914c223ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:57.545293 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-22350a55-ca49-40b1-8c2d-906914c223ee None None] MFA Rules not processed for user `aef2e9ac82734f51b7946d81c9f94ead`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:29:57.561356 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-22350a55-ca49-40b1-8c2d-906914c223ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:57.761601 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90610316-6b47-4708-9895-a28c6608da0b admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:57.791205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f69a6c-51cd-44de-9327-b28e3f56912b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:57.803668 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f69a6c-51cd-44de-9327-b28e3f56912b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:57.804307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f69a6c-51cd-44de-9327-b28e3f56912b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:57.806330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f69a6c-51cd-44de-9327-b28e3f56912b admin admin] PATH_INFO: `/v3/projects/48d68300909a462cb5d41e49393c0259` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:57.811208 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f69a6c-51cd-44de-9327-b28e3f56912b admin admin] RBAC: Authorizing `identity:delete_project(project_id=48d68300909a462cb5d41e49393c0259)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:57.815501 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f69a6c-51cd-44de-9327-b28e3f56912b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:57.983613 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 878/1765] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:29:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 654 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:29:57.989249 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22350a55-ca49-40b1-8c2d-906914c223ee None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:57.993903 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:58.042487 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22350a55-ca49-40b1-8c2d-906914c223ee None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:58.102846 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d8f69a6c-51cd-44de-9327-b28e3f56912b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48d68300909a462cb5d41e49393c0259', 'request_id': 'req-d8f69a6c-51cd-44de-9327-b28e3f56912b'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:58.157576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d8f69a6c-51cd-44de-9327-b28e3f56912b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48d68300909a462cb5d41e49393c0259', 'request_id': 'req-d8f69a6c-51cd-44de-9327-b28e3f56912b'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:58.189987 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d8f69a6c-51cd-44de-9327-b28e3f56912b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48d68300909a462cb5d41e49393c0259', 'request_id': 'req-d8f69a6c-51cd-44de-9327-b28e3f56912b'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:58.245579 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d8f69a6c-51cd-44de-9327-b28e3f56912b admin admin] The token cache is being invalidate because project 48d68300909a462cb5d41e49393c0259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:29:58.250126 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d8f69a6c-51cd-44de-9327-b28e3f56912b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:58.253030 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d8f69a6c-51cd-44de-9327-b28e3f56912b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:58.261287 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 888/1766] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:29:57 2022] DELETE /identity/v3/projects/48d68300909a462cb5d41e49393c0259 => generated 0 bytes in 1145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:58.264890 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f69a6c-51cd-44de-9327-b28e3f56912b admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:58.270893 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d8f69a6c-51cd-44de-9327-b28e3f56912b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:58.279840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:58.420179 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11215dab-2108-4574-8d0c-781293e6b4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:58.424834 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11215dab-2108-4574-8d0c-781293e6b4f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:58.425245 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11215dab-2108-4574-8d0c-781293e6b4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:58.425627 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11215dab-2108-4574-8d0c-781293e6b4f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:58.426632 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11215dab-2108-4574-8d0c-781293e6b4f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:58.446343 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11215dab-2108-4574-8d0c-781293e6b4f4 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:58.582323 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f69a6c-51cd-44de-9327-b28e3f56912b admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:58.595534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad73dc-7882-4691-acd6-769565c27850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:58.597986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad73dc-7882-4691-acd6-769565c27850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:58.598271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad73dc-7882-4691-acd6-769565c27850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:58.600176 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad73dc-7882-4691-acd6-769565c27850 admin admin] PATH_INFO: `/v3/users/1703e504ceac4b4aa8156f2c45602f6a` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:58.603873 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad73dc-7882-4691-acd6-769565c27850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1703e504ceac4b4aa8156f2c45602f6a)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:58.611959 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad73dc-7882-4691-acd6-769565c27850 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:58.623305 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 879/1767] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:29:57 2022] POST /identity/v3/projects => generated 375 bytes in 635 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:58.627785 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11215dab-2108-4574-8d0c-781293e6b4f4 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:58.644272 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-11215dab-2108-4574-8d0c-781293e6b4f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:58.843643 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-48ad73dc-7882-4691-acd6-769565c27850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1703e504ceac4b4aa8156f2c45602f6a'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:58.847674 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-48ad73dc-7882-4691-acd6-769565c27850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1703e504ceac4b4aa8156f2c45602f6a'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:58.875365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-48ad73dc-7882-4691-acd6-769565c27850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1703e504ceac4b4aa8156f2c45602f6a'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:58.952177 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-48ad73dc-7882-4691-acd6-769565c27850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1703e504ceac4b4aa8156f2c45602f6a'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:58.991275 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11215dab-2108-4574-8d0c-781293e6b4f4 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:59.015406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5723122-b250-42ad-9f54-4972e9744922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:59.026872 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5723122-b250-42ad-9f54-4972e9744922 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:59.027452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5723122-b250-42ad-9f54-4972e9744922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:59.027559 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-48ad73dc-7882-4691-acd6-769565c27850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1703e504ceac4b4aa8156f2c45602f6a'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:29:59.027957 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5723122-b250-42ad-9f54-4972e9744922 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:59.028990 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5723122-b250-42ad-9f54-4972e9744922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:59.032416 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5723122-b250-42ad-9f54-4972e9744922 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:59.047640 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 889/1768] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:29:58 2022] DELETE /identity/v3/users/1703e504ceac4b4aa8156f2c45602f6a => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:59.118328 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 880/1769] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:29:58 2022] POST /identity/v3/users => generated 294 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:29:59.123840 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad73dc-7882-4691-acd6-769565c27850 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:59.125283 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-48ad73dc-7882-4691-acd6-769565c27850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:29:59.391033 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:59.497254 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad73dc-7882-4691-acd6-769565c27850 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:59.512744 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35f73a-56ab-4bc0-9029-57fba566fb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:59.513968 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35f73a-56ab-4bc0-9029-57fba566fb3c admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:59.516678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35f73a-56ab-4bc0-9029-57fba566fb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:59.517871 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35f73a-56ab-4bc0-9029-57fba566fb3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:59.521695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35f73a-56ab-4bc0-9029-57fba566fb3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:59.568234 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35f73a-56ab-4bc0-9029-57fba566fb3c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:59.611922 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 890/1770] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:29:59.612155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5723122-b250-42ad-9f54-4972e9744922 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:59.658454 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5723122-b250-42ad-9f54-4972e9744922 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:29:59.688799 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25002d-6bfc-428e-a5ae-aa6f1807c245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:29:59.689831 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25002d-6bfc-428e-a5ae-aa6f1807c245 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:29:59.690260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25002d-6bfc-428e-a5ae-aa6f1807c245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:29:59.690958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25002d-6bfc-428e-a5ae-aa6f1807c245 admin admin] PATH_INFO: `/v3/projects/f4fba2ebf1c643d5816448be16a8a1de/users/3f95a16628054071921cd6a8ee59465d/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:29:59.765520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25002d-6bfc-428e-a5ae-aa6f1807c245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4fba2ebf1c643d5816448be16a8a1de, user_id=3f95a16628054071921cd6a8ee59465d, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:29:59.768825 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25002d-6bfc-428e-a5ae-aa6f1807c245 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:29:59.830191 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 881/1771] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:29:59 2022] PUT /identity/v3/projects/f4fba2ebf1c643d5816448be16a8a1de/users/3f95a16628054071921cd6a8ee59465d/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:29:59.841989 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35f73a-56ab-4bc0-9029-57fba566fb3c admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:29:59.924946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35f73a-56ab-4bc0-9029-57fba566fb3c admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:00.272166 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee275d-e880-4c03-9e7a-cc8c62688485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:00.272789 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee275d-e880-4c03-9e7a-cc8c62688485 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:00.273072 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee275d-e880-4c03-9e7a-cc8c62688485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:00.273342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee275d-e880-4c03-9e7a-cc8c62688485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:00.273994 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee275d-e880-4c03-9e7a-cc8c62688485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:00.275624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee275d-e880-4c03-9e7a-cc8c62688485 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:00.334410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25002d-6bfc-428e-a5ae-aa6f1807c245 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:00.351270 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 891/1772] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 512 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:00.379118 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25002d-6bfc-428e-a5ae-aa6f1807c245 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:00.410195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cac98-de71-4bba-b227-14c9dd841615 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:00.410874 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cac98-de71-4bba-b227-14c9dd841615 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:00.410874 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cac98-de71-4bba-b227-14c9dd841615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:00.414721 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8b172-ee24-4c30-8e35-028ab8b325c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:00.416037 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8b172-ee24-4c30-8e35-028ab8b325c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:00.417787 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8b172-ee24-4c30-8e35-028ab8b325c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:00.419895 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8b172-ee24-4c30-8e35-028ab8b325c7 admin admin] PATH_INFO: `/v3/projects/f4fba2ebf1c643d5816448be16a8a1de/users/3f95a16628054071921cd6a8ee59465d/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:00.426202 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8b172-ee24-4c30-8e35-028ab8b325c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4fba2ebf1c643d5816448be16a8a1de, user_id=3f95a16628054071921cd6a8ee59465d, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:00.439183 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8b172-ee24-4c30-8e35-028ab8b325c7 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:00.468353 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-6a9cac98-de71-4bba-b227-14c9dd841615 None None] MFA Rules not processed for user `62d720a284ad493bb8393289e9e38140`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:00.471872 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6a9cac98-de71-4bba-b227-14c9dd841615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:00.484132 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 882/1773] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:00 2022] PUT /identity/v3/projects/f4fba2ebf1c643d5816448be16a8a1de/users/3f95a16628054071921cd6a8ee59465d/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:00.492105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3aee8-310f-4d77-a614-7268b7176870 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:00.492603 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3aee8-310f-4d77-a614-7268b7176870 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:00.493337 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3aee8-310f-4d77-a614-7268b7176870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:00.631928 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-f3c3aee8-310f-4d77-a614-7268b7176870 None None] MFA Rules not processed for user `3f95a16628054071921cd6a8ee59465d`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:00.644394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f3c3aee8-310f-4d77-a614-7268b7176870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:00.837475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 892/1774] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:30:00.840371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cac98-de71-4bba-b227-14c9dd841615 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:00.849787 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6a9cac98-de71-4bba-b227-14c9dd841615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:01.190345 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 883/1775] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 700 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:30:01.201073 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3aee8-310f-4d77-a614-7268b7176870 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:01.213824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f3c3aee8-310f-4d77-a614-7268b7176870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:01.223497 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cac98-de71-4bba-b227-14c9dd841615 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:01.250003 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e1947-4915-4982-950c-245a3297b7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:01.256152 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e1947-4915-4982-950c-245a3297b7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:01.259806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:01.261562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e1947-4915-4982-950c-245a3297b7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:01.261796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e1947-4915-4982-950c-245a3297b7fd admin admin] PATH_INFO: `/v3/projects/c6c307ece34041e2b0a3e752aecb3e98` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:01.279756 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e1947-4915-4982-950c-245a3297b7fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6c307ece34041e2b0a3e752aecb3e98)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:01.287330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e1947-4915-4982-950c-245a3297b7fd admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:01.288111 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3aee8-310f-4d77-a614-7268b7176870 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:01.309469 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bad97-f0ad-4a75-8eba-4a09dd053a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:01.310370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bad97-f0ad-4a75-8eba-4a09dd053a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:01.319012 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bad97-f0ad-4a75-8eba-4a09dd053a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:01.322146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bad97-f0ad-4a75-8eba-4a09dd053a85 admin admin] PATH_INFO: `/v3/users/6584e9869c194bf2942e251d70a0fc4e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:01.325910 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bad97-f0ad-4a75-8eba-4a09dd053a85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6584e9869c194bf2942e251d70a0fc4e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:01.342099 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bad97-f0ad-4a75-8eba-4a09dd053a85 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:01.399404 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:01.498318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-fd3e1947-4915-4982-950c-245a3297b7fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6c307ece34041e2b0a3e752aecb3e98', 'request_id': 'req-fd3e1947-4915-4982-950c-245a3297b7fd'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:01.514936 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-fd3e1947-4915-4982-950c-245a3297b7fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6c307ece34041e2b0a3e752aecb3e98', 'request_id': 'req-fd3e1947-4915-4982-950c-245a3297b7fd'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:01.542420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-fd3e1947-4915-4982-950c-245a3297b7fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6c307ece34041e2b0a3e752aecb3e98', 'request_id': 'req-fd3e1947-4915-4982-950c-245a3297b7fd'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:01.585492 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-3e3bad97-f0ad-4a75-8eba-4a09dd053a85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6584e9869c194bf2942e251d70a0fc4e'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:01.587109 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-3e3bad97-f0ad-4a75-8eba-4a09dd053a85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6584e9869c194bf2942e251d70a0fc4e'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:01.599623 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-fd3e1947-4915-4982-950c-245a3297b7fd admin admin] The token cache is being invalidate because project c6c307ece34041e2b0a3e752aecb3e98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:01.600097 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-fd3e1947-4915-4982-950c-245a3297b7fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:01.607984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-fd3e1947-4915-4982-950c-245a3297b7fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:01.617161 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 893/1776] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:00 2022] DELETE /identity/v3/projects/c6c307ece34041e2b0a3e752aecb3e98 => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:01.617816 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e1947-4915-4982-950c-245a3297b7fd admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:01.625729 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-fd3e1947-4915-4982-950c-245a3297b7fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:01.672761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-3e3bad97-f0ad-4a75-8eba-4a09dd053a85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6584e9869c194bf2942e251d70a0fc4e'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:01.703339 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-3e3bad97-f0ad-4a75-8eba-4a09dd053a85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6584e9869c194bf2942e251d70a0fc4e'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:01.745927 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-3e3bad97-f0ad-4a75-8eba-4a09dd053a85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6584e9869c194bf2942e251d70a0fc4e'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:01.787846 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 884/1777] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:01 2022] DELETE /identity/v3/users/6584e9869c194bf2942e251d70a0fc4e => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:01.790699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b893f-9ed0-4afa-a788-5316c66b24cd None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:01.799367 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b893f-9ed0-4afa-a788-5316c66b24cd None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:01.800331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b893f-9ed0-4afa-a788-5316c66b24cd None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:01.803313 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 885/1778] 10.222.0.62 () {54 vars in 921 bytes} [Tue Oct 4 14:30:01 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:30:01.805484 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71531d50-0a69-40f6-8182-09140f3d0de4 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:01.806178 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71531d50-0a69-40f6-8182-09140f3d0de4 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:01.806815 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71531d50-0a69-40f6-8182-09140f3d0de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:01.877040 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-71531d50-0a69-40f6-8182-09140f3d0de4 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:01.882531 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-71531d50-0a69-40f6-8182-09140f3d0de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:02.040114 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e1947-4915-4982-950c-245a3297b7fd admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:02.179056 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2d0c9-d10f-4146-85e6-b8946b44f9d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:02.179689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2d0c9-d10f-4146-85e6-b8946b44f9d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:02.182047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2d0c9-d10f-4146-85e6-b8946b44f9d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:02.182688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2d0c9-d10f-4146-85e6-b8946b44f9d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:02.187090 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3fa2d0c9-d10f-4146-85e6-b8946b44f9d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:02.263204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 886/1779] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:02.290390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7212fa-989c-428d-9ff3-5028a5b11796 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:02.290983 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7212fa-989c-428d-9ff3-5028a5b11796 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:02.291476 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7212fa-989c-428d-9ff3-5028a5b11796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:02.345515 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2d0c9-d10f-4146-85e6-b8946b44f9d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:02.347652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2d0c9-d10f-4146-85e6-b8946b44f9d5 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:02.364040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 894/1780] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 746 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:02.366125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f3097-2c62-40a4-992e-2a08980026ce None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:02.366418 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f3097-2c62-40a4-992e-2a08980026ce None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:02.366699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f3097-2c62-40a4-992e-2a08980026ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:02.405005 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-3f7212fa-989c-428d-9ff3-5028a5b11796 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:02.406239 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-3f7212fa-989c-428d-9ff3-5028a5b11796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:02.431973 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 887/1781] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:02.431973 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d516f3-1d6a-4048-8d49-5a9feb2a3882 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:02.431973 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d516f3-1d6a-4048-8d49-5a9feb2a3882 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:02.431973 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d516f3-1d6a-4048-8d49-5a9feb2a3882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:02.434872 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-557f3097-2c62-40a4-992e-2a08980026ce None None] MFA Rules not processed for user `151e7b9c7a7b46d58dc2f563d05775e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:02.453142 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-557f3097-2c62-40a4-992e-2a08980026ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:02.477669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:02.534991 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-56d516f3-1d6a-4048-8d49-5a9feb2a3882 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:02.539445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-56d516f3-1d6a-4048-8d49-5a9feb2a3882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:02.574364 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 888/1782] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:02.585723 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d516f3-1d6a-4048-8d49-5a9feb2a3882 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:02.592067 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-56d516f3-1d6a-4048-8d49-5a9feb2a3882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:02.947568 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d516f3-1d6a-4048-8d49-5a9feb2a3882 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:02.961164 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591594c0-0831-4b0a-a3b6-037c097c3158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:02.964491 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591594c0-0831-4b0a-a3b6-037c097c3158 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:02.983218 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591594c0-0831-4b0a-a3b6-037c097c3158 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:02.983859 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591594c0-0831-4b0a-a3b6-037c097c3158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:03.036253 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591594c0-0831-4b0a-a3b6-037c097c3158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:03.037830 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591594c0-0831-4b0a-a3b6-037c097c3158 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:03.084913 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 895/1783] 10.222.0.62 () {58 vars in 1018 bytes} [Tue Oct 4 14:30:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 720 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:03.091628 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f3097-2c62-40a4-992e-2a08980026ce None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:03.096549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 889/1784] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:03.173945 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f3097-2c62-40a4-992e-2a08980026ce None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:03.208771 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f22ea-81bb-454f-a968-dca8613047c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:03.209865 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f22ea-81bb-454f-a968-dca8613047c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:03.210762 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f22ea-81bb-454f-a968-dca8613047c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:03.211184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f22ea-81bb-454f-a968-dca8613047c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:03.212568 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f22ea-81bb-454f-a968-dca8613047c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:30:03.213086 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f22ea-81bb-454f-a968-dca8613047c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:03.221361 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f22ea-81bb-454f-a968-dca8613047c6 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:03.277665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591594c0-0831-4b0a-a3b6-037c097c3158 service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:03.279333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 896/1785] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:30:03.297114 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591594c0-0831-4b0a-a3b6-037c097c3158 service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:03.314100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd23c1b-70de-4932-a47a-377ef16e358c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:03.314874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd23c1b-70de-4932-a47a-377ef16e358c admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:03.317528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd23c1b-70de-4932-a47a-377ef16e358c admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:03.319640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd23c1b-70de-4932-a47a-377ef16e358c admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:03.320587 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd23c1b-70de-4932-a47a-377ef16e358c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:03.328462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd23c1b-70de-4932-a47a-377ef16e358c admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:03.363610 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:03.463852 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 890/1786] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:03 2022] POST /identity/v3/projects => generated 363 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:30:03.468798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f22ea-81bb-454f-a968-dca8613047c6 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:03.498521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f22ea-81bb-454f-a968-dca8613047c6 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:03.782660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c037dcd-7a03-42e4-bea6-956ed469f61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:03.783740 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c037dcd-7a03-42e4-bea6-956ed469f61b admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:03.784221 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c037dcd-7a03-42e4-bea6-956ed469f61b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:03.784675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c037dcd-7a03-42e4-bea6-956ed469f61b admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:03.786109 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c037dcd-7a03-42e4-bea6-956ed469f61b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:03.788350 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c037dcd-7a03-42e4-bea6-956ed469f61b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:03.854476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 897/1787] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:03 2022] POST /identity/v3/users => generated 282 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:03.861354 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd23c1b-70de-4932-a47a-377ef16e358c admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:03.895737 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd23c1b-70de-4932-a47a-377ef16e358c admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:03.916943 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde2852-7d46-40a3-b17e-78f61ce32c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:03.917601 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde2852-7d46-40a3-b17e-78f61ce32c93 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:03.923846 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde2852-7d46-40a3-b17e-78f61ce32c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:03.925409 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde2852-7d46-40a3-b17e-78f61ce32c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:03.927809 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde2852-7d46-40a3-b17e-78f61ce32c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:03.936578 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde2852-7d46-40a3-b17e-78f61ce32c93 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:03.990195 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 891/1788] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:03.992819 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c037dcd-7a03-42e4-bea6-956ed469f61b admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:04.009066 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c037dcd-7a03-42e4-bea6-956ed469f61b admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:04.021261 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde2852-7d46-40a3-b17e-78f61ce32c93 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:04.023969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-0fde2852-7d46-40a3-b17e-78f61ce32c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:04.039560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216095c1-2491-44c6-9a6c-ed482c947430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:04.042157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216095c1-2491-44c6-9a6c-ed482c947430 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:04.042629 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216095c1-2491-44c6-9a6c-ed482c947430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:04.045116 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216095c1-2491-44c6-9a6c-ed482c947430 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:04.046239 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216095c1-2491-44c6-9a6c-ed482c947430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:04.053811 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216095c1-2491-44c6-9a6c-ed482c947430 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:04.093391 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 898/1789] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:04.097328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216095c1-2491-44c6-9a6c-ed482c947430 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:04.133390 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216095c1-2491-44c6-9a6c-ed482c947430 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:04.158729 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2c45e-dd40-47bc-b919-6f724e0b34c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:04.159753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2c45e-dd40-47bc-b919-6f724e0b34c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:04.164980 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2c45e-dd40-47bc-b919-6f724e0b34c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:04.165492 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2c45e-dd40-47bc-b919-6f724e0b34c1 admin admin] PATH_INFO: `/v3/projects/640c95fc77074e3292da023ceb60f606/users/147013226fd34623897f1b93485ac867/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:04.212317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2c45e-dd40-47bc-b919-6f724e0b34c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=640c95fc77074e3292da023ceb60f606, user_id=147013226fd34623897f1b93485ac867, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:04.216549 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2c45e-dd40-47bc-b919-6f724e0b34c1 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:04.274743 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 899/1790] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:04 2022] PUT /identity/v3/projects/640c95fc77074e3292da023ceb60f606/users/147013226fd34623897f1b93485ac867/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:04.301147 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951c9cb-7b18-4e92-b171-980b27cc2734 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:04.301749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951c9cb-7b18-4e92-b171-980b27cc2734 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:04.302200 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951c9cb-7b18-4e92-b171-980b27cc2734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:04.308481 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde2852-7d46-40a3-b17e-78f61ce32c93 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:04.386258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-a951c9cb-7b18-4e92-b171-980b27cc2734 None None] MFA Rules not processed for user `147013226fd34623897f1b93485ac867`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:04.395467 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a951c9cb-7b18-4e92-b171-980b27cc2734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:04.520317 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea7d1a-125e-47f9-be44-204571d84aab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:04.520962 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea7d1a-125e-47f9-be44-204571d84aab service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:04.523201 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea7d1a-125e-47f9-be44-204571d84aab service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:04.523482 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea7d1a-125e-47f9-be44-204571d84aab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:04.528337 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:04.553142 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea7d1a-125e-47f9-be44-204571d84aab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:04.554957 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea7d1a-125e-47f9-be44-204571d84aab service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:04.613299 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 892/1791] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:04.665832 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 900/1792] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:30:04.673631 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea7d1a-125e-47f9-be44-204571d84aab service nova] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:04.859290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:04.879377 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951c9cb-7b18-4e92-b171-980b27cc2734 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:04.883193 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a951c9cb-7b18-4e92-b171-980b27cc2734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:04.883616 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea7d1a-125e-47f9-be44-204571d84aab service nova] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:04.895248 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118eb324-6015-4000-8052-06b5433a9146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:04.896294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118eb324-6015-4000-8052-06b5433a9146 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:04.896729 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118eb324-6015-4000-8052-06b5433a9146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:04.897139 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118eb324-6015-4000-8052-06b5433a9146 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:04.897928 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118eb324-6015-4000-8052-06b5433a9146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:04.905124 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118eb324-6015-4000-8052-06b5433a9146 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:04.912809 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951c9cb-7b18-4e92-b171-980b27cc2734 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:04.921088 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795baedd-4e2b-4d07-8573-f4ac27164586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:04.921816 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795baedd-4e2b-4d07-8573-f4ac27164586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:04.922336 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795baedd-4e2b-4d07-8573-f4ac27164586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:04.922681 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795baedd-4e2b-4d07-8573-f4ac27164586 admin admin] PATH_INFO: `/v3/users/14cfc8c9ec1e4f4094c978311462a7ef` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:04.925897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795baedd-4e2b-4d07-8573-f4ac27164586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14cfc8c9ec1e4f4094c978311462a7ef)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:04.928597 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795baedd-4e2b-4d07-8573-f4ac27164586 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:04.994973 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 893/1793] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:04 2022] POST /identity/v3/projects => generated 365 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:05.000484 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118eb324-6015-4000-8052-06b5433a9146 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:05.050931 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-795baedd-4e2b-4d07-8573-f4ac27164586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14cfc8c9ec1e4f4094c978311462a7ef'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:05.052423 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-795baedd-4e2b-4d07-8573-f4ac27164586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14cfc8c9ec1e4f4094c978311462a7ef'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:05.067489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-795baedd-4e2b-4d07-8573-f4ac27164586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14cfc8c9ec1e4f4094c978311462a7ef'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:05.108211 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-795baedd-4e2b-4d07-8573-f4ac27164586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14cfc8c9ec1e4f4094c978311462a7ef'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:05.119141 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-795baedd-4e2b-4d07-8573-f4ac27164586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14cfc8c9ec1e4f4094c978311462a7ef'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:05.131877 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 901/1794] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:04 2022] DELETE /identity/v3/users/14cfc8c9ec1e4f4094c978311462a7ef => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:30:05.138709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02a67d-0a24-40ae-9d5c-00bc6e448b8d None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:05.139287 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02a67d-0a24-40ae-9d5c-00bc6e448b8d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:05.139759 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02a67d-0a24-40ae-9d5c-00bc6e448b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:05.157216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118eb324-6015-4000-8052-06b5433a9146 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:05.209162 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-2d02a67d-0a24-40ae-9d5c-00bc6e448b8d None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:05.212716 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2d02a67d-0a24-40ae-9d5c-00bc6e448b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:05.346685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c928f-aca3-4ed8-9cb4-79b8b960224a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:05.347830 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c928f-aca3-4ed8-9cb4-79b8b960224a admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:05.348098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c928f-aca3-4ed8-9cb4-79b8b960224a admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:05.350076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c928f-aca3-4ed8-9cb4-79b8b960224a admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:05.351025 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c928f-aca3-4ed8-9cb4-79b8b960224a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:05.357452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c928f-aca3-4ed8-9cb4-79b8b960224a admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:05.432089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 894/1795] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:04 2022] POST /identity/v3/users => generated 289 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:05.437318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c928f-aca3-4ed8-9cb4-79b8b960224a admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:05.441637 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b36c928f-aca3-4ed8-9cb4-79b8b960224a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:05.463564 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c928f-aca3-4ed8-9cb4-79b8b960224a admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:05.471590 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c68f54-97ad-4c2b-b07e-f9eb19bd5954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:05.475615 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c68f54-97ad-4c2b-b07e-f9eb19bd5954 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:05.476061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c68f54-97ad-4c2b-b07e-f9eb19bd5954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:05.476494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c68f54-97ad-4c2b-b07e-f9eb19bd5954 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:05.477385 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c68f54-97ad-4c2b-b07e-f9eb19bd5954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:05.479227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 902/1796] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:05.488572 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c68f54-97ad-4c2b-b07e-f9eb19bd5954 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:05.507042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 895/1797] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:05.511598 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02a67d-0a24-40ae-9d5c-00bc6e448b8d None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:05.532924 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02a67d-0a24-40ae-9d5c-00bc6e448b8d None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:05.550058 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b5615-00f4-49cf-9ae1-8ce67721c827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:05.551228 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b5615-00f4-49cf-9ae1-8ce67721c827 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:05.551338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b5615-00f4-49cf-9ae1-8ce67721c827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:05.551650 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b5615-00f4-49cf-9ae1-8ce67721c827 admin admin] PATH_INFO: `/v3/projects/0d76651c99e44c518ec81114dabd0cef/users/249b221d0e034ef5900ae7d4ea801dbe/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:05.596851 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b5615-00f4-49cf-9ae1-8ce67721c827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d76651c99e44c518ec81114dabd0cef, user_id=249b221d0e034ef5900ae7d4ea801dbe, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:05.620915 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b5615-00f4-49cf-9ae1-8ce67721c827 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:05.665383 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 903/1798] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:05 2022] PUT /identity/v3/projects/0d76651c99e44c518ec81114dabd0cef/users/249b221d0e034ef5900ae7d4ea801dbe/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:05.666855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c68f54-97ad-4c2b-b07e-f9eb19bd5954 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:05.683958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c68f54-97ad-4c2b-b07e-f9eb19bd5954 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:05.717632 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b5615-00f4-49cf-9ae1-8ce67721c827 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:05.720111 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6f5b5615-00f4-49cf-9ae1-8ce67721c827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:05.839365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:05.939959 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca424a-f343-4031-83d4-e304ea5c248c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:05.941866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca424a-f343-4031-83d4-e304ea5c248c admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:05.945044 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca424a-f343-4031-83d4-e304ea5c248c admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:05.948125 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca424a-f343-4031-83d4-e304ea5c248c admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:05.949675 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca424a-f343-4031-83d4-e304ea5c248c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:05.953659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca424a-f343-4031-83d4-e304ea5c248c admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:05.967075 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b5615-00f4-49cf-9ae1-8ce67721c827 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:05.982075 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1b737-0b1a-4013-8766-8ddcee4ec428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:05.983596 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1b737-0b1a-4013-8766-8ddcee4ec428 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:05.985557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1b737-0b1a-4013-8766-8ddcee4ec428 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:05.987745 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1b737-0b1a-4013-8766-8ddcee4ec428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:05.989045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 896/1799] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:05.994756 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca424a-f343-4031-83d4-e304ea5c248c admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:06.018389 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:06.024226 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1b737-0b1a-4013-8766-8ddcee4ec428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:06.028761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1b737-0b1a-4013-8766-8ddcee4ec428 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:06.033107 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca424a-f343-4031-83d4-e304ea5c248c admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:06.041853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52903118-14d2-4c14-bc04-d54bdb0694d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:06.043629 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52903118-14d2-4c14-bc04-d54bdb0694d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:06.044046 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52903118-14d2-4c14-bc04-d54bdb0694d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:06.044511 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52903118-14d2-4c14-bc04-d54bdb0694d7 admin admin] PATH_INFO: `/v3/projects/0d76651c99e44c518ec81114dabd0cef/users/249b221d0e034ef5900ae7d4ea801dbe/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:06.047680 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52903118-14d2-4c14-bc04-d54bdb0694d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d76651c99e44c518ec81114dabd0cef, user_id=249b221d0e034ef5900ae7d4ea801dbe, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:06.050449 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52903118-14d2-4c14-bc04-d54bdb0694d7 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:06.066252 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 897/1800] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:05 2022] PUT /identity/v3/projects/0d76651c99e44c518ec81114dabd0cef/users/249b221d0e034ef5900ae7d4ea801dbe/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:06.070647 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 904/1801] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:06.095534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2816c5d-ee12-4127-b1da-40e6df144957 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:06.096519 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2816c5d-ee12-4127-b1da-40e6df144957 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:06.097277 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2816c5d-ee12-4127-b1da-40e6df144957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:06.154916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-e2816c5d-ee12-4127-b1da-40e6df144957 None None] MFA Rules not processed for user `249b221d0e034ef5900ae7d4ea801dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:06.158355 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e2816c5d-ee12-4127-b1da-40e6df144957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:06.365431 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 898/1802] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:06.386382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1b737-0b1a-4013-8766-8ddcee4ec428 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:06.388492 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5ed1b737-0b1a-4013-8766-8ddcee4ec428 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:06.581631 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1b737-0b1a-4013-8766-8ddcee4ec428 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:06.719026 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a22d3-189c-4fd4-8547-0790c033d777 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:06.720778 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a22d3-189c-4fd4-8547-0790c033d777 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:06.722488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a22d3-189c-4fd4-8547-0790c033d777 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:06.724276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a22d3-189c-4fd4-8547-0790c033d777 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:06.773635 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a22d3-189c-4fd4-8547-0790c033d777 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:06.775899 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a22d3-189c-4fd4-8547-0790c033d777 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:06.820945 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 905/1803] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:06 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:07.057188 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2816c5d-ee12-4127-b1da-40e6df144957 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:07.071738 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2816c5d-ee12-4127-b1da-40e6df144957 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:07.091964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5719768-d003-49d5-a1b7-f7f438bb76c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:07.092603 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5719768-d003-49d5-a1b7-f7f438bb76c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:07.092882 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5719768-d003-49d5-a1b7-f7f438bb76c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:07.093152 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5719768-d003-49d5-a1b7-f7f438bb76c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:07.101715 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b5719768-d003-49d5-a1b7-f7f438bb76c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:07.364920 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5719768-d003-49d5-a1b7-f7f438bb76c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:07.368197 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5719768-d003-49d5-a1b7-f7f438bb76c7 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:07.388322 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 899/1804] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:30:07.950746 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a22d3-189c-4fd4-8547-0790c033d777 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:07.957280 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5719768-d003-49d5-a1b7-f7f438bb76c7 service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:07.961478 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b5719768-d003-49d5-a1b7-f7f438bb76c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:08.158830 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5719768-d003-49d5-a1b7-f7f438bb76c7 service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:08.164536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a22d3-189c-4fd4-8547-0790c033d777 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:08.175205 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab5603-3e35-432a-a902-58087e865875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:08.176383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab5603-3e35-432a-a902-58087e865875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:08.177616 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7563c-e654-4422-a694-23e6f927bfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:08.178027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab5603-3e35-432a-a902-58087e865875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:08.179235 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab5603-3e35-432a-a902-58087e865875 admin admin] PATH_INFO: `/v3/projects/e08e8cad494b4199bd8260e90bbd6772` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:08.180434 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7563c-e654-4422-a694-23e6f927bfa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:08.180764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7563c-e654-4422-a694-23e6f927bfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:08.181038 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7563c-e654-4422-a694-23e6f927bfa8 admin admin] PATH_INFO: `/v3/users/147013226fd34623897f1b93485ac867` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:08.185313 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7563c-e654-4422-a694-23e6f927bfa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=147013226fd34623897f1b93485ac867)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:08.187503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab5603-3e35-432a-a902-58087e865875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e08e8cad494b4199bd8260e90bbd6772)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:08.198449 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7563c-e654-4422-a694-23e6f927bfa8 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:08.205344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab5603-3e35-432a-a902-58087e865875 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:08.240335 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:08.281704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:08.330168 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-60ab5603-3e35-432a-a902-58087e865875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e08e8cad494b4199bd8260e90bbd6772', 'request_id': 'req-60ab5603-3e35-432a-a902-58087e865875'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:08.331290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-39a7563c-e654-4422-a694-23e6f927bfa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '147013226fd34623897f1b93485ac867'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:08.333250 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-39a7563c-e654-4422-a694-23e6f927bfa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '147013226fd34623897f1b93485ac867'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:08.347489 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-60ab5603-3e35-432a-a902-58087e865875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e08e8cad494b4199bd8260e90bbd6772', 'request_id': 'req-60ab5603-3e35-432a-a902-58087e865875'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:08.363439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-39a7563c-e654-4422-a694-23e6f927bfa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '147013226fd34623897f1b93485ac867'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:08.396612 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-60ab5603-3e35-432a-a902-58087e865875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e08e8cad494b4199bd8260e90bbd6772', 'request_id': 'req-60ab5603-3e35-432a-a902-58087e865875'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:08.421906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-39a7563c-e654-4422-a694-23e6f927bfa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '147013226fd34623897f1b93485ac867'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:08.443634 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-60ab5603-3e35-432a-a902-58087e865875 admin admin] The token cache is being invalidate because project e08e8cad494b4199bd8260e90bbd6772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:08.445155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-60ab5603-3e35-432a-a902-58087e865875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:08.451088 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-60ab5603-3e35-432a-a902-58087e865875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:08.453950 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-39a7563c-e654-4422-a694-23e6f927bfa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '147013226fd34623897f1b93485ac867'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:08.456046 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 900/1805] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:07 2022] DELETE /identity/v3/projects/e08e8cad494b4199bd8260e90bbd6772 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:08.460155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab5603-3e35-432a-a902-58087e865875 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:08.465706 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-60ab5603-3e35-432a-a902-58087e865875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:08.475737 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 906/1806] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:07 2022] DELETE /identity/v3/users/147013226fd34623897f1b93485ac867 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:08.505879 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b7f0b-53d6-471f-8da0-d4126b135eaf None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:08.506225 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b7f0b-53d6-471f-8da0-d4126b135eaf None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:08.506505 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b7f0b-53d6-471f-8da0-d4126b135eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:08.605523 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-4f1b7f0b-53d6-471f-8da0-d4126b135eaf None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:08.608491 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4f1b7f0b-53d6-471f-8da0-d4126b135eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:08.669475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab5603-3e35-432a-a902-58087e865875 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:08.836703 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 907/1807] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:08.881793 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b7f0b-53d6-471f-8da0-d4126b135eaf None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:08.883911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4f1b7f0b-53d6-471f-8da0-d4126b135eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:08.886355 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238585a2-7bd1-4cea-af09-ea0008f58eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:08.890222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238585a2-7bd1-4cea-af09-ea0008f58eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:08.890686 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238585a2-7bd1-4cea-af09-ea0008f58eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:08.891041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238585a2-7bd1-4cea-af09-ea0008f58eed admin admin] PATH_INFO: `/v3/users/a1487fbbb545444a9c61e352d1c8d0b2` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:08.892506 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238585a2-7bd1-4cea-af09-ea0008f58eed admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1487fbbb545444a9c61e352d1c8d0b2)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:08.894832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238585a2-7bd1-4cea-af09-ea0008f58eed admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:09.081175 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b7f0b-53d6-471f-8da0-d4126b135eaf None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:09.101540 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922eb6e-0e5e-47d7-9211-e4de436a8453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:09.102771 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922eb6e-0e5e-47d7-9211-e4de436a8453 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:09.103142 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922eb6e-0e5e-47d7-9211-e4de436a8453 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:09.107094 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922eb6e-0e5e-47d7-9211-e4de436a8453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:09.137733 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922eb6e-0e5e-47d7-9211-e4de436a8453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:09.156681 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922eb6e-0e5e-47d7-9211-e4de436a8453 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:09.156796 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-238585a2-7bd1-4cea-af09-ea0008f58eed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1487fbbb545444a9c61e352d1c8d0b2'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:09.157328 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-238585a2-7bd1-4cea-af09-ea0008f58eed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1487fbbb545444a9c61e352d1c8d0b2'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:09.163255 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:09.194345 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-238585a2-7bd1-4cea-af09-ea0008f58eed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1487fbbb545444a9c61e352d1c8d0b2'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:09.201103 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 908/1808] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:30:09.202105 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922eb6e-0e5e-47d7-9211-e4de436a8453 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:09.209691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-238585a2-7bd1-4cea-af09-ea0008f58eed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1487fbbb545444a9c61e352d1c8d0b2'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:09.211450 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7922eb6e-0e5e-47d7-9211-e4de436a8453 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:09.223433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-238585a2-7bd1-4cea-af09-ea0008f58eed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1487fbbb545444a9c61e352d1c8d0b2'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:09.233658 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 901/1809] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:08 2022] DELETE /identity/v3/users/a1487fbbb545444a9c61e352d1c8d0b2 => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:09.257595 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922eb6e-0e5e-47d7-9211-e4de436a8453 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:09.359424 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:09.391094 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a766a-77ac-4528-9145-ac16de33619a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:09.395574 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a766a-77ac-4528-9145-ac16de33619a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:09.396492 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a766a-77ac-4528-9145-ac16de33619a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:09.397070 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a766a-77ac-4528-9145-ac16de33619a admin admin] PATH_INFO: `/v3/projects/aeaf0ab777f14a6ead5a3f6444e40437` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:09.399744 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a766a-77ac-4528-9145-ac16de33619a admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeaf0ab777f14a6ead5a3f6444e40437)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:09.403300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a766a-77ac-4528-9145-ac16de33619a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:09.554466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-064a766a-77ac-4528-9145-ac16de33619a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeaf0ab777f14a6ead5a3f6444e40437', 'request_id': 'req-064a766a-77ac-4528-9145-ac16de33619a'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:09.582808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-064a766a-77ac-4528-9145-ac16de33619a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeaf0ab777f14a6ead5a3f6444e40437', 'request_id': 'req-064a766a-77ac-4528-9145-ac16de33619a'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:09.600199 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-064a766a-77ac-4528-9145-ac16de33619a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeaf0ab777f14a6ead5a3f6444e40437', 'request_id': 'req-064a766a-77ac-4528-9145-ac16de33619a'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:09.637013 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-064a766a-77ac-4528-9145-ac16de33619a admin admin] The token cache is being invalidate because project aeaf0ab777f14a6ead5a3f6444e40437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:09.637390 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-064a766a-77ac-4528-9145-ac16de33619a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:09.641058 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-064a766a-77ac-4528-9145-ac16de33619a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:09.643763 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 909/1810] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:09 2022] DELETE /identity/v3/projects/aeaf0ab777f14a6ead5a3f6444e40437 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:09.649967 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238585a2-7bd1-4cea-af09-ea0008f58eed admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:09.651477 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-238585a2-7bd1-4cea-af09-ea0008f58eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:09.695672 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238585a2-7bd1-4cea-af09-ea0008f58eed admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:09.873001 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62805678-e986-457d-aa04-818b8f076b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:09.874127 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62805678-e986-457d-aa04-818b8f076b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:09.874701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62805678-e986-457d-aa04-818b8f076b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:09.875486 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62805678-e986-457d-aa04-818b8f076b83 admin admin] PATH_INFO: `/v3/users/70565f5c37f5492a978c41f325847dee` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:09.877651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62805678-e986-457d-aa04-818b8f076b83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70565f5c37f5492a978c41f325847dee)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:09.880619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62805678-e986-457d-aa04-818b8f076b83 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:09.959194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-62805678-e986-457d-aa04-818b8f076b83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70565f5c37f5492a978c41f325847dee'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:09.959945 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-62805678-e986-457d-aa04-818b8f076b83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70565f5c37f5492a978c41f325847dee'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:09.998030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-62805678-e986-457d-aa04-818b8f076b83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70565f5c37f5492a978c41f325847dee'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:10.025208 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-62805678-e986-457d-aa04-818b8f076b83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70565f5c37f5492a978c41f325847dee'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:10.048778 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-62805678-e986-457d-aa04-818b8f076b83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70565f5c37f5492a978c41f325847dee'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:10.059387 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 902/1811] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:09 2022] DELETE /identity/v3/users/70565f5c37f5492a978c41f325847dee => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:10.145154 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324eb15-9b21-4551-b011-822a7452d69b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:10.145786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324eb15-9b21-4551-b011-822a7452d69b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:10.145786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324eb15-9b21-4551-b011-822a7452d69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:10.248902 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-d324eb15-9b21-4551-b011-822a7452d69b None None] MFA Rules not processed for user `7eaef5f6ca21428a9c87bb7dffc2017d`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:10.250344 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d324eb15-9b21-4551-b011-822a7452d69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:10.407894 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 910/1812] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:10.841838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62805678-e986-457d-aa04-818b8f076b83 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:10.844713 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-62805678-e986-457d-aa04-818b8f076b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:10.975151 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:10.995006 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62805678-e986-457d-aa04-818b8f076b83 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:11.001804 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4ff40-8906-4f5d-a876-3a5dc1bd64d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:11.003428 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4ff40-8906-4f5d-a876-3a5dc1bd64d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:11.004018 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4ff40-8906-4f5d-a876-3a5dc1bd64d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:11.004422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4ff40-8906-4f5d-a876-3a5dc1bd64d6 admin admin] PATH_INFO: `/v3/projects/f503aef0fdcb4570baddd0f99a8f9e67` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:11.005929 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4ff40-8906-4f5d-a876-3a5dc1bd64d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f503aef0fdcb4570baddd0f99a8f9e67)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:11.008345 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4ff40-8906-4f5d-a876-3a5dc1bd64d6 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:11.012051 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324eb15-9b21-4551-b011-822a7452d69b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:11.013716 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d324eb15-9b21-4551-b011-822a7452d69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:11.049028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324eb15-9b21-4551-b011-822a7452d69b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:11.087089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e506fd-a328-4afe-b8d8-1dedeee6ce42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:11.088480 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e506fd-a328-4afe-b8d8-1dedeee6ce42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:11.089175 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e506fd-a328-4afe-b8d8-1dedeee6ce42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:11.091975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e506fd-a328-4afe-b8d8-1dedeee6ce42 admin admin] PATH_INFO: `/v3/projects/640c95fc77074e3292da023ceb60f606` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:11.093242 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e506fd-a328-4afe-b8d8-1dedeee6ce42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=640c95fc77074e3292da023ceb60f606)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:11.103272 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e506fd-a328-4afe-b8d8-1dedeee6ce42 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:11.147242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a4b4ff40-8906-4f5d-a876-3a5dc1bd64d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f503aef0fdcb4570baddd0f99a8f9e67', 'request_id': 'req-a4b4ff40-8906-4f5d-a876-3a5dc1bd64d6'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:11.173029 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a4b4ff40-8906-4f5d-a876-3a5dc1bd64d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f503aef0fdcb4570baddd0f99a8f9e67', 'request_id': 'req-a4b4ff40-8906-4f5d-a876-3a5dc1bd64d6'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:11.198590 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a4b4ff40-8906-4f5d-a876-3a5dc1bd64d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f503aef0fdcb4570baddd0f99a8f9e67', 'request_id': 'req-a4b4ff40-8906-4f5d-a876-3a5dc1bd64d6'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:11.242484 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a4b4ff40-8906-4f5d-a876-3a5dc1bd64d6 admin admin] The token cache is being invalidate because project f503aef0fdcb4570baddd0f99a8f9e67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:11.243553 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a4b4ff40-8906-4f5d-a876-3a5dc1bd64d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:11.270861 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-48e506fd-a328-4afe-b8d8-1dedeee6ce42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '640c95fc77074e3292da023ceb60f606', 'request_id': 'req-48e506fd-a328-4afe-b8d8-1dedeee6ce42'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:11.292185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-48e506fd-a328-4afe-b8d8-1dedeee6ce42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '640c95fc77074e3292da023ceb60f606', 'request_id': 'req-48e506fd-a328-4afe-b8d8-1dedeee6ce42'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:11.300194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a4b4ff40-8906-4f5d-a876-3a5dc1bd64d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:11.309091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-48e506fd-a328-4afe-b8d8-1dedeee6ce42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '640c95fc77074e3292da023ceb60f606', 'request_id': 'req-48e506fd-a328-4afe-b8d8-1dedeee6ce42'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:11.311289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 903/1813] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:10 2022] DELETE /identity/v3/projects/f503aef0fdcb4570baddd0f99a8f9e67 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:11.326835 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a8620-8930-4926-8b04-55564324908c None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:11.327484 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a8620-8930-4926-8b04-55564324908c None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:11.329593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a8620-8930-4926-8b04-55564324908c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:11.340720 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-48e506fd-a328-4afe-b8d8-1dedeee6ce42 admin admin] The token cache is being invalidate because project 640c95fc77074e3292da023ceb60f606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:11.341315 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-48e506fd-a328-4afe-b8d8-1dedeee6ce42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:11.342167 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-48e506fd-a328-4afe-b8d8-1dedeee6ce42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:11.354396 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 911/1814] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:11 2022] DELETE /identity/v3/projects/640c95fc77074e3292da023ceb60f606 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:11.355637 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e506fd-a328-4afe-b8d8-1dedeee6ce42 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:11.358702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-48e506fd-a328-4afe-b8d8-1dedeee6ce42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:11.379621 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-e34a8620-8930-4926-8b04-55564324908c None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:11.381257 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e34a8620-8930-4926-8b04-55564324908c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:11.383954 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:11.620343 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e506fd-a328-4afe-b8d8-1dedeee6ce42 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:11.633199 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d9ba7-c850-43f4-9c13-e14163cad900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:11.634279 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d9ba7-c850-43f4-9c13-e14163cad900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:11.638051 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d9ba7-c850-43f4-9c13-e14163cad900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:11.638765 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d9ba7-c850-43f4-9c13-e14163cad900 admin admin] PATH_INFO: `/v3/users/249b221d0e034ef5900ae7d4ea801dbe` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:11.641291 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 904/1815] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:11.642192 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d9ba7-c850-43f4-9c13-e14163cad900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=249b221d0e034ef5900ae7d4ea801dbe)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:11.642386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a8620-8930-4926-8b04-55564324908c None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:11.647401 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d9ba7-c850-43f4-9c13-e14163cad900 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:11.652887 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e34a8620-8930-4926-8b04-55564324908c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:11.681056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a8620-8930-4926-8b04-55564324908c None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:11.695830 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60596c96-4ef5-4e7b-91cc-01f06eed507f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:11.697313 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60596c96-4ef5-4e7b-91cc-01f06eed507f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:11.697860 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60596c96-4ef5-4e7b-91cc-01f06eed507f admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:11.698325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60596c96-4ef5-4e7b-91cc-01f06eed507f admin admin] PATH_INFO: `/v3/projects/4366e5d556384d68b82b5a4cc90d8981` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:11.701621 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60596c96-4ef5-4e7b-91cc-01f06eed507f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4366e5d556384d68b82b5a4cc90d8981)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:11.705527 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60596c96-4ef5-4e7b-91cc-01f06eed507f admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:11.753513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5d2d9ba7-c850-43f4-9c13-e14163cad900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '249b221d0e034ef5900ae7d4ea801dbe'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:11.754566 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5d2d9ba7-c850-43f4-9c13-e14163cad900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '249b221d0e034ef5900ae7d4ea801dbe'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:11.773830 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5d2d9ba7-c850-43f4-9c13-e14163cad900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '249b221d0e034ef5900ae7d4ea801dbe'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:11.806457 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5d2d9ba7-c850-43f4-9c13-e14163cad900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '249b221d0e034ef5900ae7d4ea801dbe'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:11.824593 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5d2d9ba7-c850-43f4-9c13-e14163cad900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '249b221d0e034ef5900ae7d4ea801dbe'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:11.848395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 912/1816] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:11 2022] DELETE /identity/v3/users/249b221d0e034ef5900ae7d4ea801dbe => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:11.852497 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3edd85-a7d8-4015-9dce-aa889404583b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:11.852784 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3edd85-a7d8-4015-9dce-aa889404583b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:11.853060 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3edd85-a7d8-4015-9dce-aa889404583b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:11.862988 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-60596c96-4ef5-4e7b-91cc-01f06eed507f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4366e5d556384d68b82b5a4cc90d8981', 'request_id': 'req-60596c96-4ef5-4e7b-91cc-01f06eed507f'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:11.883260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-60596c96-4ef5-4e7b-91cc-01f06eed507f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4366e5d556384d68b82b5a4cc90d8981', 'request_id': 'req-60596c96-4ef5-4e7b-91cc-01f06eed507f'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:11.883421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ed3edd85-a7d8-4015-9dce-aa889404583b None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:11.884785 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ed3edd85-a7d8-4015-9dce-aa889404583b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:11.899010 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-60596c96-4ef5-4e7b-91cc-01f06eed507f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4366e5d556384d68b82b5a4cc90d8981', 'request_id': 'req-60596c96-4ef5-4e7b-91cc-01f06eed507f'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:11.914148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:11.923866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-60596c96-4ef5-4e7b-91cc-01f06eed507f admin admin] The token cache is being invalidate because project 4366e5d556384d68b82b5a4cc90d8981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:11.924169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-60596c96-4ef5-4e7b-91cc-01f06eed507f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:11.926623 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-60596c96-4ef5-4e7b-91cc-01f06eed507f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:11.930034 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 905/1817] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:11 2022] DELETE /identity/v3/projects/4366e5d556384d68b82b5a4cc90d8981 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:11.937454 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b6d18-fc09-4a29-b1ff-59f408cfa04a None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:11.937747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b6d18-fc09-4a29-b1ff-59f408cfa04a None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:11.938014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b6d18-fc09-4a29-b1ff-59f408cfa04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:12.002804 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-a84b6d18-fc09-4a29-b1ff-59f408cfa04a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:12.004382 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a84b6d18-fc09-4a29-b1ff-59f408cfa04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:12.044357 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 913/1818] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:12.052328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3edd85-a7d8-4015-9dce-aa889404583b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:12.068069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3edd85-a7d8-4015-9dce-aa889404583b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:12.076756 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e1b7f-3dd9-47ad-90d0-7d19f95b2f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:12.077802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e1b7f-3dd9-47ad-90d0-7d19f95b2f48 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:12.078503 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e1b7f-3dd9-47ad-90d0-7d19f95b2f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:12.079255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e1b7f-3dd9-47ad-90d0-7d19f95b2f48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:12.080279 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e1b7f-3dd9-47ad-90d0-7d19f95b2f48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:30:12.080863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e1b7f-3dd9-47ad-90d0-7d19f95b2f48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:12.083135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e1b7f-3dd9-47ad-90d0-7d19f95b2f48 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:12.113798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 914/1819] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:30:12.119315 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e1b7f-3dd9-47ad-90d0-7d19f95b2f48 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:12.134817 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 906/1820] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:12.147208 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba925e9b-fe27-4794-93b0-25c85d64791c None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:12.147612 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba925e9b-fe27-4794-93b0-25c85d64791c None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:12.149464 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e1b7f-3dd9-47ad-90d0-7d19f95b2f48 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:12.149698 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba925e9b-fe27-4794-93b0-25c85d64791c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:12.164831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af2499-aa54-455d-bcf3-b919e8e98224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:12.169018 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af2499-aa54-455d-bcf3-b919e8e98224 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:12.169780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af2499-aa54-455d-bcf3-b919e8e98224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:12.170256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af2499-aa54-455d-bcf3-b919e8e98224 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:12.172381 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af2499-aa54-455d-bcf3-b919e8e98224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:12.176363 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af2499-aa54-455d-bcf3-b919e8e98224 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:12.179123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-ba925e9b-fe27-4794-93b0-25c85d64791c None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:12.180882 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-ba925e9b-fe27-4794-93b0-25c85d64791c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:12.191570 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 907/1821] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:30:12.196708 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba925e9b-fe27-4794-93b0-25c85d64791c None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:12.202613 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:12.210655 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba925e9b-fe27-4794-93b0-25c85d64791c None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:12.224628 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fcf20-6f8c-4656-a536-46eb0c378142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:12.225844 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fcf20-6f8c-4656-a536-46eb0c378142 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:12.226355 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fcf20-6f8c-4656-a536-46eb0c378142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:12.227554 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fcf20-6f8c-4656-a536-46eb0c378142 admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:12.228472 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0fcf20-6f8c-4656-a536-46eb0c378142 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:30:12.228879 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0fcf20-6f8c-4656-a536-46eb0c378142 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:12.232481 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0fcf20-6f8c-4656-a536-46eb0c378142 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:12.237231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 915/1822] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:12 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:12.238597 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af2499-aa54-455d-bcf3-b919e8e98224 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:12.260728 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 908/1823] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:30:12.267286 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fcf20-6f8c-4656-a536-46eb0c378142 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:12.280815 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fcf20-6f8c-4656-a536-46eb0c378142 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:12.344035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af2499-aa54-455d-bcf3-b919e8e98224 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:12.351894 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741cf3d-cdb7-4a88-baf9-ecbb7b7f2f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:12.353014 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741cf3d-cdb7-4a88-baf9-ecbb7b7f2f4f admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:12.353797 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741cf3d-cdb7-4a88-baf9-ecbb7b7f2f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:12.354673 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741cf3d-cdb7-4a88-baf9-ecbb7b7f2f4f admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:12.355828 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741cf3d-cdb7-4a88-baf9-ecbb7b7f2f4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:12.359085 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741cf3d-cdb7-4a88-baf9-ecbb7b7f2f4f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:12.361213 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c902f-8885-48fc-9998-14546be3e937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:12.361679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c902f-8885-48fc-9998-14546be3e937 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:12.361957 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c902f-8885-48fc-9998-14546be3e937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:12.362412 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c902f-8885-48fc-9998-14546be3e937 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:12.363066 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c902f-8885-48fc-9998-14546be3e937 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:12.366083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c902f-8885-48fc-9998-14546be3e937 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:12.417616 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 916/1824] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:12 2022] POST /identity/v3/users => generated 284 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:12.422666 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741cf3d-cdb7-4a88-baf9-ecbb7b7f2f4f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:12.440994 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741cf3d-cdb7-4a88-baf9-ecbb7b7f2f4f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:12.454702 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 909/1825] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:12 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:12.457770 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c902f-8885-48fc-9998-14546be3e937 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:12.462247 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c45eb-9ca1-4dc9-b306-323e1fb2c7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:12.466352 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c45eb-9ca1-4dc9-b306-323e1fb2c7cf admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:12.466918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c45eb-9ca1-4dc9-b306-323e1fb2c7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:12.468038 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c45eb-9ca1-4dc9-b306-323e1fb2c7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:12.471632 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c45eb-9ca1-4dc9-b306-323e1fb2c7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:12.474530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c45eb-9ca1-4dc9-b306-323e1fb2c7cf admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:12.503887 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 917/1826] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:30:12.508804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c45eb-9ca1-4dc9-b306-323e1fb2c7cf admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:12.554670 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c45eb-9ca1-4dc9-b306-323e1fb2c7cf admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:12.615805 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c902f-8885-48fc-9998-14546be3e937 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:12.624051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afddeb3-5720-48c8-a16b-8bcd6b7f7a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:12.624687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afddeb3-5720-48c8-a16b-8bcd6b7f7a7b admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:12.624970 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afddeb3-5720-48c8-a16b-8bcd6b7f7a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:12.625497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afddeb3-5720-48c8-a16b-8bcd6b7f7a7b admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:12.626200 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afddeb3-5720-48c8-a16b-8bcd6b7f7a7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:12.629137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afddeb3-5720-48c8-a16b-8bcd6b7f7a7b admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:12.649927 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:12.678647 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 910/1827] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:12 2022] POST /identity/v3/users => generated 290 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:12.678647 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afddeb3-5720-48c8-a16b-8bcd6b7f7a7b admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:12.680552 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-0afddeb3-5720-48c8-a16b-8bcd6b7f7a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:12.685534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307448a0-5e69-47dc-b259-773ec62bca53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:12.686352 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307448a0-5e69-47dc-b259-773ec62bca53 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:12.686831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307448a0-5e69-47dc-b259-773ec62bca53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:12.687307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307448a0-5e69-47dc-b259-773ec62bca53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:12.688594 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307448a0-5e69-47dc-b259-773ec62bca53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:12.691822 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307448a0-5e69-47dc-b259-773ec62bca53 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:12.696608 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afddeb3-5720-48c8-a16b-8bcd6b7f7a7b admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:12.702366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e085b-3d62-4380-a556-b408b13b1ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:12.703094 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e085b-3d62-4380-a556-b408b13b1ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:12.703445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e085b-3d62-4380-a556-b408b13b1ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:12.703858 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e085b-3d62-4380-a556-b408b13b1ce4 admin admin] PATH_INFO: `/v3/projects/0d76651c99e44c518ec81114dabd0cef` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:12.705477 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e085b-3d62-4380-a556-b408b13b1ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d76651c99e44c518ec81114dabd0cef)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:12.707644 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e085b-3d62-4380-a556-b408b13b1ce4 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:12.711352 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 918/1828] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:12.711352 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307448a0-5e69-47dc-b259-773ec62bca53 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:12.722821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307448a0-5e69-47dc-b259-773ec62bca53 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:12.727699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07c462-afff-439f-9abe-419c4e0744f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:12.728367 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07c462-afff-439f-9abe-419c4e0744f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:12.728647 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07c462-afff-439f-9abe-419c4e0744f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:12.728910 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07c462-afff-439f-9abe-419c4e0744f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:12.731430 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07c462-afff-439f-9abe-419c4e0744f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:12.732972 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07c462-afff-439f-9abe-419c4e0744f7 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:12.746617 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 919/1829] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:12.747496 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07c462-afff-439f-9abe-419c4e0744f7 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:12.762107 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07c462-afff-439f-9abe-419c4e0744f7 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:12.781722 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-005e085b-3d62-4380-a556-b408b13b1ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d76651c99e44c518ec81114dabd0cef', 'request_id': 'req-005e085b-3d62-4380-a556-b408b13b1ce4'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:12.791014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-005e085b-3d62-4380-a556-b408b13b1ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d76651c99e44c518ec81114dabd0cef', 'request_id': 'req-005e085b-3d62-4380-a556-b408b13b1ce4'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:12.807613 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-005e085b-3d62-4380-a556-b408b13b1ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d76651c99e44c518ec81114dabd0cef', 'request_id': 'req-005e085b-3d62-4380-a556-b408b13b1ce4'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:12.823668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-005e085b-3d62-4380-a556-b408b13b1ce4 admin admin] The token cache is being invalidate because project 0d76651c99e44c518ec81114dabd0cef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:12.824326 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-005e085b-3d62-4380-a556-b408b13b1ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:12.825423 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-005e085b-3d62-4380-a556-b408b13b1ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:12.831700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 911/1830] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:12 2022] DELETE /identity/v3/projects/0d76651c99e44c518ec81114dabd0cef => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:12.838540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e085b-3d62-4380-a556-b408b13b1ce4 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:12.840940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:12.845840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-005e085b-3d62-4380-a556-b408b13b1ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:12.853165 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6c9c0-8acc-47d7-8304-7a7b953c5d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:12.854152 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6c9c0-8acc-47d7-8304-7a7b953c5d1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:12.854620 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6c9c0-8acc-47d7-8304-7a7b953c5d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:12.856336 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6c9c0-8acc-47d7-8304-7a7b953c5d1c admin admin] PATH_INFO: `/v3/projects/efe4ad0688934010be2c45b84a379970/users/7ae37cfb127b43a89633c91d6e511687/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:12.878388 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e085b-3d62-4380-a556-b408b13b1ce4 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:12.893635 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6c9c0-8acc-47d7-8304-7a7b953c5d1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe4ad0688934010be2c45b84a379970, user_id=7ae37cfb127b43a89633c91d6e511687, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:12.896685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6c9c0-8acc-47d7-8304-7a7b953c5d1c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:12.904542 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d828d47-faff-4b63-92a9-4cd6914a7984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:12.905240 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d828d47-faff-4b63-92a9-4cd6914a7984 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:12.905626 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d828d47-faff-4b63-92a9-4cd6914a7984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:12.905813 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d828d47-faff-4b63-92a9-4cd6914a7984 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:12.906489 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d828d47-faff-4b63-92a9-4cd6914a7984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:12.912559 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d828d47-faff-4b63-92a9-4cd6914a7984 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:12.922017 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 920/1831] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:12 2022] PUT /identity/v3/projects/efe4ad0688934010be2c45b84a379970/users/7ae37cfb127b43a89633c91d6e511687/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:12.923669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d05cc0-5057-4d9e-a56c-5bad5d5b8833 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:12.924054 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d05cc0-5057-4d9e-a56c-5bad5d5b8833 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:12.924345 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d05cc0-5057-4d9e-a56c-5bad5d5b8833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:12.954849 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 912/1832] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:12.957824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fe17f-b00a-45f9-8ebb-cfc905114fac None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:12.958045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fe17f-b00a-45f9-8ebb-cfc905114fac None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:12.958320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fe17f-b00a-45f9-8ebb-cfc905114fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:12.979424 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-40d05cc0-5057-4d9e-a56c-5bad5d5b8833 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:12.986694 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-40d05cc0-5057-4d9e-a56c-5bad5d5b8833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:13.040075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-173fe17f-b00a-45f9-8ebb-cfc905114fac None None] MFA Rules not processed for user `7ae37cfb127b43a89633c91d6e511687`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:13.042959 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-173fe17f-b00a-45f9-8ebb-cfc905114fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:13.154469 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 921/1833] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:13.156134 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d05cc0-5057-4d9e-a56c-5bad5d5b8833 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:13.180674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 913/1834] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:13.181788 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af7f6f-9f41-408c-89f8-e77b692bd105 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:13.181916 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d05cc0-5057-4d9e-a56c-5bad5d5b8833 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:13.182074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af7f6f-9f41-408c-89f8-e77b692bd105 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:13.182349 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af7f6f-9f41-408c-89f8-e77b692bd105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:13.215571 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-37af7f6f-9f41-408c-89f8-e77b692bd105 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:13.218546 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-37af7f6f-9f41-408c-89f8-e77b692bd105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:13.224988 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873cf3b-08d2-4578-921a-aa2f77acf045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:13.232433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 914/1835] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:13.233296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af7f6f-9f41-408c-89f8-e77b692bd105 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:13.233401 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873cf3b-08d2-4578-921a-aa2f77acf045 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:13.233670 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873cf3b-08d2-4578-921a-aa2f77acf045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:13.233957 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873cf3b-08d2-4578-921a-aa2f77acf045 admin admin] PATH_INFO: `/v3/projects/9c73ec42d3d04afb8812345dcb74012b/users/3fcfd90069f24bb1aa75df2a701a6879/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:13.238764 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-37af7f6f-9f41-408c-89f8-e77b692bd105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:13.261180 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af7f6f-9f41-408c-89f8-e77b692bd105 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:13.269513 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39e5a3-0ac1-4753-b150-7c4e4017a7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:13.270351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39e5a3-0ac1-4753-b150-7c4e4017a7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:13.270775 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39e5a3-0ac1-4753-b150-7c4e4017a7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:13.271200 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39e5a3-0ac1-4753-b150-7c4e4017a7e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:13.272075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39e5a3-0ac1-4753-b150-7c4e4017a7e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:13.274110 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39e5a3-0ac1-4753-b150-7c4e4017a7e1 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:13.301489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873cf3b-08d2-4578-921a-aa2f77acf045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c73ec42d3d04afb8812345dcb74012b, user_id=3fcfd90069f24bb1aa75df2a701a6879, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:13.303907 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873cf3b-08d2-4578-921a-aa2f77acf045 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:13.325182 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 915/1836] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:13 2022] POST /identity/v3/projects => generated 367 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:13.329171 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39e5a3-0ac1-4753-b150-7c4e4017a7e1 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:13.340439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 922/1837] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:13 2022] PUT /identity/v3/projects/9c73ec42d3d04afb8812345dcb74012b/users/3fcfd90069f24bb1aa75df2a701a6879/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:13.341370 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873cf3b-08d2-4578-921a-aa2f77acf045 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:13.463169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:13.535761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873cf3b-08d2-4578-921a-aa2f77acf045 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:13.543397 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217576f7-cfb0-4a98-ac94-8863f6c53ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:13.544551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217576f7-cfb0-4a98-ac94-8863f6c53ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:13.545172 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217576f7-cfb0-4a98-ac94-8863f6c53ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:13.545949 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217576f7-cfb0-4a98-ac94-8863f6c53ea9 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:13.547431 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217576f7-cfb0-4a98-ac94-8863f6c53ea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:13.548458 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39e5a3-0ac1-4753-b150-7c4e4017a7e1 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:13.553571 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217576f7-cfb0-4a98-ac94-8863f6c53ea9 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:13.561623 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db8c93-cc8a-4ae8-ab6f-0e6ee7b7bc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:13.562740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db8c93-cc8a-4ae8-ab6f-0e6ee7b7bc12 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:13.564527 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db8c93-cc8a-4ae8-ab6f-0e6ee7b7bc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:13.565473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db8c93-cc8a-4ae8-ab6f-0e6ee7b7bc12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:13.567517 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db8c93-cc8a-4ae8-ab6f-0e6ee7b7bc12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:30:13.568143 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db8c93-cc8a-4ae8-ab6f-0e6ee7b7bc12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:13.570289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db8c93-cc8a-4ae8-ab6f-0e6ee7b7bc12 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:13.596179 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 916/1838] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:30:13.598000 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9bce5-fa28-42d0-8239-9882660c8887 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:13.598390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9bce5-fa28-42d0-8239-9882660c8887 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:13.600496 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9bce5-fa28-42d0-8239-9882660c8887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:13.650055 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 923/1839] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:13 2022] POST /identity/v3/users => generated 290 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:13.651576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217576f7-cfb0-4a98-ac94-8863f6c53ea9 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:13.658510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-33a9bce5-fa28-42d0-8239-9882660c8887 None None] MFA Rules not processed for user `3fcfd90069f24bb1aa75df2a701a6879`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:13.660167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-33a9bce5-fa28-42d0-8239-9882660c8887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:13.690254 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217576f7-cfb0-4a98-ac94-8863f6c53ea9 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:13.707787 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76276f36-ef2b-4a2b-97a2-3f0f41c23dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:13.708526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76276f36-ef2b-4a2b-97a2-3f0f41c23dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:13.709295 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76276f36-ef2b-4a2b-97a2-3f0f41c23dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:13.710175 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76276f36-ef2b-4a2b-97a2-3f0f41c23dd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:13.711342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76276f36-ef2b-4a2b-97a2-3f0f41c23dd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:13.732599 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76276f36-ef2b-4a2b-97a2-3f0f41c23dd4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:13.855894 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 924/1840] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:13 2022] POST /identity/v3/projects => generated 377 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:13.855894 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76276f36-ef2b-4a2b-97a2-3f0f41c23dd4 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:13.888155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 917/1841] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:13.888155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82febe9-7dc4-40be-834f-24277ed6490a None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:13.888155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82febe9-7dc4-40be-834f-24277ed6490a None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:13.888883 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82febe9-7dc4-40be-834f-24277ed6490a None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:13.890188 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 918/1842] 10.222.0.62 () {54 vars in 921 bytes} [Tue Oct 4 14:30:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:30:13.891315 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82febe9-7dc4-40be-834f-24277ed6490a None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:14.005256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:14.141374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82febe9-7dc4-40be-834f-24277ed6490a None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:14.151548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418c36d-dad5-40ee-a21e-f5edd5b369a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:14.153292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418c36d-dad5-40ee-a21e-f5edd5b369a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:14.155648 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418c36d-dad5-40ee-a21e-f5edd5b369a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:14.155970 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418c36d-dad5-40ee-a21e-f5edd5b369a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:14.156650 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418c36d-dad5-40ee-a21e-f5edd5b369a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:14.158677 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76276f36-ef2b-4a2b-97a2-3f0f41c23dd4 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:14.165604 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418c36d-dad5-40ee-a21e-f5edd5b369a0 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:14.175232 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b986c2-0790-4659-8046-3f925b823f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:14.177101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b986c2-0790-4659-8046-3f925b823f19 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:14.177682 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b986c2-0790-4659-8046-3f925b823f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:14.178161 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b986c2-0790-4659-8046-3f925b823f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:14.179589 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b986c2-0790-4659-8046-3f925b823f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:14.181963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b986c2-0790-4659-8046-3f925b823f19 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:14.204227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 925/1843] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:14.206757 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b986c2-0790-4659-8046-3f925b823f19 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:14.225298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 919/1844] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:13 2022] POST /identity/v3/users => generated 289 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:14.225298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd01ec-1db6-46de-8383-4f27c9ccfb2f None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:14.225298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd01ec-1db6-46de-8383-4f27c9ccfb2f None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:14.225298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd01ec-1db6-46de-8383-4f27c9ccfb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:14.227662 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b986c2-0790-4659-8046-3f925b823f19 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:14.234781 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06575f0b-f211-48b8-8860-213134cebf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:14.235842 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06575f0b-f211-48b8-8860-213134cebf65 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:14.236368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06575f0b-f211-48b8-8860-213134cebf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:14.236904 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06575f0b-f211-48b8-8860-213134cebf65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:14.237860 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06575f0b-f211-48b8-8860-213134cebf65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:14.241653 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06575f0b-f211-48b8-8860-213134cebf65 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:14.280470 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-f1fd01ec-1db6-46de-8383-4f27c9ccfb2f None None] MFA Rules not processed for user `151e7b9c7a7b46d58dc2f563d05775e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:14.284319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f1fd01ec-1db6-46de-8383-4f27c9ccfb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:14.316167 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 926/1845] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:14 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:14.317882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06575f0b-f211-48b8-8860-213134cebf65 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:14.402888 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:14.501785 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06575f0b-f211-48b8-8860-213134cebf65 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:14.524293 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161fce6-dddf-4e85-b010-8f3dbb7f7b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:14.524573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161fce6-dddf-4e85-b010-8f3dbb7f7b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:14.525035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161fce6-dddf-4e85-b010-8f3dbb7f7b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:14.525376 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161fce6-dddf-4e85-b010-8f3dbb7f7b42 admin admin] PATH_INFO: `/v3/projects/0b53fbec646a43058a0817d40ac5d3b1/users/e7a5004673cc4660b426739b280a8fca/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:14.556912 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 920/1846] 10.222.0.62 () {58 vars in 1018 bytes} [Tue Oct 4 14:30:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:14.579021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd01ec-1db6-46de-8383-4f27c9ccfb2f None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:14.585018 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161fce6-dddf-4e85-b010-8f3dbb7f7b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b53fbec646a43058a0817d40ac5d3b1, user_id=e7a5004673cc4660b426739b280a8fca, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:14.592214 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161fce6-dddf-4e85-b010-8f3dbb7f7b42 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:14.621882 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd01ec-1db6-46de-8383-4f27c9ccfb2f None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:14.632422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 927/1847] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:14 2022] PUT /identity/v3/projects/0b53fbec646a43058a0817d40ac5d3b1/users/e7a5004673cc4660b426739b280a8fca/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:14.634128 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161fce6-dddf-4e85-b010-8f3dbb7f7b42 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:14.840460 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644731f8-3bde-40c0-b18b-8f450f8f415b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:14.841261 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644731f8-3bde-40c0-b18b-8f450f8f415b admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:14.841660 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644731f8-3bde-40c0-b18b-8f450f8f415b admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:14.842036 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644731f8-3bde-40c0-b18b-8f450f8f415b admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:14.843062 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644731f8-3bde-40c0-b18b-8f450f8f415b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:14.845517 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644731f8-3bde-40c0-b18b-8f450f8f415b admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:14.860402 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161fce6-dddf-4e85-b010-8f3dbb7f7b42 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:14.868675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503748c-1e07-4f05-89ad-6eec4182d26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:14.869690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503748c-1e07-4f05-89ad-6eec4182d26f admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:14.869975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503748c-1e07-4f05-89ad-6eec4182d26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:14.870251 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503748c-1e07-4f05-89ad-6eec4182d26f admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:14.871414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503748c-1e07-4f05-89ad-6eec4182d26f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:14.873515 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 921/1848] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:14.874552 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644731f8-3bde-40c0-b18b-8f450f8f415b admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:14.874738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503748c-1e07-4f05-89ad-6eec4182d26f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:14.905122 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644731f8-3bde-40c0-b18b-8f450f8f415b admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:14.914138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ab489-35f9-4a5b-81b1-2138e1f0d600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:14.914138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ab489-35f9-4a5b-81b1-2138e1f0d600 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:14.914138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ab489-35f9-4a5b-81b1-2138e1f0d600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:14.914560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 928/1849] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:14 2022] POST /identity/v3/users => generated 289 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:14.914721 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ab489-35f9-4a5b-81b1-2138e1f0d600 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:14.915074 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503748c-1e07-4f05-89ad-6eec4182d26f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:14.915761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ab489-35f9-4a5b-81b1-2138e1f0d600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:14.918412 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ab489-35f9-4a5b-81b1-2138e1f0d600 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:14.920463 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0503748c-1e07-4f05-89ad-6eec4182d26f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:14.942741 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 922/1850] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:14.946002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ab489-35f9-4a5b-81b1-2138e1f0d600 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:14.990718 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:15.010386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ab489-35f9-4a5b-81b1-2138e1f0d600 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:15.020352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6d20c-d7cc-448e-a76d-c284e35a1844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:15.021458 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6d20c-d7cc-448e-a76d-c284e35a1844 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:15.021976 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6d20c-d7cc-448e-a76d-c284e35a1844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:15.023313 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6d20c-d7cc-448e-a76d-c284e35a1844 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:15.024172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6d20c-d7cc-448e-a76d-c284e35a1844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:15.026012 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6d20c-d7cc-448e-a76d-c284e35a1844 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:15.094039 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 923/1851] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:15.098561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6d20c-d7cc-448e-a76d-c284e35a1844 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:15.124997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6d20c-d7cc-448e-a76d-c284e35a1844 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:15.145766 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51fb07-5a45-4d4b-a596-3f3a46ecf2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:15.146424 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51fb07-5a45-4d4b-a596-3f3a46ecf2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:15.146868 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51fb07-5a45-4d4b-a596-3f3a46ecf2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:15.147314 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51fb07-5a45-4d4b-a596-3f3a46ecf2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:15.148277 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51fb07-5a45-4d4b-a596-3f3a46ecf2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:15.150516 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51fb07-5a45-4d4b-a596-3f3a46ecf2f4 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:15.184335 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 924/1852] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:15.185668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51fb07-5a45-4d4b-a596-3f3a46ecf2f4 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:15.192648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503748c-1e07-4f05-89ad-6eec4182d26f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:15.209525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2daab-9660-46be-a1c2-3f62490f784b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:15.212817 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51fb07-5a45-4d4b-a596-3f3a46ecf2f4 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:15.213435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2daab-9660-46be-a1c2-3f62490f784b service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:15.213856 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2daab-9660-46be-a1c2-3f62490f784b service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:15.215441 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2daab-9660-46be-a1c2-3f62490f784b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:15.235282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be7720-cd56-45e1-a55b-4505687ec233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:15.236493 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be7720-cd56-45e1-a55b-4505687ec233 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:15.236960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be7720-cd56-45e1-a55b-4505687ec233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:15.237418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be7720-cd56-45e1-a55b-4505687ec233 admin admin] PATH_INFO: `/v3/projects/0b53fbec646a43058a0817d40ac5d3b1/users/e7a5004673cc4660b426739b280a8fca/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:15.245275 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be7720-cd56-45e1-a55b-4505687ec233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b53fbec646a43058a0817d40ac5d3b1, user_id=e7a5004673cc4660b426739b280a8fca, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:15.252902 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be7720-cd56-45e1-a55b-4505687ec233 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:15.258242 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2daab-9660-46be-a1c2-3f62490f784b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:15.263769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2daab-9660-46be-a1c2-3f62490f784b service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:15.292839 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 929/1853] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:15.295172 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2daab-9660-46be-a1c2-3f62490f784b service nova] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:15.314927 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 925/1854] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:15 2022] PUT /identity/v3/projects/0b53fbec646a43058a0817d40ac5d3b1/users/e7a5004673cc4660b426739b280a8fca/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:15.316399 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be7720-cd56-45e1-a55b-4505687ec233 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:15.328758 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2daab-9660-46be-a1c2-3f62490f784b service nova] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:15.510504 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be7720-cd56-45e1-a55b-4505687ec233 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:15.518568 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1be1fa-31bf-4460-a6e4-5ff05cdbac50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:15.519824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1be1fa-31bf-4460-a6e4-5ff05cdbac50 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:15.520230 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1be1fa-31bf-4460-a6e4-5ff05cdbac50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:15.520817 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1be1fa-31bf-4460-a6e4-5ff05cdbac50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:15.521492 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1be1fa-31bf-4460-a6e4-5ff05cdbac50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:15.523585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1be1fa-31bf-4460-a6e4-5ff05cdbac50 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:15.553795 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 926/1855] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:15.553795 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4b831-978d-4025-8ec1-8553f80a2a3b None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:15.553795 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4b831-978d-4025-8ec1-8553f80a2a3b None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:15.553795 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4b831-978d-4025-8ec1-8553f80a2a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:15.566499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e87b1a-15b5-4bd7-b1d8-b3096482b7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:15.567650 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e87b1a-15b5-4bd7-b1d8-b3096482b7d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:15.569771 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e87b1a-15b5-4bd7-b1d8-b3096482b7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:15.570282 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e87b1a-15b5-4bd7-b1d8-b3096482b7d5 admin admin] PATH_INFO: `/v3/projects/b799173fe87b45409f3d450c1d0971a1/users/1221e2bf1e9040dc80f35759d8bb8b2c/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:15.628122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e87b1a-15b5-4bd7-b1d8-b3096482b7d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b799173fe87b45409f3d450c1d0971a1, user_id=1221e2bf1e9040dc80f35759d8bb8b2c, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:15.630523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-d9f4b831-978d-4025-8ec1-8553f80a2a3b None None] MFA Rules not processed for user `e7a5004673cc4660b426739b280a8fca`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:15.635162 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e87b1a-15b5-4bd7-b1d8-b3096482b7d5 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:15.635367 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d9f4b831-978d-4025-8ec1-8553f80a2a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:15.665180 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:15.700458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 930/1856] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:15 2022] PUT /identity/v3/projects/b799173fe87b45409f3d450c1d0971a1/users/1221e2bf1e9040dc80f35759d8bb8b2c/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:15.702099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e87b1a-15b5-4bd7-b1d8-b3096482b7d5 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:15.824267 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 927/1857] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:15 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:15.830648 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c237570-f062-4464-af0a-7b08d1b4ac7e None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:15.831441 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c237570-f062-4464-af0a-7b08d1b4ac7e None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:15.831837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c237570-f062-4464-af0a-7b08d1b4ac7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:15.847213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e87b1a-15b5-4bd7-b1d8-b3096482b7d5 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:15.853120 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec44da-473e-4262-91c4-36d8ef6ec8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:15.853885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec44da-473e-4262-91c4-36d8ef6ec8db admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:15.854243 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec44da-473e-4262-91c4-36d8ef6ec8db admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:15.854589 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec44da-473e-4262-91c4-36d8ef6ec8db admin admin] PATH_INFO: `/v3/projects/958f2dff89434245924ac082360d39b7/users/02b59eded3d244b8b2313da501595af8/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:15.874788 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec44da-473e-4262-91c4-36d8ef6ec8db admin admin] RBAC: Authorizing `identity:create_grant(project_id=958f2dff89434245924ac082360d39b7, user_id=02b59eded3d244b8b2313da501595af8, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:15.878587 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec44da-473e-4262-91c4-36d8ef6ec8db admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:15.897846 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:15.901165 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-6c237570-f062-4464-af0a-7b08d1b4ac7e None None] MFA Rules not processed for user `1221e2bf1e9040dc80f35759d8bb8b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:15.903986 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-6c237570-f062-4464-af0a-7b08d1b4ac7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:15.908283 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 931/1858] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:15 2022] PUT /identity/v3/projects/958f2dff89434245924ac082360d39b7/users/02b59eded3d244b8b2313da501595af8/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:15.909131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec44da-473e-4262-91c4-36d8ef6ec8db admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:15.914670 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-80ec44da-473e-4262-91c4-36d8ef6ec8db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:16.034936 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 928/1859] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:16.034936 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf8c1e-7d3a-430a-92e2-2abac4c56a02 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:16.034936 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf8c1e-7d3a-430a-92e2-2abac4c56a02 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:16.034936 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf8c1e-7d3a-430a-92e2-2abac4c56a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:16.041798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec44da-473e-4262-91c4-36d8ef6ec8db admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:16.050233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d24465-42f1-44be-8640-ccc71bad3c96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:16.051624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d24465-42f1-44be-8640-ccc71bad3c96 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:16.051624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d24465-42f1-44be-8640-ccc71bad3c96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:16.051624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d24465-42f1-44be-8640-ccc71bad3c96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:16.080603 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-2baf8c1e-7d3a-430a-92e2-2abac4c56a02 None None] MFA Rules not processed for user `02b59eded3d244b8b2313da501595af8`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:16.082666 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-2baf8c1e-7d3a-430a-92e2-2abac4c56a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:16.144515 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d24465-42f1-44be-8640-ccc71bad3c96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:16.147872 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d24465-42f1-44be-8640-ccc71bad3c96 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:16.168286 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 932/1860] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:16.169655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d24465-42f1-44be-8640-ccc71bad3c96 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:16.208809 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 929/1861] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:16.210631 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf8c1e-7d3a-430a-92e2-2abac4c56a02 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:16.268465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:16.294175 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d24465-42f1-44be-8640-ccc71bad3c96 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:16.299764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cb93a-42ea-4f2b-9588-6800b80d4b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:16.300435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cb93a-42ea-4f2b-9588-6800b80d4b1e admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:16.300785 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cb93a-42ea-4f2b-9588-6800b80d4b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:16.301138 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cb93a-42ea-4f2b-9588-6800b80d4b1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:16.303514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cb93a-42ea-4f2b-9588-6800b80d4b1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:16.306641 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cb93a-42ea-4f2b-9588-6800b80d4b1e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:16.319523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf8c1e-7d3a-430a-92e2-2abac4c56a02 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:16.328023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c68dc6-0db1-48b2-bbf8-dd78f43a6efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:16.328658 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c68dc6-0db1-48b2-bbf8-dd78f43a6efe admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:16.328938 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c68dc6-0db1-48b2-bbf8-dd78f43a6efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:16.329207 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c68dc6-0db1-48b2-bbf8-dd78f43a6efe admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:16.329905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c68dc6-0db1-48b2-bbf8-dd78f43a6efe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:16.331955 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c68dc6-0db1-48b2-bbf8-dd78f43a6efe admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:16.363550 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 933/1862] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:16 2022] POST /identity/v3/projects => generated 379 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:16.369984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cb93a-42ea-4f2b-9588-6800b80d4b1e admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:16.378033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 930/1863] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:16 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:16.382699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c68dc6-0db1-48b2-bbf8-dd78f43a6efe admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:16.431598 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:16.463315 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cb93a-42ea-4f2b-9588-6800b80d4b1e admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:16.512236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c68dc6-0db1-48b2-bbf8-dd78f43a6efe admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:16.530444 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdbf54-ca56-4c69-ad2b-9277bbf09634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:16.530444 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdbf54-ca56-4c69-ad2b-9277bbf09634 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:16.530444 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdbf54-ca56-4c69-ad2b-9277bbf09634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:16.530444 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdbf54-ca56-4c69-ad2b-9277bbf09634 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:16.530901 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdbf54-ca56-4c69-ad2b-9277bbf09634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:16.534412 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdbf54-ca56-4c69-ad2b-9277bbf09634 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:16.568359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 931/1864] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:16 2022] POST /identity/v3/users => generated 295 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:16.577655 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdbf54-ca56-4c69-ad2b-9277bbf09634 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:16.582863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ff4c8-a831-4f16-b099-f854775e7343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:16.583909 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ff4c8-a831-4f16-b099-f854775e7343 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:16.584393 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ff4c8-a831-4f16-b099-f854775e7343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:16.584827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ff4c8-a831-4f16-b099-f854775e7343 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:16.586306 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ff4c8-a831-4f16-b099-f854775e7343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:16.592628 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ff4c8-a831-4f16-b099-f854775e7343 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:16.596915 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdbf54-ca56-4c69-ad2b-9277bbf09634 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:16.604286 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f9449-3cac-4ed0-9158-70473f80b8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:16.605364 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f9449-3cac-4ed0-9158-70473f80b8aa admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:16.605966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f9449-3cac-4ed0-9158-70473f80b8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:16.606509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f9449-3cac-4ed0-9158-70473f80b8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:16.607578 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f9449-3cac-4ed0-9158-70473f80b8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:16.610663 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f9449-3cac-4ed0-9158-70473f80b8aa admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:16.631688 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 932/1865] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:16.637462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f9449-3cac-4ed0-9158-70473f80b8aa admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:16.644801 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 934/1866] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:16 2022] POST /identity/v3/users => generated 296 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:16.649072 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ff4c8-a831-4f16-b099-f854775e7343 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:16.650552 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f9449-3cac-4ed0-9158-70473f80b8aa admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:16.662410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa1fdd-e8a5-4abf-977c-f594ff4e1e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:16.663256 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa1fdd-e8a5-4abf-977c-f594ff4e1e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:16.663528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa1fdd-e8a5-4abf-977c-f594ff4e1e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:16.663829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa1fdd-e8a5-4abf-977c-f594ff4e1e52 admin admin] PATH_INFO: `/v3/projects/c320fd5850e746648f7f2863f16af4c1/users/b25f02cd450b477d8c4d099bd2631cc4/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:16.665580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ff4c8-a831-4f16-b099-f854775e7343 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:16.672675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd01249-e203-4174-bfea-dc96a0f8acfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:16.673375 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd01249-e203-4174-bfea-dc96a0f8acfd admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:16.673656 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd01249-e203-4174-bfea-dc96a0f8acfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:16.673928 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd01249-e203-4174-bfea-dc96a0f8acfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:16.674583 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd01249-e203-4174-bfea-dc96a0f8acfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:16.676947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd01249-e203-4174-bfea-dc96a0f8acfd admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:16.681395 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa1fdd-e8a5-4abf-977c-f594ff4e1e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c320fd5850e746648f7f2863f16af4c1, user_id=b25f02cd450b477d8c4d099bd2631cc4, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:16.685024 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa1fdd-e8a5-4abf-977c-f594ff4e1e52 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:16.688874 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 935/1867] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:16.697121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd01249-e203-4174-bfea-dc96a0f8acfd admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:16.704248 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 933/1868] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:16 2022] PUT /identity/v3/projects/c320fd5850e746648f7f2863f16af4c1/users/b25f02cd450b477d8c4d099bd2631cc4/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:16.709065 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa1fdd-e8a5-4abf-977c-f594ff4e1e52 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:16.715217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd01249-e203-4174-bfea-dc96a0f8acfd admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:16.812643 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa1fdd-e8a5-4abf-977c-f594ff4e1e52 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:16.817361 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d3866-dcae-42e6-95ac-7d5f7b8c2c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:16.818445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3bb4f-320a-4079-83af-040922e1fc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:16.818980 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d3866-dcae-42e6-95ac-7d5f7b8c2c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:16.819088 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3bb4f-320a-4079-83af-040922e1fc3a admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:16.819326 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3bb4f-320a-4079-83af-040922e1fc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:16.819596 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3bb4f-320a-4079-83af-040922e1fc3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:16.819979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d3866-dcae-42e6-95ac-7d5f7b8c2c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:16.820396 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3bb4f-320a-4079-83af-040922e1fc3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:16.820498 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d3866-dcae-42e6-95ac-7d5f7b8c2c62 admin admin] PATH_INFO: `/v3/projects/bcf33dacae9340c980ce445f9bf3e63a/users/a9b0ac8412554141ae66e36b2002e21f/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:16.822004 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3bb4f-320a-4079-83af-040922e1fc3a admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:16.830085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:16.835668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 934/1869] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:16.842813 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3bb4f-320a-4079-83af-040922e1fc3a admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:16.849255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d3866-dcae-42e6-95ac-7d5f7b8c2c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf33dacae9340c980ce445f9bf3e63a, user_id=a9b0ac8412554141ae66e36b2002e21f, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:16.852043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d3866-dcae-42e6-95ac-7d5f7b8c2c62 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:16.854658 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3bb4f-320a-4079-83af-040922e1fc3a admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:16.862411 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f130cb9-bef5-4be2-8398-a67bcedf5cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:16.863888 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f130cb9-bef5-4be2-8398-a67bcedf5cab admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:16.864299 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f130cb9-bef5-4be2-8398-a67bcedf5cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:16.864674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f130cb9-bef5-4be2-8398-a67bcedf5cab admin admin] PATH_INFO: `/v3/projects/c320fd5850e746648f7f2863f16af4c1/users/b25f02cd450b477d8c4d099bd2631cc4/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:16.867051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f130cb9-bef5-4be2-8398-a67bcedf5cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c320fd5850e746648f7f2863f16af4c1, user_id=b25f02cd450b477d8c4d099bd2631cc4, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:16.870394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f130cb9-bef5-4be2-8398-a67bcedf5cab admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:16.871634 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 936/1870] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:16 2022] PUT /identity/v3/projects/bcf33dacae9340c980ce445f9bf3e63a/users/a9b0ac8412554141ae66e36b2002e21f/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:16.876236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d3866-dcae-42e6-95ac-7d5f7b8c2c62 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:16.888287 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 935/1871] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:16 2022] PUT /identity/v3/projects/c320fd5850e746648f7f2863f16af4c1/users/b25f02cd450b477d8c4d099bd2631cc4/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:16.899571 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31faa53-84fb-420d-9e94-e17e6db4f90c None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:16.899930 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31faa53-84fb-420d-9e94-e17e6db4f90c None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:16.900694 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31faa53-84fb-420d-9e94-e17e6db4f90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:16.935120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-a31faa53-84fb-420d-9e94-e17e6db4f90c None None] MFA Rules not processed for user `b25f02cd450b477d8c4d099bd2631cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:16.936669 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a31faa53-84fb-420d-9e94-e17e6db4f90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:16.940459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:16.970073 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d3866-dcae-42e6-95ac-7d5f7b8c2c62 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:17.059659 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa7120-3ffa-47e6-be9c-2234c1cb29e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:17.060618 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa7120-3ffa-47e6-be9c-2234c1cb29e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:17.060955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa7120-3ffa-47e6-be9c-2234c1cb29e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:17.061301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa7120-3ffa-47e6-be9c-2234c1cb29e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:17.062015 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa7120-3ffa-47e6-be9c-2234c1cb29e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:17.064027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa7120-3ffa-47e6-be9c-2234c1cb29e4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:17.064462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 936/1872] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:17.078952 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 937/1873] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:17.082410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31faa53-84fb-420d-9e94-e17e6db4f90c None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:17.083924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a31faa53-84fb-420d-9e94-e17e6db4f90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:17.084615 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa7120-3ffa-47e6-be9c-2234c1cb29e4 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:17.101855 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa7120-3ffa-47e6-be9c-2234c1cb29e4 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:17.138088 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb4916-9c9f-4253-b029-28d46334a89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:17.138991 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb4916-9c9f-4253-b029-28d46334a89f admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:17.139201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb4916-9c9f-4253-b029-28d46334a89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:17.139469 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb4916-9c9f-4253-b029-28d46334a89f admin admin] PATH_INFO: `/v3/projects/bcf33dacae9340c980ce445f9bf3e63a/users/a9b0ac8412554141ae66e36b2002e21f/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:17.141689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb4916-9c9f-4253-b029-28d46334a89f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf33dacae9340c980ce445f9bf3e63a, user_id=a9b0ac8412554141ae66e36b2002e21f, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:17.145379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb4916-9c9f-4253-b029-28d46334a89f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:17.160997 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 938/1874] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:17 2022] PUT /identity/v3/projects/bcf33dacae9340c980ce445f9bf3e63a/users/a9b0ac8412554141ae66e36b2002e21f/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:17.176245 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b7105-f554-45e0-9f33-11c57a324cb0 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:17.176677 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b7105-f554-45e0-9f33-11c57a324cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:17.176912 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b7105-f554-45e0-9f33-11c57a324cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:17.242915 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-237b7105-f554-45e0-9f33-11c57a324cb0 None None] MFA Rules not processed for user `a9b0ac8412554141ae66e36b2002e21f`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:17.248292 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-237b7105-f554-45e0-9f33-11c57a324cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:17.248533 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31faa53-84fb-420d-9e94-e17e6db4f90c None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:17.336139 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08b72b-a189-4101-b5f7-0d36811a0c8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:17.338430 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08b72b-a189-4101-b5f7-0d36811a0c8e service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:17.338858 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08b72b-a189-4101-b5f7-0d36811a0c8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:17.339088 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08b72b-a189-4101-b5f7-0d36811a0c8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:17.447001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 939/1875] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:17.463045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:17.513279 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b7105-f554-45e0-9f33-11c57a324cb0 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:17.525743 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b7105-f554-45e0-9f33-11c57a324cb0 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:17.527909 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08b72b-a189-4101-b5f7-0d36811a0c8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:17.531691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08b72b-a189-4101-b5f7-0d36811a0c8e service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:17.538119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bda09c-2ad4-4695-9e75-e6dd76083fb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:17.538761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bda09c-2ad4-4695-9e75-e6dd76083fb8 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:17.539036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bda09c-2ad4-4695-9e75-e6dd76083fb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:17.539316 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bda09c-2ad4-4695-9e75-e6dd76083fb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:17.554847 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 937/1876] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:17.556361 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bda09c-2ad4-4695-9e75-e6dd76083fb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:17.557839 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bda09c-2ad4-4695-9e75-e6dd76083fb8 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:17.582681 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 940/1877] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:17.671489 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08b72b-a189-4101-b5f7-0d36811a0c8e service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:17.686218 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08b72b-a189-4101-b5f7-0d36811a0c8e service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:17.707190 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b013f-68dd-4866-b1a3-a35fe518be4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:17.707190 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b013f-68dd-4866-b1a3-a35fe518be4a service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:17.707190 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b013f-68dd-4866-b1a3-a35fe518be4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:17.707190 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b013f-68dd-4866-b1a3-a35fe518be4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:17.805310 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b013f-68dd-4866-b1a3-a35fe518be4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:17.806344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b013f-68dd-4866-b1a3-a35fe518be4a service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:17.840305 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 938/1878] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:18.799298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bda09c-2ad4-4695-9e75-e6dd76083fb8 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:18.893218 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:18.911280 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bda09c-2ad4-4695-9e75-e6dd76083fb8 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:18.917572 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb73a60-05fb-4875-98ac-0b67e1a284b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:18.919461 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb73a60-05fb-4875-98ac-0b67e1a284b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:18.920155 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb73a60-05fb-4875-98ac-0b67e1a284b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:18.920746 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb73a60-05fb-4875-98ac-0b67e1a284b7 admin admin] PATH_INFO: `/v3/users/1221e2bf1e9040dc80f35759d8bb8b2c` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:18.923071 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb73a60-05fb-4875-98ac-0b67e1a284b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1221e2bf1e9040dc80f35759d8bb8b2c)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:18.926258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb73a60-05fb-4875-98ac-0b67e1a284b7 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:19.059563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ceb73a60-05fb-4875-98ac-0b67e1a284b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1221e2bf1e9040dc80f35759d8bb8b2c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:19.060329 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ceb73a60-05fb-4875-98ac-0b67e1a284b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1221e2bf1e9040dc80f35759d8bb8b2c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:19.077180 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ceb73a60-05fb-4875-98ac-0b67e1a284b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1221e2bf1e9040dc80f35759d8bb8b2c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:19.099960 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ceb73a60-05fb-4875-98ac-0b67e1a284b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1221e2bf1e9040dc80f35759d8bb8b2c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:19.122248 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ceb73a60-05fb-4875-98ac-0b67e1a284b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1221e2bf1e9040dc80f35759d8bb8b2c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:19.132507 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 941/1879] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:18 2022] DELETE /identity/v3/users/1221e2bf1e9040dc80f35759d8bb8b2c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:19.134791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eeb3a-30c5-4b7c-8af2-6454a8650032 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:19.135247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eeb3a-30c5-4b7c-8af2-6454a8650032 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:19.135600 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eeb3a-30c5-4b7c-8af2-6454a8650032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:19.159491 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-7e8eeb3a-30c5-4b7c-8af2-6454a8650032 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:19.161055 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-7e8eeb3a-30c5-4b7c-8af2-6454a8650032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:19.211252 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb73a60-05fb-4875-98ac-0b67e1a284b7 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:19.214056 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ceb73a60-05fb-4875-98ac-0b67e1a284b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:19.287796 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 939/1880] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:19.298237 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8eeb3a-30c5-4b7c-8af2-6454a8650032 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:19.302448 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-7e8eeb3a-30c5-4b7c-8af2-6454a8650032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:19.355884 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb73a60-05fb-4875-98ac-0b67e1a284b7 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:19.366545 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa761588-7a23-4442-a5a5-80ac2794b05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:19.367937 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa761588-7a23-4442-a5a5-80ac2794b05c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:19.368774 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa761588-7a23-4442-a5a5-80ac2794b05c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:19.369222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa761588-7a23-4442-a5a5-80ac2794b05c admin admin] PATH_INFO: `/v3/users/7ae37cfb127b43a89633c91d6e511687` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:19.371958 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa761588-7a23-4442-a5a5-80ac2794b05c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ae37cfb127b43a89633c91d6e511687)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:19.376926 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa761588-7a23-4442-a5a5-80ac2794b05c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:19.386612 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8eeb3a-30c5-4b7c-8af2-6454a8650032 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:19.390760 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990d487-2230-4080-9aae-0c2dc60cd4f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:19.391378 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990d487-2230-4080-9aae-0c2dc60cd4f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:19.391676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990d487-2230-4080-9aae-0c2dc60cd4f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:19.392151 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990d487-2230-4080-9aae-0c2dc60cd4f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:19.404127 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990d487-2230-4080-9aae-0c2dc60cd4f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:19.405909 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990d487-2230-4080-9aae-0c2dc60cd4f8 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:19.421637 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 940/1881] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:30:19.442904 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-aa761588-7a23-4442-a5a5-80ac2794b05c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ae37cfb127b43a89633c91d6e511687'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:19.444605 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-aa761588-7a23-4442-a5a5-80ac2794b05c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ae37cfb127b43a89633c91d6e511687'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:19.457870 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-aa761588-7a23-4442-a5a5-80ac2794b05c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ae37cfb127b43a89633c91d6e511687'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:19.477909 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:19.482495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-aa761588-7a23-4442-a5a5-80ac2794b05c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ae37cfb127b43a89633c91d6e511687'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:19.502741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-aa761588-7a23-4442-a5a5-80ac2794b05c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ae37cfb127b43a89633c91d6e511687'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:19.521165 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 942/1882] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:19 2022] DELETE /identity/v3/users/7ae37cfb127b43a89633c91d6e511687 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:30:19.531143 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b3c96-8e89-4234-aac5-60bc2c22f247 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:19.531143 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b3c96-8e89-4234-aac5-60bc2c22f247 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:19.531143 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b3c96-8e89-4234-aac5-60bc2c22f247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:19.565456 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-e18b3c96-8e89-4234-aac5-60bc2c22f247 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:19.579651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e18b3c96-8e89-4234-aac5-60bc2c22f247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:19.606528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:19.718836 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 941/1883] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:19.800556 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa761588-7a23-4442-a5a5-80ac2794b05c admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:19.804078 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-aa761588-7a23-4442-a5a5-80ac2794b05c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:19.907295 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa761588-7a23-4442-a5a5-80ac2794b05c admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:19.918691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366eeec-8db9-4d9d-8790-67ad8a8af61d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:19.920779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366eeec-8db9-4d9d-8790-67ad8a8af61d service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:19.920950 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366eeec-8db9-4d9d-8790-67ad8a8af61d service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:19.921444 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366eeec-8db9-4d9d-8790-67ad8a8af61d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:19.936598 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366eeec-8db9-4d9d-8790-67ad8a8af61d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:19.938476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366eeec-8db9-4d9d-8790-67ad8a8af61d service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:19.956578 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 943/1884] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:30:20.492326 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10163d-5c28-4ace-91a7-197db127ccf7 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:20.492869 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10163d-5c28-4ace-91a7-197db127ccf7 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:20.492869 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10163d-5c28-4ace-91a7-197db127ccf7 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:20.494651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 942/1885] 10.222.0.62 () {54 vars in 921 bytes} [Tue Oct 4 14:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:30:20.511214 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842357e-0380-44d7-afe6-25a13837899f None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:20.512092 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842357e-0380-44d7-afe6-25a13837899f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:20.512547 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842357e-0380-44d7-afe6-25a13837899f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:20.559666 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-1842357e-0380-44d7-afe6-25a13837899f None None] MFA Rules not processed for user `151e7b9c7a7b46d58dc2f563d05775e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:20.575107 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1842357e-0380-44d7-afe6-25a13837899f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:20.734365 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10163d-5c28-4ace-91a7-197db127ccf7 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:20.736356 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-8a10163d-5c28-4ace-91a7-197db127ccf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:20.738244 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 944/1886] 10.222.0.62 () {58 vars in 1018 bytes} [Tue Oct 4 14:30:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:20.762646 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10163d-5c28-4ace-91a7-197db127ccf7 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:20.768697 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ada82-03b2-4ef9-93c6-1f46b688497b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:20.769667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ada82-03b2-4ef9-93c6-1f46b688497b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:20.777664 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ada82-03b2-4ef9-93c6-1f46b688497b admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:20.778059 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ada82-03b2-4ef9-93c6-1f46b688497b admin admin] PATH_INFO: `/v3/projects/b799173fe87b45409f3d450c1d0971a1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:20.780732 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ada82-03b2-4ef9-93c6-1f46b688497b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b799173fe87b45409f3d450c1d0971a1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:20.782862 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ada82-03b2-4ef9-93c6-1f46b688497b admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:20.848249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842357e-0380-44d7-afe6-25a13837899f None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:20.849722 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1842357e-0380-44d7-afe6-25a13837899f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:20.872083 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842357e-0380-44d7-afe6-25a13837899f None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:20.884518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-775ada82-03b2-4ef9-93c6-1f46b688497b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b799173fe87b45409f3d450c1d0971a1', 'request_id': 'req-775ada82-03b2-4ef9-93c6-1f46b688497b'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:20.894058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-775ada82-03b2-4ef9-93c6-1f46b688497b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b799173fe87b45409f3d450c1d0971a1', 'request_id': 'req-775ada82-03b2-4ef9-93c6-1f46b688497b'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:20.904065 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-775ada82-03b2-4ef9-93c6-1f46b688497b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b799173fe87b45409f3d450c1d0971a1', 'request_id': 'req-775ada82-03b2-4ef9-93c6-1f46b688497b'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:20.931680 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-775ada82-03b2-4ef9-93c6-1f46b688497b admin admin] The token cache is being invalidate because project b799173fe87b45409f3d450c1d0971a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:20.931680 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-775ada82-03b2-4ef9-93c6-1f46b688497b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:20.932550 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-775ada82-03b2-4ef9-93c6-1f46b688497b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:20.936843 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 943/1887] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:20 2022] DELETE /identity/v3/projects/b799173fe87b45409f3d450c1d0971a1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:30:20.941333 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ada82-03b2-4ef9-93c6-1f46b688497b admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:20.944261 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-775ada82-03b2-4ef9-93c6-1f46b688497b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:20.992427 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd09a8-e6af-4be9-a435-c88ae108e25d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:20.993265 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd09a8-e6af-4be9-a435-c88ae108e25d service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:20.993555 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd09a8-e6af-4be9-a435-c88ae108e25d service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:20.993892 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd09a8-e6af-4be9-a435-c88ae108e25d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:20.996727 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1edd09a8-e6af-4be9-a435-c88ae108e25d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:21.015758 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd09a8-e6af-4be9-a435-c88ae108e25d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:21.018271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd09a8-e6af-4be9-a435-c88ae108e25d service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:21.034890 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 945/1888] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:21.045907 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ada82-03b2-4ef9-93c6-1f46b688497b admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:21.053659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d06bf7-6620-4ff4-84d9-2362fc874312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:21.054557 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d06bf7-6620-4ff4-84d9-2362fc874312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:21.054940 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d06bf7-6620-4ff4-84d9-2362fc874312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:21.055294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d06bf7-6620-4ff4-84d9-2362fc874312 admin admin] PATH_INFO: `/v3/users/a9b0ac8412554141ae66e36b2002e21f` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:21.059472 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d06bf7-6620-4ff4-84d9-2362fc874312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9b0ac8412554141ae66e36b2002e21f)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:21.062607 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d06bf7-6620-4ff4-84d9-2362fc874312 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:21.129773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:21.132580 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-43d06bf7-6620-4ff4-84d9-2362fc874312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9b0ac8412554141ae66e36b2002e21f'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:21.133699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-43d06bf7-6620-4ff4-84d9-2362fc874312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9b0ac8412554141ae66e36b2002e21f'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:21.161633 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd09a8-e6af-4be9-a435-c88ae108e25d service nova] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:21.162318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-43d06bf7-6620-4ff4-84d9-2362fc874312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9b0ac8412554141ae66e36b2002e21f'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:21.163757 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1edd09a8-e6af-4be9-a435-c88ae108e25d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:21.177614 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-43d06bf7-6620-4ff4-84d9-2362fc874312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9b0ac8412554141ae66e36b2002e21f'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:21.188819 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:21.195860 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-43d06bf7-6620-4ff4-84d9-2362fc874312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9b0ac8412554141ae66e36b2002e21f'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:21.198322 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd09a8-e6af-4be9-a435-c88ae108e25d service nova] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:21.208544 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 944/1889] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:20 2022] DELETE /identity/v3/users/a9b0ac8412554141ae66e36b2002e21f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:30:21.215264 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2b633-234e-47bd-9386-4e33bcade093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:21.216413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2b633-234e-47bd-9386-4e33bcade093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:21.217010 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2b633-234e-47bd-9386-4e33bcade093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:21.217519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2b633-234e-47bd-9386-4e33bcade093 admin admin] PATH_INFO: `/v3/projects/efe4ad0688934010be2c45b84a379970` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:21.219472 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2b633-234e-47bd-9386-4e33bcade093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efe4ad0688934010be2c45b84a379970)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:21.222834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2b633-234e-47bd-9386-4e33bcade093 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:21.323319 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b0b2b633-234e-47bd-9386-4e33bcade093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efe4ad0688934010be2c45b84a379970', 'request_id': 'req-b0b2b633-234e-47bd-9386-4e33bcade093'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:21.351235 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b0b2b633-234e-47bd-9386-4e33bcade093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efe4ad0688934010be2c45b84a379970', 'request_id': 'req-b0b2b633-234e-47bd-9386-4e33bcade093'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:21.362203 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b0b2b633-234e-47bd-9386-4e33bcade093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efe4ad0688934010be2c45b84a379970', 'request_id': 'req-b0b2b633-234e-47bd-9386-4e33bcade093'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:21.387632 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b0b2b633-234e-47bd-9386-4e33bcade093 admin admin] The token cache is being invalidate because project efe4ad0688934010be2c45b84a379970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:21.388214 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b0b2b633-234e-47bd-9386-4e33bcade093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:21.389444 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b0b2b633-234e-47bd-9386-4e33bcade093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:21.391670 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 946/1890] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:21 2022] DELETE /identity/v3/projects/efe4ad0688934010be2c45b84a379970 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:21.396587 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d06bf7-6620-4ff4-84d9-2362fc874312 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:21.398831 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-43d06bf7-6620-4ff4-84d9-2362fc874312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:21.429642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2b633-234e-47bd-9386-4e33bcade093 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:21.432019 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b0b2b633-234e-47bd-9386-4e33bcade093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:21.516926 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2b633-234e-47bd-9386-4e33bcade093 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:21.522484 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f159915-1e41-4b3c-88bb-246c0c7ffe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:21.523278 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f159915-1e41-4b3c-88bb-246c0c7ffe0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:21.523563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f159915-1e41-4b3c-88bb-246c0c7ffe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:21.523877 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f159915-1e41-4b3c-88bb-246c0c7ffe0b admin admin] PATH_INFO: `/v3/users/3fcfd90069f24bb1aa75df2a701a6879` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:21.528470 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f159915-1e41-4b3c-88bb-246c0c7ffe0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fcfd90069f24bb1aa75df2a701a6879)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:21.530791 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f159915-1e41-4b3c-88bb-246c0c7ffe0b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:21.568514 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d06bf7-6620-4ff4-84d9-2362fc874312 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:21.576094 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95fea7-9403-4400-b3bb-d21c2af27130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:21.576858 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95fea7-9403-4400-b3bb-d21c2af27130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:21.577281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95fea7-9403-4400-b3bb-d21c2af27130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:21.577789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95fea7-9403-4400-b3bb-d21c2af27130 admin admin] PATH_INFO: `/v3/users/e7a5004673cc4660b426739b280a8fca` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:21.579092 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95fea7-9403-4400-b3bb-d21c2af27130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7a5004673cc4660b426739b280a8fca)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:21.581368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95fea7-9403-4400-b3bb-d21c2af27130 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:21.594186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4f159915-1e41-4b3c-88bb-246c0c7ffe0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fcfd90069f24bb1aa75df2a701a6879'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:21.594895 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4f159915-1e41-4b3c-88bb-246c0c7ffe0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fcfd90069f24bb1aa75df2a701a6879'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:21.609582 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4f159915-1e41-4b3c-88bb-246c0c7ffe0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fcfd90069f24bb1aa75df2a701a6879'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:21.632558 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4f159915-1e41-4b3c-88bb-246c0c7ffe0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fcfd90069f24bb1aa75df2a701a6879'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:21.641947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4f159915-1e41-4b3c-88bb-246c0c7ffe0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fcfd90069f24bb1aa75df2a701a6879'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:21.652984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 947/1891] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:21 2022] DELETE /identity/v3/users/3fcfd90069f24bb1aa75df2a701a6879 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:21.658579 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f159915-1e41-4b3c-88bb-246c0c7ffe0b admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:21.661295 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4f159915-1e41-4b3c-88bb-246c0c7ffe0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:21.666495 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-6c95fea7-9403-4400-b3bb-d21c2af27130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7a5004673cc4660b426739b280a8fca'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:21.667594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-6c95fea7-9403-4400-b3bb-d21c2af27130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7a5004673cc4660b426739b280a8fca'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:21.684800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:21.691222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-6c95fea7-9403-4400-b3bb-d21c2af27130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7a5004673cc4660b426739b280a8fca'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:21.701743 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-6c95fea7-9403-4400-b3bb-d21c2af27130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7a5004673cc4660b426739b280a8fca'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:21.714897 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-6c95fea7-9403-4400-b3bb-d21c2af27130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7a5004673cc4660b426739b280a8fca'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:21.723546 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 945/1892] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:21 2022] DELETE /identity/v3/users/e7a5004673cc4660b426739b280a8fca => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:30:21.726488 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a70a06-bfb8-464b-8442-06c84816a639 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:21.727148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a70a06-bfb8-464b-8442-06c84816a639 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:21.727733 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a70a06-bfb8-464b-8442-06c84816a639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:21.766016 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-09a70a06-bfb8-464b-8442-06c84816a639 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:21.768381 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-09a70a06-bfb8-464b-8442-06c84816a639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:21.776517 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f159915-1e41-4b3c-88bb-246c0c7ffe0b admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:21.841101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:21.874714 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fce44-56f8-4b4a-b400-a574386def99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:21.876047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fce44-56f8-4b4a-b400-a574386def99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:21.876739 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fce44-56f8-4b4a-b400-a574386def99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:21.877239 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fce44-56f8-4b4a-b400-a574386def99 admin admin] PATH_INFO: `/v3/projects/bcf33dacae9340c980ce445f9bf3e63a` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:21.878575 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8fce44-56f8-4b4a-b400-a574386def99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf33dacae9340c980ce445f9bf3e63a)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:21.879599 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 946/1893] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:21.880981 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8fce44-56f8-4b4a-b400-a574386def99 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:21.897280 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a70a06-bfb8-464b-8442-06c84816a639 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:21.899469 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-09a70a06-bfb8-464b-8442-06c84816a639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:21.983241 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-1b8fce44-56f8-4b4a-b400-a574386def99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf33dacae9340c980ce445f9bf3e63a', 'request_id': 'req-1b8fce44-56f8-4b4a-b400-a574386def99'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:22.008700 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-1b8fce44-56f8-4b4a-b400-a574386def99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf33dacae9340c980ce445f9bf3e63a', 'request_id': 'req-1b8fce44-56f8-4b4a-b400-a574386def99'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:22.026331 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-1b8fce44-56f8-4b4a-b400-a574386def99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf33dacae9340c980ce445f9bf3e63a', 'request_id': 'req-1b8fce44-56f8-4b4a-b400-a574386def99'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:22.049602 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a70a06-bfb8-464b-8442-06c84816a639 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:22.052795 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-1b8fce44-56f8-4b4a-b400-a574386def99 admin admin] The token cache is being invalidate because project bcf33dacae9340c980ce445f9bf3e63a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:22.053714 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-1b8fce44-56f8-4b4a-b400-a574386def99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:22.053869 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-1b8fce44-56f8-4b4a-b400-a574386def99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:22.059770 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 948/1894] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:21 2022] DELETE /identity/v3/projects/bcf33dacae9340c980ce445f9bf3e63a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:22.062858 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc7587-819d-43d8-b71f-b1a0313ca104 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:22.063374 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc7587-819d-43d8-b71f-b1a0313ca104 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:22.063852 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc7587-819d-43d8-b71f-b1a0313ca104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:22.097367 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-55cc7587-819d-43d8-b71f-b1a0313ca104 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:22.098800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-55cc7587-819d-43d8-b71f-b1a0313ca104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:22.156645 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82f073-bd15-42ae-aa70-df93c31b4d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:22.157316 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82f073-bd15-42ae-aa70-df93c31b4d54 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:22.157657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82f073-bd15-42ae-aa70-df93c31b4d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:22.157880 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82f073-bd15-42ae-aa70-df93c31b4d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:22.160051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-6e82f073-bd15-42ae-aa70-df93c31b4d54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:22.166989 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:22.199411 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 949/1895] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:22.200590 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc7587-819d-43d8-b71f-b1a0313ca104 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:22.202694 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-55cc7587-819d-43d8-b71f-b1a0313ca104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:22.218571 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc7587-819d-43d8-b71f-b1a0313ca104 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:22.226714 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62800d03-0555-40a0-b0a7-fd49b6a96ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:22.227943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62800d03-0555-40a0-b0a7-fd49b6a96ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:22.228400 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62800d03-0555-40a0-b0a7-fd49b6a96ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:22.228800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62800d03-0555-40a0-b0a7-fd49b6a96ab7 admin admin] PATH_INFO: `/v3/projects/0b53fbec646a43058a0817d40ac5d3b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:22.231450 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62800d03-0555-40a0-b0a7-fd49b6a96ab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b53fbec646a43058a0817d40ac5d3b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:22.234099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62800d03-0555-40a0-b0a7-fd49b6a96ab7 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:22.259682 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82f073-bd15-42ae-aa70-df93c31b4d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:22.262499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82f073-bd15-42ae-aa70-df93c31b4d54 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:22.273931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 947/1896] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:22.275146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86237e1a-bca4-44fc-848a-3433297957e1 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:22.275434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86237e1a-bca4-44fc-848a-3433297957e1 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:22.275912 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86237e1a-bca4-44fc-848a-3433297957e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:22.313265 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-86237e1a-bca4-44fc-848a-3433297957e1 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:22.315253 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-86237e1a-bca4-44fc-848a-3433297957e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:22.334504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-62800d03-0555-40a0-b0a7-fd49b6a96ab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b53fbec646a43058a0817d40ac5d3b1', 'request_id': 'req-62800d03-0555-40a0-b0a7-fd49b6a96ab7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:22.347162 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-62800d03-0555-40a0-b0a7-fd49b6a96ab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b53fbec646a43058a0817d40ac5d3b1', 'request_id': 'req-62800d03-0555-40a0-b0a7-fd49b6a96ab7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:22.361461 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-62800d03-0555-40a0-b0a7-fd49b6a96ab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b53fbec646a43058a0817d40ac5d3b1', 'request_id': 'req-62800d03-0555-40a0-b0a7-fd49b6a96ab7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:22.390305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-62800d03-0555-40a0-b0a7-fd49b6a96ab7 admin admin] The token cache is being invalidate because project 0b53fbec646a43058a0817d40ac5d3b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:22.392109 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-62800d03-0555-40a0-b0a7-fd49b6a96ab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:22.392876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-62800d03-0555-40a0-b0a7-fd49b6a96ab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:22.398770 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 950/1897] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:22 2022] DELETE /identity/v3/projects/0b53fbec646a43058a0817d40ac5d3b1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:22.402921 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:22.403496 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58a907-548e-4c81-b4fa-bc95a75f9229 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:22.404252 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58a907-548e-4c81-b4fa-bc95a75f9229 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:22.404252 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58a907-548e-4c81-b4fa-bc95a75f9229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:22.427586 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 948/1898] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:22.432897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-3e58a907-548e-4c81-b4fa-bc95a75f9229 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:22.433612 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86237e1a-bca4-44fc-848a-3433297957e1 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:22.434757 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3e58a907-548e-4c81-b4fa-bc95a75f9229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:22.446129 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86237e1a-bca4-44fc-848a-3433297957e1 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:22.449228 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 951/1899] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:30:22.453898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02583d4-6833-4d69-9f53-0c6d5aed740b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:22.454190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02583d4-6833-4d69-9f53-0c6d5aed740b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:22.454463 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02583d4-6833-4d69-9f53-0c6d5aed740b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:22.460843 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838f14f-cacf-4f61-8428-75f2e2a801c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:22.468183 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838f14f-cacf-4f61-8428-75f2e2a801c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:22.468540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838f14f-cacf-4f61-8428-75f2e2a801c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:22.468832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838f14f-cacf-4f61-8428-75f2e2a801c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:22.470518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838f14f-cacf-4f61-8428-75f2e2a801c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:30:22.470836 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838f14f-cacf-4f61-8428-75f2e2a801c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:22.474780 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838f14f-cacf-4f61-8428-75f2e2a801c9 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:22.490311 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 949/1900] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:30:22.494880 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838f14f-cacf-4f61-8428-75f2e2a801c9 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:22.505705 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e02583d4-6833-4d69-9f53-0c6d5aed740b None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:22.507286 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e02583d4-6833-4d69-9f53-0c6d5aed740b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:22.512458 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838f14f-cacf-4f61-8428-75f2e2a801c9 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:22.518290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e61ff-cce8-430f-a908-cb2114dad613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:22.519007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 952/1901] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:22.520123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e61ff-cce8-430f-a908-cb2114dad613 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:22.520892 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e61ff-cce8-430f-a908-cb2114dad613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:22.521314 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e61ff-cce8-430f-a908-cb2114dad613 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:22.522420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e61ff-cce8-430f-a908-cb2114dad613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:22.524224 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02583d4-6833-4d69-9f53-0c6d5aed740b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:22.536852 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e61ff-cce8-430f-a908-cb2114dad613 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:22.537684 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02583d4-6833-4d69-9f53-0c6d5aed740b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:22.543921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96afe9-2b75-4d2f-b928-1493316439fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:22.544892 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96afe9-2b75-4d2f-b928-1493316439fe admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:22.545254 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96afe9-2b75-4d2f-b928-1493316439fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:22.545657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96afe9-2b75-4d2f-b928-1493316439fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:22.546435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96afe9-2b75-4d2f-b928-1493316439fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:30:22.546843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96afe9-2b75-4d2f-b928-1493316439fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:22.548681 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96afe9-2b75-4d2f-b928-1493316439fe admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:22.602131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 953/1902] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:30:22.603503 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96afe9-2b75-4d2f-b928-1493316439fe admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:22.622293 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 950/1903] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:22 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:30:22.629351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e61ff-cce8-430f-a908-cb2114dad613 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:22.631074 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96afe9-2b75-4d2f-b928-1493316439fe admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:22.749788 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5d127-761b-4844-8543-48052d9c2f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:22.750425 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5d127-761b-4844-8543-48052d9c2f5a admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:22.750820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5d127-761b-4844-8543-48052d9c2f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:22.751063 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5d127-761b-4844-8543-48052d9c2f5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:22.751909 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5d127-761b-4844-8543-48052d9c2f5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:22.753967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5d127-761b-4844-8543-48052d9c2f5a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:22.777406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e61ff-cce8-430f-a908-cb2114dad613 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:22.784963 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8033704-7e62-44d8-8d54-5fec21f672b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:22.785590 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8033704-7e62-44d8-8d54-5fec21f672b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:22.785865 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8033704-7e62-44d8-8d54-5fec21f672b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:22.786134 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8033704-7e62-44d8-8d54-5fec21f672b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:22.787181 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8033704-7e62-44d8-8d54-5fec21f672b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:22.790750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8033704-7e62-44d8-8d54-5fec21f672b4 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:22.801030 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 954/1904] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:22 2022] POST /identity/v3/projects => generated 387 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:30:22.801978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5d127-761b-4844-8543-48052d9c2f5a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:22.804200 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-88e5d127-761b-4844-8543-48052d9c2f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:22.827988 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 951/1905] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:22 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:22.827988 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8033704-7e62-44d8-8d54-5fec21f672b4 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:22.839889 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8033704-7e62-44d8-8d54-5fec21f672b4 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:22.845493 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:22.896559 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5d127-761b-4844-8543-48052d9c2f5a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:22.904757 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4201a5-4352-40c2-a735-fe40fe7914f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:22.905457 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4201a5-4352-40c2-a735-fe40fe7914f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:22.905744 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4201a5-4352-40c2-a735-fe40fe7914f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:22.906022 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4201a5-4352-40c2-a735-fe40fe7914f9 admin admin] PATH_INFO: `/v3/projects/9c73ec42d3d04afb8812345dcb74012b` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:22.907180 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4201a5-4352-40c2-a735-fe40fe7914f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c73ec42d3d04afb8812345dcb74012b)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:22.909139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4201a5-4352-40c2-a735-fe40fe7914f9 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:22.926383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de87149-e4a3-443f-b1fb-05202bb9e9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:22.927141 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de87149-e4a3-443f-b1fb-05202bb9e9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:22.927422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de87149-e4a3-443f-b1fb-05202bb9e9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:22.927700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de87149-e4a3-443f-b1fb-05202bb9e9c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:22.928370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de87149-e4a3-443f-b1fb-05202bb9e9c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:22.930726 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de87149-e4a3-443f-b1fb-05202bb9e9c6 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:22.965282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 952/1906] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:22 2022] POST /identity/v3/users => generated 294 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:22.965567 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de87149-e4a3-443f-b1fb-05202bb9e9c6 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:22.973280 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-de4201a5-4352-40c2-a735-fe40fe7914f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c73ec42d3d04afb8812345dcb74012b', 'request_id': 'req-de4201a5-4352-40c2-a735-fe40fe7914f9'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:22.982132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-de4201a5-4352-40c2-a735-fe40fe7914f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c73ec42d3d04afb8812345dcb74012b', 'request_id': 'req-de4201a5-4352-40c2-a735-fe40fe7914f9'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:22.985164 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de87149-e4a3-443f-b1fb-05202bb9e9c6 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:22.993080 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-de4201a5-4352-40c2-a735-fe40fe7914f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c73ec42d3d04afb8812345dcb74012b', 'request_id': 'req-de4201a5-4352-40c2-a735-fe40fe7914f9'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:23.011834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-de4201a5-4352-40c2-a735-fe40fe7914f9 admin admin] The token cache is being invalidate because project 9c73ec42d3d04afb8812345dcb74012b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:23.013955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-de4201a5-4352-40c2-a735-fe40fe7914f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:23.014664 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-de4201a5-4352-40c2-a735-fe40fe7914f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:23.016531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 955/1907] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:22 2022] DELETE /identity/v3/projects/9c73ec42d3d04afb8812345dcb74012b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:23.017666 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4201a5-4352-40c2-a735-fe40fe7914f9 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:23.019740 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-de4201a5-4352-40c2-a735-fe40fe7914f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:23.053511 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:23.087863 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3f3e5-dca0-40f2-b030-adfb60f694c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:23.088472 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3f3e5-dca0-40f2-b030-adfb60f694c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:23.088750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3f3e5-dca0-40f2-b030-adfb60f694c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:23.089045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3f3e5-dca0-40f2-b030-adfb60f694c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:23.090212 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3f3e5-dca0-40f2-b030-adfb60f694c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:23.092001 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3f3e5-dca0-40f2-b030-adfb60f694c6 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:23.102896 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 953/1908] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:23.103552 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3f3e5-dca0-40f2-b030-adfb60f694c6 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:23.106067 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-2ce3f3e5-dca0-40f2-b030-adfb60f694c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:23.117832 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4201a5-4352-40c2-a735-fe40fe7914f9 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:23.126176 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3f3e5-dca0-40f2-b030-adfb60f694c6 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:23.129772 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13e04a-c1e5-4a22-9c84-9bac38498744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:23.130569 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13e04a-c1e5-4a22-9c84-9bac38498744 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:23.130848 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13e04a-c1e5-4a22-9c84-9bac38498744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:23.131114 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13e04a-c1e5-4a22-9c84-9bac38498744 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:23.132642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13e04a-c1e5-4a22-9c84-9bac38498744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:23.133408 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13e04a-c1e5-4a22-9c84-9bac38498744 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:23.149285 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1dbe9-14e8-4e4b-98f4-c771a5d432b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:23.152331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1dbe9-14e8-4e4b-98f4-c771a5d432b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:23.152827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 956/1909] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:23.153009 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1dbe9-14e8-4e4b-98f4-c771a5d432b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:23.153429 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1dbe9-14e8-4e4b-98f4-c771a5d432b0 admin admin] PATH_INFO: `/v3/users/02b59eded3d244b8b2313da501595af8` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:23.154058 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13e04a-c1e5-4a22-9c84-9bac38498744 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:23.156543 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ff13e04a-c1e5-4a22-9c84-9bac38498744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:23.157022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1dbe9-14e8-4e4b-98f4-c771a5d432b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02b59eded3d244b8b2313da501595af8)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:23.161032 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1dbe9-14e8-4e4b-98f4-c771a5d432b0 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:23.180557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13e04a-c1e5-4a22-9c84-9bac38498744 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:23.188718 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a4ba-0422-4fcd-96c3-677707396e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:23.189637 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a4ba-0422-4fcd-96c3-677707396e95 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:23.190012 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a4ba-0422-4fcd-96c3-677707396e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:23.190382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a4ba-0422-4fcd-96c3-677707396e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:23.192117 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08a4ba-0422-4fcd-96c3-677707396e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:23.195354 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08a4ba-0422-4fcd-96c3-677707396e95 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:23.209131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 957/1910] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:23.213350 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a4ba-0422-4fcd-96c3-677707396e95 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:23.231856 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a4ba-0422-4fcd-96c3-677707396e95 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:23.239324 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad19c8c-30fb-45ae-b50c-34c9f188782b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:23.240703 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad19c8c-30fb-45ae-b50c-34c9f188782b admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:23.241414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad19c8c-30fb-45ae-b50c-34c9f188782b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:23.242007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad19c8c-30fb-45ae-b50c-34c9f188782b admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:23.243805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad19c8c-30fb-45ae-b50c-34c9f188782b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:23.246515 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad19c8c-30fb-45ae-b50c-34c9f188782b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:23.263976 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 958/1911] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:23.264879 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad19c8c-30fb-45ae-b50c-34c9f188782b admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:23.282087 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad19c8c-30fb-45ae-b50c-34c9f188782b admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:23.298254 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-62f1dbe9-14e8-4e4b-98f4-c771a5d432b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02b59eded3d244b8b2313da501595af8'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:23.298953 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-62f1dbe9-14e8-4e4b-98f4-c771a5d432b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02b59eded3d244b8b2313da501595af8'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:23.299811 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcca8a9-c833-407b-89ed-6315d0ce46f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:23.300598 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcca8a9-c833-407b-89ed-6315d0ce46f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:23.300952 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcca8a9-c833-407b-89ed-6315d0ce46f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:23.301299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcca8a9-c833-407b-89ed-6315d0ce46f0 admin admin] PATH_INFO: `/v3/projects/212597ca2ac342759cb96979d1700c14/users/b3c6de2ddc4249268af78f1139c9789d/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:23.336152 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcca8a9-c833-407b-89ed-6315d0ce46f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=212597ca2ac342759cb96979d1700c14, user_id=b3c6de2ddc4249268af78f1139c9789d, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:23.338823 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcca8a9-c833-407b-89ed-6315d0ce46f0 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:23.346768 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-62f1dbe9-14e8-4e4b-98f4-c771a5d432b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02b59eded3d244b8b2313da501595af8'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:23.370917 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-62f1dbe9-14e8-4e4b-98f4-c771a5d432b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02b59eded3d244b8b2313da501595af8'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:23.372499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 959/1912] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:23 2022] PUT /identity/v3/projects/212597ca2ac342759cb96979d1700c14/users/b3c6de2ddc4249268af78f1139c9789d/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:23.373416 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcca8a9-c833-407b-89ed-6315d0ce46f0 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:23.384842 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:23.409075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-62f1dbe9-14e8-4e4b-98f4-c771a5d432b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02b59eded3d244b8b2313da501595af8'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:23.427920 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 954/1913] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:23 2022] DELETE /identity/v3/users/02b59eded3d244b8b2313da501595af8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:23.441546 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4574b-a72a-4f61-b63d-ff0ceb65d203 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:23.441843 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4574b-a72a-4f61-b63d-ff0ceb65d203 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:23.449648 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4574b-a72a-4f61-b63d-ff0ceb65d203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:23.562882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcca8a9-c833-407b-89ed-6315d0ce46f0 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:23.572191 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-94b4574b-a72a-4f61-b63d-ff0ceb65d203 None None] MFA Rules not processed for user `b3c6de2ddc4249268af78f1139c9789d`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:23.573937 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-94b4574b-a72a-4f61-b63d-ff0ceb65d203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:23.731681 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7981363-54ca-4cf0-b12c-beb86a2b24bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:23.732719 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7981363-54ca-4cf0-b12c-beb86a2b24bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:23.733070 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7981363-54ca-4cf0-b12c-beb86a2b24bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:23.733409 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7981363-54ca-4cf0-b12c-beb86a2b24bc admin admin] PATH_INFO: `/v3/projects/a9b796cd7dd7403aa5ebf1561290c3f1/users/3cb70d33ded644319d2e3b1629d33bb8/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:23.755521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 955/1914] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:23.769086 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4574b-a72a-4f61-b63d-ff0ceb65d203 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:23.771418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-94b4574b-a72a-4f61-b63d-ff0ceb65d203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:23.798301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7981363-54ca-4cf0-b12c-beb86a2b24bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b796cd7dd7403aa5ebf1561290c3f1, user_id=3cb70d33ded644319d2e3b1629d33bb8, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:23.802774 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7981363-54ca-4cf0-b12c-beb86a2b24bc admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:23.835799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 960/1915] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:23 2022] PUT /identity/v3/projects/a9b796cd7dd7403aa5ebf1561290c3f1/users/3cb70d33ded644319d2e3b1629d33bb8/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:23.836858 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7981363-54ca-4cf0-b12c-beb86a2b24bc admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:23.841272 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d7981363-54ca-4cf0-b12c-beb86a2b24bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:23.860863 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:23.907183 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4574b-a72a-4f61-b63d-ff0ceb65d203 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:23.956013 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7981363-54ca-4cf0-b12c-beb86a2b24bc admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:23.967392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea075c-9e08-4938-ab17-9a429ece2445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:23.969278 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea075c-9e08-4938-ab17-9a429ece2445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:23.969767 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea075c-9e08-4938-ab17-9a429ece2445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:23.970347 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea075c-9e08-4938-ab17-9a429ece2445 admin admin] PATH_INFO: `/v3/users/aef2e9ac82734f51b7946d81c9f94ead` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:23.976986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea075c-9e08-4938-ab17-9a429ece2445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aef2e9ac82734f51b7946d81c9f94ead)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:23.985001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea075c-9e08-4938-ab17-9a429ece2445 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:23.987510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ac9cd-4553-4bf8-9bda-0201b70da574 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:23.990310 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ac9cd-4553-4bf8-9bda-0201b70da574 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:23.990832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ac9cd-4553-4bf8-9bda-0201b70da574 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:23.992211 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ac9cd-4553-4bf8-9bda-0201b70da574 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:24.057064 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:24.069833 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f9ea075c-9e08-4938-ab17-9a429ece2445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aef2e9ac82734f51b7946d81c9f94ead'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:24.071184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f9ea075c-9e08-4938-ab17-9a429ece2445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aef2e9ac82734f51b7946d81c9f94ead'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:24.087627 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f9ea075c-9e08-4938-ab17-9a429ece2445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aef2e9ac82734f51b7946d81c9f94ead'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:24.111417 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ac9cd-4553-4bf8-9bda-0201b70da574 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:24.113912 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ac9cd-4553-4bf8-9bda-0201b70da574 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:24.116872 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f9ea075c-9e08-4938-ab17-9a429ece2445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aef2e9ac82734f51b7946d81c9f94ead'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:24.128943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f9ea075c-9e08-4938-ab17-9a429ece2445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aef2e9ac82734f51b7946d81c9f94ead'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:24.131622 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 956/1916] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:30:24.133578 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0246e-c782-466d-a743-44e0257da836 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:24.133966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0246e-c782-466d-a743-44e0257da836 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:24.134476 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0246e-c782-466d-a743-44e0257da836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:24.157687 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 961/1917] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:23 2022] DELETE /identity/v3/users/aef2e9ac82734f51b7946d81c9f94ead => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:24.162286 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1b904-4de6-4a91-ab44-c150f4c01b57 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:24.162592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1b904-4de6-4a91-ab44-c150f4c01b57 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:24.162867 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1b904-4de6-4a91-ab44-c150f4c01b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:24.184348 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-5cf0246e-c782-466d-a743-44e0257da836 None None] MFA Rules not processed for user `3cb70d33ded644319d2e3b1629d33bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:24.186134 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-5cf0246e-c782-466d-a743-44e0257da836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:24.215598 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-b0d1b904-4de6-4a91-ab44-c150f4c01b57 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:24.219500 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b0d1b904-4de6-4a91-ab44-c150f4c01b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:24.328381 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 957/1918] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:24.330958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0246e-c782-466d-a743-44e0257da836 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:24.332676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-5cf0246e-c782-466d-a743-44e0257da836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:24.393019 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 962/1919] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:24.416727 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:24.462603 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1b904-4de6-4a91-ab44-c150f4c01b57 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:24.466924 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b0d1b904-4de6-4a91-ab44-c150f4c01b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:24.473416 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0246e-c782-466d-a743-44e0257da836 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:24.483908 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342aa17-5e11-45c3-831e-de4afa266e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:24.484828 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342aa17-5e11-45c3-831e-de4afa266e2e admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:24.486839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342aa17-5e11-45c3-831e-de4afa266e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:24.487340 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342aa17-5e11-45c3-831e-de4afa266e2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:24.488492 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342aa17-5e11-45c3-831e-de4afa266e2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:24.494023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342aa17-5e11-45c3-831e-de4afa266e2e admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:24.572602 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 958/1920] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:24 2022] POST /identity/v3/projects => generated 387 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:24.575222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342aa17-5e11-45c3-831e-de4afa266e2e admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:24.617611 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1b904-4de6-4a91-ab44-c150f4c01b57 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:24.739866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342aa17-5e11-45c3-831e-de4afa266e2e admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:24.744744 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fd25e-c853-4b2b-a346-c4896d5f9a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:24.746288 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fd25e-c853-4b2b-a346-c4896d5f9a6f service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:24.746577 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fd25e-c853-4b2b-a346-c4896d5f9a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:24.747091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fd25e-c853-4b2b-a346-c4896d5f9a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:24.748692 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cd98f-0a60-43f4-9caa-ec1f703753c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:24.749422 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cd98f-0a60-43f4-9caa-ec1f703753c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:24.750326 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cd98f-0a60-43f4-9caa-ec1f703753c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:24.750601 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cd98f-0a60-43f4-9caa-ec1f703753c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:24.751677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cd98f-0a60-43f4-9caa-ec1f703753c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:24.754300 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cd98f-0a60-43f4-9caa-ec1f703753c9 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:24.766911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fd25e-c853-4b2b-a346-c4896d5f9a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:24.771508 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fd25e-c853-4b2b-a346-c4896d5f9a6f service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:24.795982 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 959/1921] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:24 2022] POST /identity/v3/users => generated 300 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:24.798202 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cd98f-0a60-43f4-9caa-ec1f703753c9 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:24.800103 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 963/1922] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:30:24.801191 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fd25e-c853-4b2b-a346-c4896d5f9a6f service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:24.806785 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-4b5cd98f-0a60-43f4-9caa-ec1f703753c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:24.827681 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fd25e-c853-4b2b-a346-c4896d5f9a6f service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:24.844521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cd98f-0a60-43f4-9caa-ec1f703753c9 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:24.845175 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8158e66-3b12-4cb5-a3fa-8e459537fb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:24.846141 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8158e66-3b12-4cb5-a3fa-8e459537fb66 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:24.846287 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8158e66-3b12-4cb5-a3fa-8e459537fb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:24.846501 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8158e66-3b12-4cb5-a3fa-8e459537fb66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:24.847173 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8158e66-3b12-4cb5-a3fa-8e459537fb66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:24.849044 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8158e66-3b12-4cb5-a3fa-8e459537fb66 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:24.865652 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf733ae-c6f2-44f3-b8da-5a847c00faad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:24.866693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf733ae-c6f2-44f3-b8da-5a847c00faad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:24.867082 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf733ae-c6f2-44f3-b8da-5a847c00faad admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:24.868225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf733ae-c6f2-44f3-b8da-5a847c00faad admin admin] PATH_INFO: `/v3/projects/958f2dff89434245924ac082360d39b7` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:24.872244 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 964/1923] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:24.872861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf733ae-c6f2-44f3-b8da-5a847c00faad admin admin] RBAC: Authorizing `identity:delete_project(project_id=958f2dff89434245924ac082360d39b7)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:24.875001 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf733ae-c6f2-44f3-b8da-5a847c00faad admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:24.879583 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8158e66-3b12-4cb5-a3fa-8e459537fb66 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:24.900048 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:24.915540 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8158e66-3b12-4cb5-a3fa-8e459537fb66 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:24.928943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b253bb-dc94-44aa-ace1-0de13d6e185f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:24.929768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b253bb-dc94-44aa-ace1-0de13d6e185f admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:24.930051 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b253bb-dc94-44aa-ace1-0de13d6e185f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:24.930436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b253bb-dc94-44aa-ace1-0de13d6e185f admin admin] PATH_INFO: `/v3/projects/ca9aaa0389464eeb8292581c6a2ed94c/users/ff84c738fcea459f890de40acf9e6c42/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:24.954986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b253bb-dc94-44aa-ace1-0de13d6e185f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9aaa0389464eeb8292581c6a2ed94c, user_id=ff84c738fcea459f890de40acf9e6c42, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:24.959920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b253bb-dc94-44aa-ace1-0de13d6e185f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:24.977825 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ccf733ae-c6f2-44f3-b8da-5a847c00faad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '958f2dff89434245924ac082360d39b7', 'request_id': 'req-ccf733ae-c6f2-44f3-b8da-5a847c00faad'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:24.984419 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 965/1924] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:24 2022] PUT /identity/v3/projects/ca9aaa0389464eeb8292581c6a2ed94c/users/ff84c738fcea459f890de40acf9e6c42/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:24.988668 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b253bb-dc94-44aa-ace1-0de13d6e185f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:24.994295 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ccf733ae-c6f2-44f3-b8da-5a847c00faad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '958f2dff89434245924ac082360d39b7', 'request_id': 'req-ccf733ae-c6f2-44f3-b8da-5a847c00faad'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:25.006995 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ccf733ae-c6f2-44f3-b8da-5a847c00faad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '958f2dff89434245924ac082360d39b7', 'request_id': 'req-ccf733ae-c6f2-44f3-b8da-5a847c00faad'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:25.029241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ccf733ae-c6f2-44f3-b8da-5a847c00faad admin admin] The token cache is being invalidate because project 958f2dff89434245924ac082360d39b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:25.029564 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ccf733ae-c6f2-44f3-b8da-5a847c00faad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:25.034075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ccf733ae-c6f2-44f3-b8da-5a847c00faad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:25.035827 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 960/1925] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:24 2022] DELETE /identity/v3/projects/958f2dff89434245924ac082360d39b7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:25.040147 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf733ae-c6f2-44f3-b8da-5a847c00faad admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:25.041508 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-ccf733ae-c6f2-44f3-b8da-5a847c00faad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:25.107436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b253bb-dc94-44aa-ace1-0de13d6e185f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:25.111987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:25.121990 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492321fe-ca58-433d-b0d7-8eff2dfeb7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:25.122998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492321fe-ca58-433d-b0d7-8eff2dfeb7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:25.123523 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492321fe-ca58-433d-b0d7-8eff2dfeb7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:25.124104 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492321fe-ca58-433d-b0d7-8eff2dfeb7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:25.126201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492321fe-ca58-433d-b0d7-8eff2dfeb7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:25.130092 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492321fe-ca58-433d-b0d7-8eff2dfeb7b1 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:25.146300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 966/1926] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:25.149955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492321fe-ca58-433d-b0d7-8eff2dfeb7b1 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:25.159386 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-492321fe-ca58-433d-b0d7-8eff2dfeb7b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:25.176673 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492321fe-ca58-433d-b0d7-8eff2dfeb7b1 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:25.181937 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd6001-179e-4c21-aafe-e0bed5555b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:25.184043 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf733ae-c6f2-44f3-b8da-5a847c00faad admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:25.184686 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd6001-179e-4c21-aafe-e0bed5555b11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:25.184802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd6001-179e-4c21-aafe-e0bed5555b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:25.186974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd6001-179e-4c21-aafe-e0bed5555b11 admin admin] PATH_INFO: `/v3/projects/ca9aaa0389464eeb8292581c6a2ed94c/users/ff84c738fcea459f890de40acf9e6c42/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:25.189533 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd6001-179e-4c21-aafe-e0bed5555b11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9aaa0389464eeb8292581c6a2ed94c, user_id=ff84c738fcea459f890de40acf9e6c42, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:25.191485 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd6001-179e-4c21-aafe-e0bed5555b11 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:25.192388 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905aabe-e0b2-49f3-b18f-b4683dd4ac7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:25.193376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905aabe-e0b2-49f3-b18f-b4683dd4ac7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:25.193893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905aabe-e0b2-49f3-b18f-b4683dd4ac7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:25.194322 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905aabe-e0b2-49f3-b18f-b4683dd4ac7e admin admin] PATH_INFO: `/v3/users/b25f02cd450b477d8c4d099bd2631cc4` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:25.195736 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905aabe-e0b2-49f3-b18f-b4683dd4ac7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b25f02cd450b477d8c4d099bd2631cc4)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:25.200691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905aabe-e0b2-49f3-b18f-b4683dd4ac7e admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:25.221285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 967/1927] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:25 2022] PUT /identity/v3/projects/ca9aaa0389464eeb8292581c6a2ed94c/users/ff84c738fcea459f890de40acf9e6c42/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:25.227495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c91ae0-d624-4dac-ada9-d0d1396a415a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:25.227978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c91ae0-d624-4dac-ada9-d0d1396a415a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:25.228255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c91ae0-d624-4dac-ada9-d0d1396a415a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:25.310303 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-94c91ae0-d624-4dac-ada9-d0d1396a415a None None] MFA Rules not processed for user `ff84c738fcea459f890de40acf9e6c42`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:25.311531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-94c91ae0-d624-4dac-ada9-d0d1396a415a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:25.314410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-d905aabe-e0b2-49f3-b18f-b4683dd4ac7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b25f02cd450b477d8c4d099bd2631cc4'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:25.315197 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-d905aabe-e0b2-49f3-b18f-b4683dd4ac7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b25f02cd450b477d8c4d099bd2631cc4'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:25.346862 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-d905aabe-e0b2-49f3-b18f-b4683dd4ac7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b25f02cd450b477d8c4d099bd2631cc4'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:25.362669 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-d905aabe-e0b2-49f3-b18f-b4683dd4ac7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b25f02cd450b477d8c4d099bd2631cc4'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:25.381941 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-d905aabe-e0b2-49f3-b18f-b4683dd4ac7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b25f02cd450b477d8c4d099bd2631cc4'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:25.394732 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 961/1928] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:25 2022] DELETE /identity/v3/users/b25f02cd450b477d8c4d099bd2631cc4 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:30:25.455595 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 968/1929] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:25.481592 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905aabe-e0b2-49f3-b18f-b4683dd4ac7e admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:25.483354 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d905aabe-e0b2-49f3-b18f-b4683dd4ac7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:25.509632 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c91ae0-d624-4dac-ada9-d0d1396a415a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:25.512950 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-94c91ae0-d624-4dac-ada9-d0d1396a415a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:25.631230 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905aabe-e0b2-49f3-b18f-b4683dd4ac7e admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:25.641561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ea0c5-7c81-446e-b002-eed2ca29e884 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:25.643385 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ea0c5-7c81-446e-b002-eed2ca29e884 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:25.644163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ea0c5-7c81-446e-b002-eed2ca29e884 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:25.644587 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ea0c5-7c81-446e-b002-eed2ca29e884 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:25.677757 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:25.712899 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c91ae0-d624-4dac-ada9-d0d1396a415a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:25.834095 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ea0c5-7c81-446e-b002-eed2ca29e884 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:25.835553 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ea0c5-7c81-446e-b002-eed2ca29e884 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:25.841685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:25.864242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 962/1930] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:25.899071 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d435e-fbdf-48ca-890f-aca5b1c89857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:25.899766 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d435e-fbdf-48ca-890f-aca5b1c89857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:25.900339 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d435e-fbdf-48ca-890f-aca5b1c89857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:25.900623 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d435e-fbdf-48ca-890f-aca5b1c89857 admin admin] PATH_INFO: `/v3/projects/b0e93a9fd17c4bd7a812d624b182121e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:25.902301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ea0c5-7c81-446e-b002-eed2ca29e884 service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:25.903655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d435e-fbdf-48ca-890f-aca5b1c89857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0e93a9fd17c4bd7a812d624b182121e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:25.904668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d03ea0c5-7c81-446e-b002-eed2ca29e884 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:25.905670 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d435e-fbdf-48ca-890f-aca5b1c89857 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:25.939059 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ea0c5-7c81-446e-b002-eed2ca29e884 service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:25.961893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10044d-bbf4-4cfb-b27c-17acf22e50b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:25.962281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10044d-bbf4-4cfb-b27c-17acf22e50b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:25.964409 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10044d-bbf4-4cfb-b27c-17acf22e50b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:25.965820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10044d-bbf4-4cfb-b27c-17acf22e50b6 admin admin] PATH_INFO: `/v3/users/3cb70d33ded644319d2e3b1629d33bb8` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:25.968075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10044d-bbf4-4cfb-b27c-17acf22e50b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cb70d33ded644319d2e3b1629d33bb8)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:25.970739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10044d-bbf4-4cfb-b27c-17acf22e50b6 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:26.012494 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b47d435e-fbdf-48ca-890f-aca5b1c89857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0e93a9fd17c4bd7a812d624b182121e', 'request_id': 'req-b47d435e-fbdf-48ca-890f-aca5b1c89857'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:26.023207 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b47d435e-fbdf-48ca-890f-aca5b1c89857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0e93a9fd17c4bd7a812d624b182121e', 'request_id': 'req-b47d435e-fbdf-48ca-890f-aca5b1c89857'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:26.039442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b47d435e-fbdf-48ca-890f-aca5b1c89857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0e93a9fd17c4bd7a812d624b182121e', 'request_id': 'req-b47d435e-fbdf-48ca-890f-aca5b1c89857'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:26.064517 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-0b10044d-bbf4-4cfb-b27c-17acf22e50b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cb70d33ded644319d2e3b1629d33bb8'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:26.065532 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-0b10044d-bbf4-4cfb-b27c-17acf22e50b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cb70d33ded644319d2e3b1629d33bb8'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:26.081651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b47d435e-fbdf-48ca-890f-aca5b1c89857 admin admin] The token cache is being invalidate because project b0e93a9fd17c4bd7a812d624b182121e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:26.081953 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b47d435e-fbdf-48ca-890f-aca5b1c89857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:26.084051 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b47d435e-fbdf-48ca-890f-aca5b1c89857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:26.088158 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-0b10044d-bbf4-4cfb-b27c-17acf22e50b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cb70d33ded644319d2e3b1629d33bb8'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:26.092366 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 969/1931] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:25 2022] DELETE /identity/v3/projects/b0e93a9fd17c4bd7a812d624b182121e => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:26.095868 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d435e-fbdf-48ca-890f-aca5b1c89857 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:26.102003 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-0b10044d-bbf4-4cfb-b27c-17acf22e50b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cb70d33ded644319d2e3b1629d33bb8'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:26.104433 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b47d435e-fbdf-48ca-890f-aca5b1c89857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:26.116502 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-0b10044d-bbf4-4cfb-b27c-17acf22e50b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cb70d33ded644319d2e3b1629d33bb8'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:26.125717 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 963/1932] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:25 2022] DELETE /identity/v3/users/3cb70d33ded644319d2e3b1629d33bb8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:30:26.126911 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10044d-bbf4-4cfb-b27c-17acf22e50b6 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:26.128879 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-0b10044d-bbf4-4cfb-b27c-17acf22e50b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:26.242988 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d435e-fbdf-48ca-890f-aca5b1c89857 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:26.249314 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d0db1-54b8-4a36-bcb4-7df5322a39e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:26.249974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d0db1-54b8-4a36-bcb4-7df5322a39e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:26.250246 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d0db1-54b8-4a36-bcb4-7df5322a39e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:26.250511 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d0db1-54b8-4a36-bcb4-7df5322a39e4 admin admin] PATH_INFO: `/v3/projects/c320fd5850e746648f7f2863f16af4c1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:26.251658 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d0db1-54b8-4a36-bcb4-7df5322a39e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c320fd5850e746648f7f2863f16af4c1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:26.253590 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d0db1-54b8-4a36-bcb4-7df5322a39e4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:26.256120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10044d-bbf4-4cfb-b27c-17acf22e50b6 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:26.263337 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1ec65-d68a-4d91-a5eb-7b97193cf5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:26.263606 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1ec65-d68a-4d91-a5eb-7b97193cf5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:26.264155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1ec65-d68a-4d91-a5eb-7b97193cf5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:26.264501 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1ec65-d68a-4d91-a5eb-7b97193cf5fe admin admin] PATH_INFO: `/v3/users/3f95a16628054071921cd6a8ee59465d` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:26.265942 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1ec65-d68a-4d91-a5eb-7b97193cf5fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f95a16628054071921cd6a8ee59465d)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:26.268124 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1ec65-d68a-4d91-a5eb-7b97193cf5fe admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:26.303853 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:26.324877 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-888d0db1-54b8-4a36-bcb4-7df5322a39e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c320fd5850e746648f7f2863f16af4c1', 'request_id': 'req-888d0db1-54b8-4a36-bcb4-7df5322a39e4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:26.331668 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-888d0db1-54b8-4a36-bcb4-7df5322a39e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c320fd5850e746648f7f2863f16af4c1', 'request_id': 'req-888d0db1-54b8-4a36-bcb4-7df5322a39e4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:26.332437 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-78a1ec65-d68a-4d91-a5eb-7b97193cf5fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f95a16628054071921cd6a8ee59465d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:26.333111 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-78a1ec65-d68a-4d91-a5eb-7b97193cf5fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f95a16628054071921cd6a8ee59465d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:26.343828 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-888d0db1-54b8-4a36-bcb4-7df5322a39e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c320fd5850e746648f7f2863f16af4c1', 'request_id': 'req-888d0db1-54b8-4a36-bcb4-7df5322a39e4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:26.363809 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-78a1ec65-d68a-4d91-a5eb-7b97193cf5fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f95a16628054071921cd6a8ee59465d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:26.373818 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-888d0db1-54b8-4a36-bcb4-7df5322a39e4 admin admin] The token cache is being invalidate because project c320fd5850e746648f7f2863f16af4c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:26.374223 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-888d0db1-54b8-4a36-bcb4-7df5322a39e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:26.374709 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-78a1ec65-d68a-4d91-a5eb-7b97193cf5fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f95a16628054071921cd6a8ee59465d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:26.374991 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-888d0db1-54b8-4a36-bcb4-7df5322a39e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:26.376577 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:26.381880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 970/1933] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:26 2022] DELETE /identity/v3/projects/c320fd5850e746648f7f2863f16af4c1 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:26.383200 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba73cb-f586-4d17-9d25-0a9065cdd6e5 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:26.383429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba73cb-f586-4d17-9d25-0a9065cdd6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:26.383742 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba73cb-f586-4d17-9d25-0a9065cdd6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:26.388428 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-78a1ec65-d68a-4d91-a5eb-7b97193cf5fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f95a16628054071921cd6a8ee59465d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:26.398553 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 964/1934] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:26 2022] DELETE /identity/v3/users/3f95a16628054071921cd6a8ee59465d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:26.400882 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b93c25-dc2d-44c1-9cb0-bd10d56ccaca None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:26.401238 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b93c25-dc2d-44c1-9cb0-bd10d56ccaca None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:26.402963 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b93c25-dc2d-44c1-9cb0-bd10d56ccaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:26.415467 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f4ba73cb-f586-4d17-9d25-0a9065cdd6e5 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:26.426657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f4ba73cb-f586-4d17-9d25-0a9065cdd6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:26.445842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-21b93c25-dc2d-44c1-9cb0-bd10d56ccaca None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:26.457059 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-21b93c25-dc2d-44c1-9cb0-bd10d56ccaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:26.551420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 971/1935] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:26.564058 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba73cb-f586-4d17-9d25-0a9065cdd6e5 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:26.567631 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f4ba73cb-f586-4d17-9d25-0a9065cdd6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:26.581038 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 965/1936] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:26.591682 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eabd3f-1920-469e-b081-dfedcf15160c None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:26.593100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eabd3f-1920-469e-b081-dfedcf15160c None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:26.593100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eabd3f-1920-469e-b081-dfedcf15160c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:26.640431 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-95eabd3f-1920-469e-b081-dfedcf15160c None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:26.641664 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-95eabd3f-1920-469e-b081-dfedcf15160c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:26.671906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 966/1937] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:26.681535 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eabd3f-1920-469e-b081-dfedcf15160c None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:26.684568 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba73cb-f586-4d17-9d25-0a9065cdd6e5 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:26.690090 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ad2a5-8bbc-4292-b1ce-cd582f4d6945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:26.690090 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ad2a5-8bbc-4292-b1ce-cd582f4d6945 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:26.690414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ad2a5-8bbc-4292-b1ce-cd582f4d6945 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:26.691246 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ad2a5-8bbc-4292-b1ce-cd582f4d6945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:26.705975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ad2a5-8bbc-4292-b1ce-cd582f4d6945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:26.709522 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ad2a5-8bbc-4292-b1ce-cd582f4d6945 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:26.722779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eabd3f-1920-469e-b081-dfedcf15160c None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:26.724912 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 972/1938] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:26.730929 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1b316-a2d2-4598-8e9e-384a5271c892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:26.732040 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1b316-a2d2-4598-8e9e-384a5271c892 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:26.732317 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1b316-a2d2-4598-8e9e-384a5271c892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:26.732585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1b316-a2d2-4598-8e9e-384a5271c892 admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:26.733239 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1b316-a2d2-4598-8e9e-384a5271c892 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:30:26.733536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1b316-a2d2-4598-8e9e-384a5271c892 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:26.735643 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1b316-a2d2-4598-8e9e-384a5271c892 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:26.758916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 967/1939] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:30:26.764335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ad2a5-8bbc-4292-b1ce-cd582f4d6945 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:26.777683 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ad2a5-8bbc-4292-b1ce-cd582f4d6945 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:26.786177 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424fd0e-af75-4f72-a02d-20ff742e8a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:26.787133 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424fd0e-af75-4f72-a02d-20ff742e8a77 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:26.787601 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424fd0e-af75-4f72-a02d-20ff742e8a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:26.788318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424fd0e-af75-4f72-a02d-20ff742e8a77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:26.789673 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424fd0e-af75-4f72-a02d-20ff742e8a77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:26.793548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424fd0e-af75-4f72-a02d-20ff742e8a77 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:26.843162 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 973/1940] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:26 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:30:26.848538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1b316-a2d2-4598-8e9e-384a5271c892 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:26.874452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1b316-a2d2-4598-8e9e-384a5271c892 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:26.886533 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424fd0e-af75-4f72-a02d-20ff742e8a77 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:26.890032 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a424fd0e-af75-4f72-a02d-20ff742e8a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:26.985129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:27.031021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827e9ec-98b7-4c90-b46f-fce120cd4016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:27.031972 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827e9ec-98b7-4c90-b46f-fce120cd4016 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:27.032327 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827e9ec-98b7-4c90-b46f-fce120cd4016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:27.032665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827e9ec-98b7-4c90-b46f-fce120cd4016 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:27.038463 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827e9ec-98b7-4c90-b46f-fce120cd4016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:27.041031 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424fd0e-af75-4f72-a02d-20ff742e8a77 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:27.047040 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827e9ec-98b7-4c90-b46f-fce120cd4016 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:27.059692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eba662-b9c0-4e54-a9dd-2562648e22d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:27.060339 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eba662-b9c0-4e54-a9dd-2562648e22d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:27.060620 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eba662-b9c0-4e54-a9dd-2562648e22d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:27.060893 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eba662-b9c0-4e54-a9dd-2562648e22d8 admin admin] PATH_INFO: `/v3/projects/f4fba2ebf1c643d5816448be16a8a1de` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:27.063331 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eba662-b9c0-4e54-a9dd-2562648e22d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4fba2ebf1c643d5816448be16a8a1de)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:27.072062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eba662-b9c0-4e54-a9dd-2562648e22d8 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:27.113230 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 968/1941] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:26 2022] POST /identity/v3/users => generated 292 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:30:27.114219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827e9ec-98b7-4c90-b46f-fce120cd4016 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:27.125977 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827e9ec-98b7-4c90-b46f-fce120cd4016 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:27.131498 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a211445-f4e6-40a5-8f7d-ef0a5e0951e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:27.132358 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a211445-f4e6-40a5-8f7d-ef0a5e0951e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:27.132643 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a211445-f4e6-40a5-8f7d-ef0a5e0951e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:27.133044 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a211445-f4e6-40a5-8f7d-ef0a5e0951e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:27.133888 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a211445-f4e6-40a5-8f7d-ef0a5e0951e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:27.136748 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a211445-f4e6-40a5-8f7d-ef0a5e0951e9 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:27.149569 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 969/1942] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:27.154125 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a211445-f4e6-40a5-8f7d-ef0a5e0951e9 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:27.165803 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-69eba662-b9c0-4e54-a9dd-2562648e22d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4fba2ebf1c643d5816448be16a8a1de', 'request_id': 'req-69eba662-b9c0-4e54-a9dd-2562648e22d8'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:27.183394 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-69eba662-b9c0-4e54-a9dd-2562648e22d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4fba2ebf1c643d5816448be16a8a1de', 'request_id': 'req-69eba662-b9c0-4e54-a9dd-2562648e22d8'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:27.184818 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a211445-f4e6-40a5-8f7d-ef0a5e0951e9 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:27.201964 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-69eba662-b9c0-4e54-a9dd-2562648e22d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4fba2ebf1c643d5816448be16a8a1de', 'request_id': 'req-69eba662-b9c0-4e54-a9dd-2562648e22d8'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:27.240310 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-69eba662-b9c0-4e54-a9dd-2562648e22d8 admin admin] The token cache is being invalidate because project f4fba2ebf1c643d5816448be16a8a1de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:27.240681 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-69eba662-b9c0-4e54-a9dd-2562648e22d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:27.241401 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-69eba662-b9c0-4e54-a9dd-2562648e22d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:27.242979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 974/1943] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:26 2022] DELETE /identity/v3/projects/f4fba2ebf1c643d5816448be16a8a1de => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:27.248478 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eba662-b9c0-4e54-a9dd-2562648e22d8 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:27.250277 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-69eba662-b9c0-4e54-a9dd-2562648e22d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:27.288867 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:27.325825 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52205595-f066-4690-8c23-d815b235d0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:27.327007 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52205595-f066-4690-8c23-d815b235d0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:27.327481 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52205595-f066-4690-8c23-d815b235d0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:27.328055 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52205595-f066-4690-8c23-d815b235d0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:27.329246 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52205595-f066-4690-8c23-d815b235d0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:27.332582 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52205595-f066-4690-8c23-d815b235d0e1 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:27.353795 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 970/1944] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:30:27.353795 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f05643-3075-468c-b145-ac40893b4f25 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:27.353795 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f05643-3075-468c-b145-ac40893b4f25 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:27.353795 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f05643-3075-468c-b145-ac40893b4f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:27.379157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-48f05643-3075-468c-b145-ac40893b4f25 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:27.381598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-48f05643-3075-468c-b145-ac40893b4f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:27.392990 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 971/1945] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:27.393846 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f05643-3075-468c-b145-ac40893b4f25 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:27.395992 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-48f05643-3075-468c-b145-ac40893b4f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:27.400180 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eba662-b9c0-4e54-a9dd-2562648e22d8 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:27.407555 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbf2ed-2b9c-4093-81cc-02b80547d511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:27.408243 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbf2ed-2b9c-4093-81cc-02b80547d511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:27.408523 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbf2ed-2b9c-4093-81cc-02b80547d511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:27.408836 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbf2ed-2b9c-4093-81cc-02b80547d511 admin admin] PATH_INFO: `/v3/projects/a9b796cd7dd7403aa5ebf1561290c3f1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:27.410253 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becbf2ed-2b9c-4093-81cc-02b80547d511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9b796cd7dd7403aa5ebf1561290c3f1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:27.412431 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becbf2ed-2b9c-4093-81cc-02b80547d511 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:27.413032 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f05643-3075-468c-b145-ac40893b4f25 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:27.419375 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a017ea-f540-495e-9e04-3a5bea34716a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:27.420026 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a017ea-f540-495e-9e04-3a5bea34716a admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:27.420363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a017ea-f540-495e-9e04-3a5bea34716a admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:27.420639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a017ea-f540-495e-9e04-3a5bea34716a admin admin] PATH_INFO: `/v3/projects/abbb94fc996942eba0997f61f3a847b5/users/8cf994fd6ad3452c9de51a06cea61b06/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:27.438984 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a017ea-f540-495e-9e04-3a5bea34716a admin admin] RBAC: Authorizing `identity:create_grant(project_id=abbb94fc996942eba0997f61f3a847b5, user_id=8cf994fd6ad3452c9de51a06cea61b06, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:27.442074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a017ea-f540-495e-9e04-3a5bea34716a admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:27.469373 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 972/1946] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:27 2022] PUT /identity/v3/projects/abbb94fc996942eba0997f61f3a847b5/users/8cf994fd6ad3452c9de51a06cea61b06/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:27.470965 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203cb2f-b590-4209-a0d5-fca7369181f7 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:27.471254 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203cb2f-b590-4209-a0d5-fca7369181f7 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:27.471881 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203cb2f-b590-4209-a0d5-fca7369181f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:27.487597 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-becbf2ed-2b9c-4093-81cc-02b80547d511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9b796cd7dd7403aa5ebf1561290c3f1', 'request_id': 'req-becbf2ed-2b9c-4093-81cc-02b80547d511'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:27.496912 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-becbf2ed-2b9c-4093-81cc-02b80547d511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9b796cd7dd7403aa5ebf1561290c3f1', 'request_id': 'req-becbf2ed-2b9c-4093-81cc-02b80547d511'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:27.498890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-b203cb2f-b590-4209-a0d5-fca7369181f7 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:27.500391 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b203cb2f-b590-4209-a0d5-fca7369181f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:27.506044 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-becbf2ed-2b9c-4093-81cc-02b80547d511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9b796cd7dd7403aa5ebf1561290c3f1', 'request_id': 'req-becbf2ed-2b9c-4093-81cc-02b80547d511'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:27.518441 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:27.529568 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-becbf2ed-2b9c-4093-81cc-02b80547d511 admin admin] The token cache is being invalidate because project a9b796cd7dd7403aa5ebf1561290c3f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:27.529568 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-becbf2ed-2b9c-4093-81cc-02b80547d511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:27.529568 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-becbf2ed-2b9c-4093-81cc-02b80547d511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:27.530390 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 975/1947] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:27 2022] DELETE /identity/v3/projects/a9b796cd7dd7403aa5ebf1561290c3f1 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:27.531666 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef8cf2-2d29-4ef1-a11c-a9d5c24e606e None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:27.531980 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef8cf2-2d29-4ef1-a11c-a9d5c24e606e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:27.532466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef8cf2-2d29-4ef1-a11c-a9d5c24e606e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:27.594920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-30ef8cf2-2d29-4ef1-a11c-a9d5c24e606e None None] MFA Rules not processed for user `8cf994fd6ad3452c9de51a06cea61b06`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:27.596275 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-30ef8cf2-2d29-4ef1-a11c-a9d5c24e606e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:27.608976 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 973/1948] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:27.610281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203cb2f-b590-4209-a0d5-fca7369181f7 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:27.612784 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b203cb2f-b590-4209-a0d5-fca7369181f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:27.630578 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203cb2f-b590-4209-a0d5-fca7369181f7 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:27.636400 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0faee5-c9d2-49db-8002-eb8682bee2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:27.637333 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0faee5-c9d2-49db-8002-eb8682bee2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:27.637848 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0faee5-c9d2-49db-8002-eb8682bee2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:27.638220 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0faee5-c9d2-49db-8002-eb8682bee2fc admin admin] PATH_INFO: `/v3/users/ff84c738fcea459f890de40acf9e6c42` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:27.639791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0faee5-c9d2-49db-8002-eb8682bee2fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff84c738fcea459f890de40acf9e6c42)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:27.642062 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0faee5-c9d2-49db-8002-eb8682bee2fc admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:27.694850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 976/1949] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:27.695999 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef8cf2-2d29-4ef1-a11c-a9d5c24e606e None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:27.709266 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9a0faee5-c9d2-49db-8002-eb8682bee2fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff84c738fcea459f890de40acf9e6c42'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:27.710267 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9a0faee5-c9d2-49db-8002-eb8682bee2fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff84c738fcea459f890de40acf9e6c42'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:27.710596 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef8cf2-2d29-4ef1-a11c-a9d5c24e606e None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:27.716880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7933960-8549-4f48-98ef-1b6aa277474e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:27.717514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7933960-8549-4f48-98ef-1b6aa277474e admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:27.717794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7933960-8549-4f48-98ef-1b6aa277474e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:27.718068 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7933960-8549-4f48-98ef-1b6aa277474e admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:27.718853 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7933960-8549-4f48-98ef-1b6aa277474e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:30:27.719160 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7933960-8549-4f48-98ef-1b6aa277474e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:27.720920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7933960-8549-4f48-98ef-1b6aa277474e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:27.726841 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9a0faee5-c9d2-49db-8002-eb8682bee2fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff84c738fcea459f890de40acf9e6c42'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:27.737713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 977/1950] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:30:27.737713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7933960-8549-4f48-98ef-1b6aa277474e admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:27.738513 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9a0faee5-c9d2-49db-8002-eb8682bee2fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff84c738fcea459f890de40acf9e6c42'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:27.739642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c7933960-8549-4f48-98ef-1b6aa277474e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:27.748413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9a0faee5-c9d2-49db-8002-eb8682bee2fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff84c738fcea459f890de40acf9e6c42'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:27.757324 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 974/1951] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:27 2022] DELETE /identity/v3/users/ff84c738fcea459f890de40acf9e6c42 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:27.758199 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0faee5-c9d2-49db-8002-eb8682bee2fc admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:27.759622 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-9a0faee5-c9d2-49db-8002-eb8682bee2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:27.764961 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7933960-8549-4f48-98ef-1b6aa277474e admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:27.813139 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:27.864490 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0faee5-c9d2-49db-8002-eb8682bee2fc admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:27.872999 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b0c7d-5312-4a52-83b1-a96ba308bd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:27.873925 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b0c7d-5312-4a52-83b1-a96ba308bd82 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:27.874533 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b0c7d-5312-4a52-83b1-a96ba308bd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:27.874982 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b0c7d-5312-4a52-83b1-a96ba308bd82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:27.876228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b0c7d-5312-4a52-83b1-a96ba308bd82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:27.879817 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b0c7d-5312-4a52-83b1-a96ba308bd82 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:27.889194 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3306ca3-bc1f-46e7-8f15-5a7fd4c2dda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:27.890618 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3306ca3-bc1f-46e7-8f15-5a7fd4c2dda3 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:27.891160 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3306ca3-bc1f-46e7-8f15-5a7fd4c2dda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:27.891862 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3306ca3-bc1f-46e7-8f15-5a7fd4c2dda3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:27.892864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3306ca3-bc1f-46e7-8f15-5a7fd4c2dda3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:27.896277 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3306ca3-bc1f-46e7-8f15-5a7fd4c2dda3 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:27.929773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 975/1952] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:27 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:27.930945 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b0c7d-5312-4a52-83b1-a96ba308bd82 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:27.949676 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 978/1953] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:27 2022] POST /identity/v3/projects => generated 383 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:27.954230 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3306ca3-bc1f-46e7-8f15-5a7fd4c2dda3 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:27.955751 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d3306ca3-bc1f-46e7-8f15-5a7fd4c2dda3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:28.013309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b0c7d-5312-4a52-83b1-a96ba308bd82 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:28.068808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3306ca3-bc1f-46e7-8f15-5a7fd4c2dda3 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:28.074530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97371629-6833-4d6f-8154-c3832478838d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:28.075168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97371629-6833-4d6f-8154-c3832478838d admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:28.075528 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97371629-6833-4d6f-8154-c3832478838d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:28.075697 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97371629-6833-4d6f-8154-c3832478838d admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:28.076422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97371629-6833-4d6f-8154-c3832478838d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:28.078720 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97371629-6833-4d6f-8154-c3832478838d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:28.086882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:28.107156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 979/1954] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:27 2022] POST /identity/v3/users => generated 298 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:30:28.109058 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97371629-6833-4d6f-8154-c3832478838d admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:28.121525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97371629-6833-4d6f-8154-c3832478838d admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:28.128239 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f111033-729c-4859-8ac0-4f933db167e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:28.128866 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f111033-729c-4859-8ac0-4f933db167e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:28.129144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f111033-729c-4859-8ac0-4f933db167e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:28.129416 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f111033-729c-4859-8ac0-4f933db167e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:28.130099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f111033-729c-4859-8ac0-4f933db167e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:28.132012 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f111033-729c-4859-8ac0-4f933db167e2 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:28.134372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7ad19-67a8-4a2d-9558-341d07f104c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:28.135358 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7ad19-67a8-4a2d-9558-341d07f104c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:28.137519 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7ad19-67a8-4a2d-9558-341d07f104c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:28.138024 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7ad19-67a8-4a2d-9558-341d07f104c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:28.139164 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7ad19-67a8-4a2d-9558-341d07f104c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:28.143087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7ad19-67a8-4a2d-9558-341d07f104c4 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:28.145405 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 980/1955] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:28.149488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f111033-729c-4859-8ac0-4f933db167e2 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:28.165000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f111033-729c-4859-8ac0-4f933db167e2 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:28.171415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfb66c-458e-42fd-af70-901112ab58fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:28.172427 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfb66c-458e-42fd-af70-901112ab58fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:28.172814 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfb66c-458e-42fd-af70-901112ab58fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:28.173190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfb66c-458e-42fd-af70-901112ab58fb admin admin] PATH_INFO: `/v3/projects/9f84314073ec446f9c64d7c609928d95/users/27c8813686d24b1690ff64aa831d9ddc/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:28.186822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 976/1956] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:27 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:30:28.187818 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7ad19-67a8-4a2d-9558-341d07f104c4 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:28.194334 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfb66c-458e-42fd-af70-901112ab58fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f84314073ec446f9c64d7c609928d95, user_id=27c8813686d24b1690ff64aa831d9ddc, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:28.200070 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfb66c-458e-42fd-af70-901112ab58fb admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:28.204370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7ad19-67a8-4a2d-9558-341d07f104c4 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:28.209844 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afacb6-f6d2-4583-9845-c1656dac2976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:28.210540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afacb6-f6d2-4583-9845-c1656dac2976 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:28.210825 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afacb6-f6d2-4583-9845-c1656dac2976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:28.211097 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afacb6-f6d2-4583-9845-c1656dac2976 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:28.211786 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afacb6-f6d2-4583-9845-c1656dac2976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:28.213401 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afacb6-f6d2-4583-9845-c1656dac2976 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:28.215054 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 981/1957] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:28 2022] PUT /identity/v3/projects/9f84314073ec446f9c64d7c609928d95/users/27c8813686d24b1690ff64aa831d9ddc/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:30:28.219204 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfb66c-458e-42fd-af70-901112ab58fb admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:28.237037 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 977/1958] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:28.239871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afacb6-f6d2-4583-9845-c1656dac2976 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:28.254529 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afacb6-f6d2-4583-9845-c1656dac2976 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:28.304725 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:28.339267 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c434ca-9f0a-4129-9b4f-380f3fdd2dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:28.340262 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c434ca-9f0a-4129-9b4f-380f3fdd2dad admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:28.340544 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c434ca-9f0a-4129-9b4f-380f3fdd2dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:28.340819 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c434ca-9f0a-4129-9b4f-380f3fdd2dad admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:28.341482 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c434ca-9f0a-4129-9b4f-380f3fdd2dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:28.357765 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c434ca-9f0a-4129-9b4f-380f3fdd2dad admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:28.359613 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfb66c-458e-42fd-af70-901112ab58fb admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:28.390949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 978/1959] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:28.392580 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c434ca-9f0a-4129-9b4f-380f3fdd2dad admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:28.396548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ea065-f072-4eaf-9835-8ab6d140ee0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:28.397224 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ea065-f072-4eaf-9835-8ab6d140ee0a admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:28.397504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ea065-f072-4eaf-9835-8ab6d140ee0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:28.397778 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ea065-f072-4eaf-9835-8ab6d140ee0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:28.398056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-89c434ca-9f0a-4129-9b4f-380f3fdd2dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:28.398436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ea065-f072-4eaf-9835-8ab6d140ee0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:28.405325 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ea065-f072-4eaf-9835-8ab6d140ee0a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:28.411337 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c434ca-9f0a-4129-9b4f-380f3fdd2dad admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:28.416264 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f8923-6212-4ad4-80f0-782ead8d9c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:28.416911 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f8923-6212-4ad4-80f0-782ead8d9c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:28.417725 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f8923-6212-4ad4-80f0-782ead8d9c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:28.418000 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f8923-6212-4ad4-80f0-782ead8d9c2c admin admin] PATH_INFO: `/v3/projects/ca9aaa0389464eeb8292581c6a2ed94c` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:28.419157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f8923-6212-4ad4-80f0-782ead8d9c2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca9aaa0389464eeb8292581c6a2ed94c)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:28.421128 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f8923-6212-4ad4-80f0-782ead8d9c2c admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:28.425569 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 982/1960] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:28.425569 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ea065-f072-4eaf-9835-8ab6d140ee0a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:28.449516 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ea065-f072-4eaf-9835-8ab6d140ee0a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:28.461873 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ced99-3b33-4bea-8a0a-a237accfcd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:28.462575 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ced99-3b33-4bea-8a0a-a237accfcd92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:28.462852 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ced99-3b33-4bea-8a0a-a237accfcd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:28.463129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ced99-3b33-4bea-8a0a-a237accfcd92 admin admin] PATH_INFO: `/v3/projects/8504c684a75f4e55ad0168a4741e7629/users/bfac3ec9885c44e7a9250d8a082727cd/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:28.490160 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ced99-3b33-4bea-8a0a-a237accfcd92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8504c684a75f4e55ad0168a4741e7629, user_id=bfac3ec9885c44e7a9250d8a082727cd, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:28.496689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ced99-3b33-4bea-8a0a-a237accfcd92 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:28.496828 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ca9f8923-6212-4ad4-80f0-782ead8d9c2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca9aaa0389464eeb8292581c6a2ed94c', 'request_id': 'req-ca9f8923-6212-4ad4-80f0-782ead8d9c2c'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:28.503757 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ca9f8923-6212-4ad4-80f0-782ead8d9c2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca9aaa0389464eeb8292581c6a2ed94c', 'request_id': 'req-ca9f8923-6212-4ad4-80f0-782ead8d9c2c'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:28.513280 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ca9f8923-6212-4ad4-80f0-782ead8d9c2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca9aaa0389464eeb8292581c6a2ed94c', 'request_id': 'req-ca9f8923-6212-4ad4-80f0-782ead8d9c2c'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:28.522983 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 983/1961] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:28 2022] PUT /identity/v3/projects/8504c684a75f4e55ad0168a4741e7629/users/bfac3ec9885c44e7a9250d8a082727cd/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:28.527764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ced99-3b33-4bea-8a0a-a237accfcd92 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:28.534345 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ca9f8923-6212-4ad4-80f0-782ead8d9c2c admin admin] The token cache is being invalidate because project ca9aaa0389464eeb8292581c6a2ed94c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:28.535290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ca9f8923-6212-4ad4-80f0-782ead8d9c2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:28.536153 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ca9f8923-6212-4ad4-80f0-782ead8d9c2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:28.539755 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 979/1962] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:28 2022] DELETE /identity/v3/projects/ca9aaa0389464eeb8292581c6a2ed94c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:28.539755 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ace51f-e213-4c2f-bb39-a26de0bdc374 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:28.539755 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ace51f-e213-4c2f-bb39-a26de0bdc374 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:28.540048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ace51f-e213-4c2f-bb39-a26de0bdc374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:28.604567 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-f3ace51f-e213-4c2f-bb39-a26de0bdc374 None None] MFA Rules not processed for user `bfac3ec9885c44e7a9250d8a082727cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:28.607247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f3ace51f-e213-4c2f-bb39-a26de0bdc374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:28.630661 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ced99-3b33-4bea-8a0a-a237accfcd92 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:28.636956 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34591cf8-ffd2-4f40-b446-7a873af85841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:28.637625 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34591cf8-ffd2-4f40-b446-7a873af85841 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:28.637970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34591cf8-ffd2-4f40-b446-7a873af85841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:28.638246 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34591cf8-ffd2-4f40-b446-7a873af85841 admin admin] PATH_INFO: `/v3/projects/9f84314073ec446f9c64d7c609928d95/users/27c8813686d24b1690ff64aa831d9ddc/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:28.640319 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34591cf8-ffd2-4f40-b446-7a873af85841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f84314073ec446f9c64d7c609928d95, user_id=27c8813686d24b1690ff64aa831d9ddc, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:28.644458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34591cf8-ffd2-4f40-b446-7a873af85841 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:28.663764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 984/1963] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:28 2022] PUT /identity/v3/projects/9f84314073ec446f9c64d7c609928d95/users/27c8813686d24b1690ff64aa831d9ddc/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:28.663764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12b918-e15c-4f88-a21a-a29a42d9838a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:28.663764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12b918-e15c-4f88-a21a-a29a42d9838a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:28.663764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12b918-e15c-4f88-a21a-a29a42d9838a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:28.694424 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-7a12b918-e15c-4f88-a21a-a29a42d9838a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:28.697507 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7a12b918-e15c-4f88-a21a-a29a42d9838a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:28.707791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 980/1964] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:28.709411 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0826261-c804-42d4-90e7-463b44a0848f None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:28.709831 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0826261-c804-42d4-90e7-463b44a0848f None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:28.710235 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0826261-c804-42d4-90e7-463b44a0848f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:28.726458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:28.749011 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-b0826261-c804-42d4-90e7-463b44a0848f None None] MFA Rules not processed for user `27c8813686d24b1690ff64aa831d9ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:28.750993 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b0826261-c804-42d4-90e7-463b44a0848f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:28.813869 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 985/1965] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:28.814842 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12b918-e15c-4f88-a21a-a29a42d9838a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:28.819665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:28.823856 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7a12b918-e15c-4f88-a21a-a29a42d9838a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:28.845553 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12b918-e15c-4f88-a21a-a29a42d9838a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:28.851663 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104a330-9548-44fb-937c-db7b86f7e81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:28.852344 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104a330-9548-44fb-937c-db7b86f7e81b admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:28.852621 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104a330-9548-44fb-937c-db7b86f7e81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:28.852887 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104a330-9548-44fb-937c-db7b86f7e81b admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:28.853531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104a330-9548-44fb-937c-db7b86f7e81b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:28.856131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104a330-9548-44fb-937c-db7b86f7e81b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:28.872430 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 981/1966] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:28.874563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e475aee-4c9e-4c9d-8075-b2681ecb0627 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:28.874940 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e475aee-4c9e-4c9d-8075-b2681ecb0627 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:28.875188 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e475aee-4c9e-4c9d-8075-b2681ecb0627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:28.892860 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 986/1967] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:28 2022] POST /identity/v3/projects => generated 387 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:28.898498 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104a330-9548-44fb-937c-db7b86f7e81b admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:28.905434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-9e475aee-4c9e-4c9d-8075-b2681ecb0627 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:28.906960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-9e475aee-4c9e-4c9d-8075-b2681ecb0627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:28.977912 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104a330-9548-44fb-937c-db7b86f7e81b admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:28.983410 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1fddf-869b-4b78-896c-915e4720b185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:28.984062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1fddf-869b-4b78-896c-915e4720b185 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:28.984345 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1fddf-869b-4b78-896c-915e4720b185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:28.984617 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1fddf-869b-4b78-896c-915e4720b185 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:28.985020 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 982/1968] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:28.985260 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1fddf-869b-4b78-896c-915e4720b185 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:28.985956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e475aee-4c9e-4c9d-8075-b2681ecb0627 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:28.987213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1fddf-869b-4b78-896c-915e4720b185 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:28.987326 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-9e475aee-4c9e-4c9d-8075-b2681ecb0627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:29.016748 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 987/1969] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:28 2022] POST /identity/v3/users => generated 300 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:29.016748 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1fddf-869b-4b78-896c-915e4720b185 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:29.030240 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1fddf-869b-4b78-896c-915e4720b185 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:29.035649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e3a8d-5ac1-445c-ab88-2c4ba3833477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:29.036304 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e3a8d-5ac1-445c-ab88-2c4ba3833477 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:29.036580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e3a8d-5ac1-445c-ab88-2c4ba3833477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:29.036861 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e3a8d-5ac1-445c-ab88-2c4ba3833477 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:29.037573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e3a8d-5ac1-445c-ab88-2c4ba3833477 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:30:29.037883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e3a8d-5ac1-445c-ab88-2c4ba3833477 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:29.039506 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e3a8d-5ac1-445c-ab88-2c4ba3833477 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:29.052157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e475aee-4c9e-4c9d-8075-b2681ecb0627 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:29.056688 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d29680-f3e8-4b64-8194-20553db81233 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:29.057453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d29680-f3e8-4b64-8194-20553db81233 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:29.057942 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d29680-f3e8-4b64-8194-20553db81233 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:29.058332 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d29680-f3e8-4b64-8194-20553db81233 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:29.060184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 988/1970] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:30:29.061510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e3a8d-5ac1-445c-ab88-2c4ba3833477 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:29.078220 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e3a8d-5ac1-445c-ab88-2c4ba3833477 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:29.084376 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a83c00-0cfc-4c83-acc9-f3fc83233a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:29.085171 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a83c00-0cfc-4c83-acc9-f3fc83233a04 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:29.085489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a83c00-0cfc-4c83-acc9-f3fc83233a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:29.085785 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a83c00-0cfc-4c83-acc9-f3fc83233a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:29.086562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a83c00-0cfc-4c83-acc9-f3fc83233a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:29.088343 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a83c00-0cfc-4c83-acc9-f3fc83233a04 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:29.103461 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 989/1971] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:29.103650 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a83c00-0cfc-4c83-acc9-f3fc83233a04 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:29.117710 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a83c00-0cfc-4c83-acc9-f3fc83233a04 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:29.124819 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576a517-137e-4e71-82ba-db87c4ebf767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:29.125520 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576a517-137e-4e71-82ba-db87c4ebf767 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:29.125845 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576a517-137e-4e71-82ba-db87c4ebf767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:29.126113 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576a517-137e-4e71-82ba-db87c4ebf767 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:29.126792 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576a517-137e-4e71-82ba-db87c4ebf767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:29.128916 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576a517-137e-4e71-82ba-db87c4ebf767 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:29.159153 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d29680-f3e8-4b64-8194-20553db81233 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:29.161108 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d29680-f3e8-4b64-8194-20553db81233 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:29.163641 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 990/1972] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:29 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:29.164623 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576a517-137e-4e71-82ba-db87c4ebf767 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:29.176729 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 983/1973] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:29.178025 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d29680-f3e8-4b64-8194-20553db81233 service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:29.199563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d29680-f3e8-4b64-8194-20553db81233 service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:29.238653 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:29.241984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:29.338475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd0558-d11a-428f-8c89-3a2fa7350ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:29.338723 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576a517-137e-4e71-82ba-db87c4ebf767 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:29.340312 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd0558-d11a-428f-8c89-3a2fa7350ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:29.340922 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd0558-d11a-428f-8c89-3a2fa7350ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:29.341656 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd0558-d11a-428f-8c89-3a2fa7350ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:29.342694 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd0558-d11a-428f-8c89-3a2fa7350ef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:29.345613 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b0407-6ea1-4151-9028-1bd65d3c29c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:29.346095 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b0407-6ea1-4151-9028-1bd65d3c29c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:29.346523 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b0407-6ea1-4151-9028-1bd65d3c29c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:29.346806 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b0407-6ea1-4151-9028-1bd65d3c29c2 admin admin] PATH_INFO: `/v3/projects/f4833b2111aa4d26a4339cba125892b2/users/af5976bca1a14be485c3320e35de7a21/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:29.347393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd0558-d11a-428f-8c89-3a2fa7350ef7 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:29.376298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b0407-6ea1-4151-9028-1bd65d3c29c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4833b2111aa4d26a4339cba125892b2, user_id=af5976bca1a14be485c3320e35de7a21, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:29.380344 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b0407-6ea1-4151-9028-1bd65d3c29c2 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:29.384130 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 984/1974] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:29 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:29.385544 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd0558-d11a-428f-8c89-3a2fa7350ef7 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:29.414605 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 991/1975] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:29 2022] PUT /identity/v3/projects/f4833b2111aa4d26a4339cba125892b2/users/af5976bca1a14be485c3320e35de7a21/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:29.415480 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b0407-6ea1-4151-9028-1bd65d3c29c2 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:29.528463 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b0407-6ea1-4151-9028-1bd65d3c29c2 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:29.537545 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc82d35-3d48-4b5f-85aa-100dd1b86656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:29.538957 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc82d35-3d48-4b5f-85aa-100dd1b86656 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:29.539453 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc82d35-3d48-4b5f-85aa-100dd1b86656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:29.540012 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc82d35-3d48-4b5f-85aa-100dd1b86656 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:29.542880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc82d35-3d48-4b5f-85aa-100dd1b86656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:29.546436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc82d35-3d48-4b5f-85aa-100dd1b86656 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:29.562319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd0558-d11a-428f-8c89-3a2fa7350ef7 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:29.565057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 992/1976] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:29.566745 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc82d35-3d48-4b5f-85aa-100dd1b86656 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:29.582132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc82d35-3d48-4b5f-85aa-100dd1b86656 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:29.589959 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace66c63-4986-47cc-9045-fbed6508484b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:29.590797 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace66c63-4986-47cc-9045-fbed6508484b admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:29.591221 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace66c63-4986-47cc-9045-fbed6508484b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:29.591681 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace66c63-4986-47cc-9045-fbed6508484b admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:29.592525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace66c63-4986-47cc-9045-fbed6508484b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:29.594518 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace66c63-4986-47cc-9045-fbed6508484b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:29.611590 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 993/1977] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:29.612949 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace66c63-4986-47cc-9045-fbed6508484b admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:29.629190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace66c63-4986-47cc-9045-fbed6508484b admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:29.634692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e54237-f810-4973-8418-aa33ef5951ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:29.635328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e54237-f810-4973-8418-aa33ef5951ee admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:29.638021 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e54237-f810-4973-8418-aa33ef5951ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:29.638328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e54237-f810-4973-8418-aa33ef5951ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:29.639231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e54237-f810-4973-8418-aa33ef5951ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:29.642164 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e54237-f810-4973-8418-aa33ef5951ee admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:29.670016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 994/1978] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:29.671000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e54237-f810-4973-8418-aa33ef5951ee admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:29.705827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e54237-f810-4973-8418-aa33ef5951ee admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:29.727209 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea15c79-1553-4935-be90-84789257b1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:29.728542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea15c79-1553-4935-be90-84789257b1e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:29.728816 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea15c79-1553-4935-be90-84789257b1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:29.730561 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea15c79-1553-4935-be90-84789257b1e0 admin admin] PATH_INFO: `/v3/projects/f4833b2111aa4d26a4339cba125892b2/users/af5976bca1a14be485c3320e35de7a21/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:29.735111 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea15c79-1553-4935-be90-84789257b1e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4833b2111aa4d26a4339cba125892b2, user_id=af5976bca1a14be485c3320e35de7a21, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:29.739418 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea15c79-1553-4935-be90-84789257b1e0 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:29.760277 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 995/1979] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:29 2022] PUT /identity/v3/projects/f4833b2111aa4d26a4339cba125892b2/users/af5976bca1a14be485c3320e35de7a21/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:29.762112 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea15c79-1553-4935-be90-84789257b1e0 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:29.768846 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067ce92-aa84-4aa7-a7f9-b032df18bac8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:29.769522 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067ce92-aa84-4aa7-a7f9-b032df18bac8 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:29.769803 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067ce92-aa84-4aa7-a7f9-b032df18bac8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:29.770584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067ce92-aa84-4aa7-a7f9-b032df18bac8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:29.772686 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-c067ce92-aa84-4aa7-a7f9-b032df18bac8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:29.934163 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea15c79-1553-4935-be90-84789257b1e0 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:29.937609 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067ce92-aa84-4aa7-a7f9-b032df18bac8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:29.942376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067ce92-aa84-4aa7-a7f9-b032df18bac8 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:29.959695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7c571-44fe-4360-9dd4-ac3cde9240e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:29.960746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 985/1980] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:29.961533 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7c571-44fe-4360-9dd4-ac3cde9240e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:29.961816 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7c571-44fe-4360-9dd4-ac3cde9240e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:29.962095 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7c571-44fe-4360-9dd4-ac3cde9240e1 admin admin] PATH_INFO: `/v3/projects/8484e107e9054dc78f091f8d8152a4b8/users/8c2c52c0461b4d73a28fcdcc799bc14e/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:29.962200 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b88404-6073-458f-9f68-c5f6ebb859f3 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:29.965105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b88404-6073-458f-9f68-c5f6ebb859f3 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:29.965105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b88404-6073-458f-9f68-c5f6ebb859f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:30.031235 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7c571-44fe-4360-9dd4-ac3cde9240e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8484e107e9054dc78f091f8d8152a4b8, user_id=8c2c52c0461b4d73a28fcdcc799bc14e, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:30.049694 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7c571-44fe-4360-9dd4-ac3cde9240e1 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:30.067630 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-e5b88404-6073-458f-9f68-c5f6ebb859f3 None None] MFA Rules not processed for user `af5976bca1a14be485c3320e35de7a21`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:30.082915 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e5b88404-6073-458f-9f68-c5f6ebb859f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:30.099894 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 996/1981] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:29 2022] PUT /identity/v3/projects/8484e107e9054dc78f091f8d8152a4b8/users/8c2c52c0461b4d73a28fcdcc799bc14e/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:30.116948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ac4a9-30f4-456b-ba3c-cd8011bbc288 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:30.116948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ac4a9-30f4-456b-ba3c-cd8011bbc288 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:30.117231 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ac4a9-30f4-456b-ba3c-cd8011bbc288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:30.122551 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:30.203050 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:30.238212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-033ac4a9-30f4-456b-ba3c-cd8011bbc288 None None] MFA Rules not processed for user `8c2c52c0461b4d73a28fcdcc799bc14e`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:30.239622 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-033ac4a9-30f4-456b-ba3c-cd8011bbc288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:30.367935 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 986/1982] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:29 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:30.380078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b88404-6073-458f-9f68-c5f6ebb859f3 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:30.382233 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e5b88404-6073-458f-9f68-c5f6ebb859f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:30.442270 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 997/1983] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:30.446206 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ac4a9-30f4-456b-ba3c-cd8011bbc288 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:30.660039 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b88404-6073-458f-9f68-c5f6ebb859f3 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:30.684707 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f3b81-274d-4482-b845-fb7c18aea113 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:30.685425 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f3b81-274d-4482-b845-fb7c18aea113 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:30.685712 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f3b81-274d-4482-b845-fb7c18aea113 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:30.685989 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f3b81-274d-4482-b845-fb7c18aea113 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:30.691350 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ac4a9-30f4-456b-ba3c-cd8011bbc288 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:30.702084 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a083d09-1f08-4964-b7ec-73257399887f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:30.702427 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a083d09-1f08-4964-b7ec-73257399887f admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:30.702683 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a083d09-1f08-4964-b7ec-73257399887f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:30.702899 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a083d09-1f08-4964-b7ec-73257399887f admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:30.703838 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a083d09-1f08-4964-b7ec-73257399887f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:30.705855 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a083d09-1f08-4964-b7ec-73257399887f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:30.727696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f3b81-274d-4482-b845-fb7c18aea113 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:30.730814 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f3b81-274d-4482-b845-fb7c18aea113 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:30.754643 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 987/1984] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:30 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:30:30.758066 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f3b81-274d-4482-b845-fb7c18aea113 service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:30.765886 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 998/1985] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:30 2022] POST /identity/v3/projects => generated 385 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:30:30.767119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a083d09-1f08-4964-b7ec-73257399887f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:30.778373 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b45f3b81-274d-4482-b845-fb7c18aea113 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:30.824529 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f3b81-274d-4482-b845-fb7c18aea113 service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:30.884285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a083d09-1f08-4964-b7ec-73257399887f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:30.898103 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca8dd0-7f00-4d14-bca4-be9eab46fc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:30.898714 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca8dd0-7f00-4d14-bca4-be9eab46fc73 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:30.898999 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca8dd0-7f00-4d14-bca4-be9eab46fc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:30.899267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca8dd0-7f00-4d14-bca4-be9eab46fc73 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:30.899975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca8dd0-7f00-4d14-bca4-be9eab46fc73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:30.908148 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca8dd0-7f00-4d14-bca4-be9eab46fc73 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:30.948828 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76141e5-62ab-4a9b-9452-af7f6ee65d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:30.949634 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76141e5-62ab-4a9b-9452-af7f6ee65d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:30.950018 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76141e5-62ab-4a9b-9452-af7f6ee65d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:30.950396 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76141e5-62ab-4a9b-9452-af7f6ee65d14 admin admin] PATH_INFO: `/v3/users/8cf994fd6ad3452c9de51a06cea61b06` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:30.953239 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76141e5-62ab-4a9b-9452-af7f6ee65d14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cf994fd6ad3452c9de51a06cea61b06)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:30.955327 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76141e5-62ab-4a9b-9452-af7f6ee65d14 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:30.957265 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 999/1986] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:30 2022] POST /identity/v3/users => generated 299 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:30.961059 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca8dd0-7f00-4d14-bca4-be9eab46fc73 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:30.975239 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca8dd0-7f00-4d14-bca4-be9eab46fc73 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:30.982268 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746f6e2-dfd7-4f84-844c-763c5cf23b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:30.983439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746f6e2-dfd7-4f84-844c-763c5cf23b01 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:30.983817 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746f6e2-dfd7-4f84-844c-763c5cf23b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:30.984153 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746f6e2-dfd7-4f84-844c-763c5cf23b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:30.984930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746f6e2-dfd7-4f84-844c-763c5cf23b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:30.989454 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746f6e2-dfd7-4f84-844c-763c5cf23b01 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:31.010492 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1000/1987] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:31.015640 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746f6e2-dfd7-4f84-844c-763c5cf23b01 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:31.037114 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:31.049957 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746f6e2-dfd7-4f84-844c-763c5cf23b01 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:31.072266 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4807d-69a9-4c54-99c0-5fe92691c00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:31.077117 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4807d-69a9-4c54-99c0-5fe92691c00a admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:31.077584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4807d-69a9-4c54-99c0-5fe92691c00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:31.078086 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4807d-69a9-4c54-99c0-5fe92691c00a admin admin] PATH_INFO: `/v3/projects/2d096e850360483a85deaab78d8836d2/users/4a10be83d64c432cb16e628a39a43ee6/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:31.086192 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b76141e5-62ab-4a9b-9452-af7f6ee65d14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cf994fd6ad3452c9de51a06cea61b06'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:31.087587 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b76141e5-62ab-4a9b-9452-af7f6ee65d14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cf994fd6ad3452c9de51a06cea61b06'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:31.100611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:31.126682 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b76141e5-62ab-4a9b-9452-af7f6ee65d14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cf994fd6ad3452c9de51a06cea61b06'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:31.139599 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b76141e5-62ab-4a9b-9452-af7f6ee65d14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cf994fd6ad3452c9de51a06cea61b06'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:31.146783 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4807d-69a9-4c54-99c0-5fe92691c00a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d096e850360483a85deaab78d8836d2, user_id=4a10be83d64c432cb16e628a39a43ee6, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:31.153066 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4807d-69a9-4c54-99c0-5fe92691c00a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:31.156527 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b76141e5-62ab-4a9b-9452-af7f6ee65d14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cf994fd6ad3452c9de51a06cea61b06'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:31.168943 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 988/1988] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:30 2022] DELETE /identity/v3/users/8cf994fd6ad3452c9de51a06cea61b06 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:31.171741 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1053f-9fb6-44a6-bd8c-035e148739fd None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:31.177091 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1053f-9fb6-44a6-bd8c-035e148739fd None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:31.177404 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1053f-9fb6-44a6-bd8c-035e148739fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:31.179122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1001/1989] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:31 2022] PUT /identity/v3/projects/2d096e850360483a85deaab78d8836d2/users/4a10be83d64c432cb16e628a39a43ee6/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:31.190533 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4807d-69a9-4c54-99c0-5fe92691c00a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:31.197564 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ffc4807d-69a9-4c54-99c0-5fe92691c00a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:31.223475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-9fd1053f-9fb6-44a6-bd8c-035e148739fd None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:31.227842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-9fd1053f-9fb6-44a6-bd8c-035e148739fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:31.365497 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4807d-69a9-4c54-99c0-5fe92691c00a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:31.378733 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966f40d-aec3-4589-86ea-1b93400ebfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:31.379596 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966f40d-aec3-4589-86ea-1b93400ebfc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:31.379916 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966f40d-aec3-4589-86ea-1b93400ebfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:31.380630 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966f40d-aec3-4589-86ea-1b93400ebfc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:31.384237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966f40d-aec3-4589-86ea-1b93400ebfc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:31.388709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966f40d-aec3-4589-86ea-1b93400ebfc8 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:31.403088 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 989/1990] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:31.409286 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1053f-9fb6-44a6-bd8c-035e148739fd None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:31.415448 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-9fd1053f-9fb6-44a6-bd8c-035e148739fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:31.432092 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1002/1991] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:31.456683 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966f40d-aec3-4589-86ea-1b93400ebfc8 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:31.523908 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966f40d-aec3-4589-86ea-1b93400ebfc8 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:31.564298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbffc0f-159b-4834-9405-b2af34e13517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:31.565005 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbffc0f-159b-4834-9405-b2af34e13517 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:31.565286 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbffc0f-159b-4834-9405-b2af34e13517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:31.565895 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbffc0f-159b-4834-9405-b2af34e13517 admin admin] PATH_INFO: `/v3/projects/2d096e850360483a85deaab78d8836d2/users/4a10be83d64c432cb16e628a39a43ee6/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:31.586825 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbffc0f-159b-4834-9405-b2af34e13517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d096e850360483a85deaab78d8836d2, user_id=4a10be83d64c432cb16e628a39a43ee6, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:31.590665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbffc0f-159b-4834-9405-b2af34e13517 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:31.636293 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1003/1992] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:31 2022] PUT /identity/v3/projects/2d096e850360483a85deaab78d8836d2/users/4a10be83d64c432cb16e628a39a43ee6/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:31.648483 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05cc690-a4a2-44b9-a51e-65cf4b44ff7f None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:31.648815 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05cc690-a4a2-44b9-a51e-65cf4b44ff7f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:31.649042 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05cc690-a4a2-44b9-a51e-65cf4b44ff7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:31.713216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1053f-9fb6-44a6-bd8c-035e148739fd None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:31.744766 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f05cc690-a4a2-44b9-a51e-65cf4b44ff7f None None] MFA Rules not processed for user `4a10be83d64c432cb16e628a39a43ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:31.748254 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f05cc690-a4a2-44b9-a51e-65cf4b44ff7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:31.834263 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e624da-2f95-4dc0-9592-3f6dcf268cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:31.834902 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e624da-2f95-4dc0-9592-3f6dcf268cee service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:31.835203 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e624da-2f95-4dc0-9592-3f6dcf268cee service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:31.835462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e624da-2f95-4dc0-9592-3f6dcf268cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:31.904643 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:31.958835 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e624da-2f95-4dc0-9592-3f6dcf268cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:31.965034 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e624da-2f95-4dc0-9592-3f6dcf268cee service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:31.996259 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1004/1993] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:31 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:31.999142 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 990/1994] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:32.040520 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05cc690-a4a2-44b9-a51e-65cf4b44ff7f None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:32.043041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f05cc690-a4a2-44b9-a51e-65cf4b44ff7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:32.180385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:32.195432 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05cc690-a4a2-44b9-a51e-65cf4b44ff7f None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:32.203670 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67093d7-f09a-4754-960a-9846247b5874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:32.204659 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67093d7-f09a-4754-960a-9846247b5874 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:32.204997 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67093d7-f09a-4754-960a-9846247b5874 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:32.205270 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67093d7-f09a-4754-960a-9846247b5874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:32.233275 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67093d7-f09a-4754-960a-9846247b5874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:32.234737 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e624da-2f95-4dc0-9592-3f6dcf268cee service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:32.236157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67093d7-f09a-4754-960a-9846247b5874 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:32.238804 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-56e624da-2f95-4dc0-9592-3f6dcf268cee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:32.260022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e624da-2f95-4dc0-9592-3f6dcf268cee service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:32.266311 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c9b98-3e9e-4b8c-8946-2da7628dd64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:32.267073 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c9b98-3e9e-4b8c-8946-2da7628dd64d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:32.267465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c9b98-3e9e-4b8c-8946-2da7628dd64d admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:32.267877 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c9b98-3e9e-4b8c-8946-2da7628dd64d admin admin] PATH_INFO: `/v3/users/bfac3ec9885c44e7a9250d8a082727cd` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:32.269196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c9b98-3e9e-4b8c-8946-2da7628dd64d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfac3ec9885c44e7a9250d8a082727cd)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:32.271366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c9b98-3e9e-4b8c-8946-2da7628dd64d admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:32.273317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1005/1995] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:30:32.379603 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67093d7-f09a-4754-960a-9846247b5874 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:32.390689 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a64c9b98-3e9e-4b8c-8946-2da7628dd64d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfac3ec9885c44e7a9250d8a082727cd'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:32.391674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a64c9b98-3e9e-4b8c-8946-2da7628dd64d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfac3ec9885c44e7a9250d8a082727cd'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:32.396773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67093d7-f09a-4754-960a-9846247b5874 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:32.416526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4991cf0-128e-4fed-a0c8-3b9066cafb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:32.417958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a64c9b98-3e9e-4b8c-8946-2da7628dd64d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfac3ec9885c44e7a9250d8a082727cd'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:32.419276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4991cf0-128e-4fed-a0c8-3b9066cafb19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:32.419664 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4991cf0-128e-4fed-a0c8-3b9066cafb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:32.420068 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4991cf0-128e-4fed-a0c8-3b9066cafb19 admin admin] PATH_INFO: `/v3/users/8c2c52c0461b4d73a28fcdcc799bc14e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:32.422172 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4991cf0-128e-4fed-a0c8-3b9066cafb19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c2c52c0461b4d73a28fcdcc799bc14e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:32.425570 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4991cf0-128e-4fed-a0c8-3b9066cafb19 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:32.437324 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a64c9b98-3e9e-4b8c-8946-2da7628dd64d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfac3ec9885c44e7a9250d8a082727cd'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:32.458484 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a64c9b98-3e9e-4b8c-8946-2da7628dd64d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfac3ec9885c44e7a9250d8a082727cd'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:32.495807 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 991/1996] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:32 2022] DELETE /identity/v3/users/bfac3ec9885c44e7a9250d8a082727cd => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:30:32.501212 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae87b6a-3e9f-4a83-a6be-397515b5dc10 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:32.501212 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae87b6a-3e9f-4a83-a6be-397515b5dc10 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:32.504612 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae87b6a-3e9f-4a83-a6be-397515b5dc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:32.563287 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-8ae87b6a-3e9f-4a83-a6be-397515b5dc10 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:32.566641 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-8ae87b6a-3e9f-4a83-a6be-397515b5dc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:32.570031 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d4991cf0-128e-4fed-a0c8-3b9066cafb19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c2c52c0461b4d73a28fcdcc799bc14e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:32.571112 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d4991cf0-128e-4fed-a0c8-3b9066cafb19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c2c52c0461b4d73a28fcdcc799bc14e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:32.591515 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d4991cf0-128e-4fed-a0c8-3b9066cafb19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c2c52c0461b4d73a28fcdcc799bc14e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:32.628312 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d4991cf0-128e-4fed-a0c8-3b9066cafb19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c2c52c0461b4d73a28fcdcc799bc14e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:32.641806 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d4991cf0-128e-4fed-a0c8-3b9066cafb19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c2c52c0461b4d73a28fcdcc799bc14e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:32.653998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1006/1997] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:32 2022] DELETE /identity/v3/users/8c2c52c0461b4d73a28fcdcc799bc14e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:30:32.656103 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5d176-4917-4d5a-8cb2-b9728c647f32 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:32.660072 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5d176-4917-4d5a-8cb2-b9728c647f32 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:32.660604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5d176-4917-4d5a-8cb2-b9728c647f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:32.700526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-27b5d176-4917-4d5a-8cb2-b9728c647f32 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:32.700921 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 992/1998] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:32.705237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-27b5d176-4917-4d5a-8cb2-b9728c647f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:32.739868 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae87b6a-3e9f-4a83-a6be-397515b5dc10 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:32.743872 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-8ae87b6a-3e9f-4a83-a6be-397515b5dc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:32.847269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:32.857123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae87b6a-3e9f-4a83-a6be-397515b5dc10 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:32.966929 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1007/1999] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:32.987336 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e042243-34f2-47ce-8853-11edcd3b6da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:32.988473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e042243-34f2-47ce-8853-11edcd3b6da1 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:32.988752 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e042243-34f2-47ce-8853-11edcd3b6da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:32.989016 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e042243-34f2-47ce-8853-11edcd3b6da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:32.989631 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5d176-4917-4d5a-8cb2-b9728c647f32 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:32.993050 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-27b5d176-4917-4d5a-8cb2-b9728c647f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:33.007642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e042243-34f2-47ce-8853-11edcd3b6da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:33.010324 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e042243-34f2-47ce-8853-11edcd3b6da1 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:33.024959 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5d176-4917-4d5a-8cb2-b9728c647f32 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:33.038602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62f21b-0a06-406b-8b41-6629c43d2a8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:33.040545 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 993/2000] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:30:33.040899 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62f21b-0a06-406b-8b41-6629c43d2a8d service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:33.041373 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62f21b-0a06-406b-8b41-6629c43d2a8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:33.042505 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62f21b-0a06-406b-8b41-6629c43d2a8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:33.060859 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e62f21b-0a06-406b-8b41-6629c43d2a8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:33.062878 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e62f21b-0a06-406b-8b41-6629c43d2a8d service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:33.079159 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1008/2001] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:30:33.853528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e042243-34f2-47ce-8853-11edcd3b6da1 service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:33.855959 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-9e042243-34f2-47ce-8853-11edcd3b6da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:33.895549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e042243-34f2-47ce-8853-11edcd3b6da1 service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:33.902048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ef991-e339-412e-9a1d-7a096720afa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:33.903770 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ef991-e339-412e-9a1d-7a096720afa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:33.904130 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ef991-e339-412e-9a1d-7a096720afa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:33.904475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ef991-e339-412e-9a1d-7a096720afa4 admin admin] PATH_INFO: `/v3/projects/8504c684a75f4e55ad0168a4741e7629` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:33.905949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ef991-e339-412e-9a1d-7a096720afa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8504c684a75f4e55ad0168a4741e7629)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:33.911045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ef991-e339-412e-9a1d-7a096720afa4 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:33.987387 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-481ef991-e339-412e-9a1d-7a096720afa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8504c684a75f4e55ad0168a4741e7629', 'request_id': 'req-481ef991-e339-412e-9a1d-7a096720afa4'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:33.998268 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-481ef991-e339-412e-9a1d-7a096720afa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8504c684a75f4e55ad0168a4741e7629', 'request_id': 'req-481ef991-e339-412e-9a1d-7a096720afa4'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:34.008410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-481ef991-e339-412e-9a1d-7a096720afa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8504c684a75f4e55ad0168a4741e7629', 'request_id': 'req-481ef991-e339-412e-9a1d-7a096720afa4'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:34.030225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-481ef991-e339-412e-9a1d-7a096720afa4 admin admin] The token cache is being invalidate because project 8504c684a75f4e55ad0168a4741e7629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:34.030919 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-481ef991-e339-412e-9a1d-7a096720afa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:34.032625 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-481ef991-e339-412e-9a1d-7a096720afa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:34.034936 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 994/2002] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:33 2022] DELETE /identity/v3/projects/8504c684a75f4e55ad0168a4741e7629 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:34.040060 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62f21b-0a06-406b-8b41-6629c43d2a8d service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:34.093998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62f21b-0a06-406b-8b41-6629c43d2a8d service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:34.188605 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ef991-e339-412e-9a1d-7a096720afa4 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:34.190831 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-481ef991-e339-412e-9a1d-7a096720afa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:34.246270 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:34.290416 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d22cf-f8a2-4382-854a-d37660611bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:34.291436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d22cf-f8a2-4382-854a-d37660611bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:34.296627 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d22cf-f8a2-4382-854a-d37660611bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:34.298217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d22cf-f8a2-4382-854a-d37660611bcf admin admin] PATH_INFO: `/v3/users/af5976bca1a14be485c3320e35de7a21` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:34.300328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d22cf-f8a2-4382-854a-d37660611bcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=af5976bca1a14be485c3320e35de7a21)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:34.308547 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d22cf-f8a2-4382-854a-d37660611bcf admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:34.393553 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ef991-e339-412e-9a1d-7a096720afa4 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:34.434624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5459276-2872-4e8e-91ae-1ca31d594582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:34.435287 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5459276-2872-4e8e-91ae-1ca31d594582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:34.435964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5459276-2872-4e8e-91ae-1ca31d594582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:34.439269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5459276-2872-4e8e-91ae-1ca31d594582 admin admin] PATH_INFO: `/v3/projects/abbb94fc996942eba0997f61f3a847b5` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:34.444504 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5459276-2872-4e8e-91ae-1ca31d594582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abbb94fc996942eba0997f61f3a847b5)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:34.459230 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5459276-2872-4e8e-91ae-1ca31d594582 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:34.477666 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-105d22cf-f8a2-4382-854a-d37660611bcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af5976bca1a14be485c3320e35de7a21'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:34.478885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-105d22cf-f8a2-4382-854a-d37660611bcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af5976bca1a14be485c3320e35de7a21'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:34.493631 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-105d22cf-f8a2-4382-854a-d37660611bcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af5976bca1a14be485c3320e35de7a21'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:34.542521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-105d22cf-f8a2-4382-854a-d37660611bcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af5976bca1a14be485c3320e35de7a21'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:34.574289 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-105d22cf-f8a2-4382-854a-d37660611bcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af5976bca1a14be485c3320e35de7a21'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:34.590496 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1009/2003] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:34 2022] DELETE /identity/v3/users/af5976bca1a14be485c3320e35de7a21 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:34.633108 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:34.669388 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c5459276-2872-4e8e-91ae-1ca31d594582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abbb94fc996942eba0997f61f3a847b5', 'request_id': 'req-c5459276-2872-4e8e-91ae-1ca31d594582'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:34.678570 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c5459276-2872-4e8e-91ae-1ca31d594582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abbb94fc996942eba0997f61f3a847b5', 'request_id': 'req-c5459276-2872-4e8e-91ae-1ca31d594582'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:34.700739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c5459276-2872-4e8e-91ae-1ca31d594582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abbb94fc996942eba0997f61f3a847b5', 'request_id': 'req-c5459276-2872-4e8e-91ae-1ca31d594582'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:34.720646 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c5459276-2872-4e8e-91ae-1ca31d594582 admin admin] The token cache is being invalidate because project abbb94fc996942eba0997f61f3a847b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:34.722272 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c5459276-2872-4e8e-91ae-1ca31d594582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:34.724113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c5459276-2872-4e8e-91ae-1ca31d594582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:34.729653 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 995/2004] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:34 2022] DELETE /identity/v3/projects/abbb94fc996942eba0997f61f3a847b5 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:34.734142 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d22cf-f8a2-4382-854a-d37660611bcf admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:34.736288 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-105d22cf-f8a2-4382-854a-d37660611bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:34.852448 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5459276-2872-4e8e-91ae-1ca31d594582 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:34.855289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-c5459276-2872-4e8e-91ae-1ca31d594582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:34.858994 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d22cf-f8a2-4382-854a-d37660611bcf admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:34.956119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc699e5a-146a-492c-8ee3-82575bed5b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:34.956980 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc699e5a-146a-492c-8ee3-82575bed5b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:34.957263 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc699e5a-146a-492c-8ee3-82575bed5b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:34.957538 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc699e5a-146a-492c-8ee3-82575bed5b3f admin admin] PATH_INFO: `/v3/users/27c8813686d24b1690ff64aa831d9ddc` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:34.959039 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc699e5a-146a-492c-8ee3-82575bed5b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=27c8813686d24b1690ff64aa831d9ddc)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:34.961200 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc699e5a-146a-492c-8ee3-82575bed5b3f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:34.990170 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:35.062585 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bc699e5a-146a-492c-8ee3-82575bed5b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27c8813686d24b1690ff64aa831d9ddc'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:35.066967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bc699e5a-146a-492c-8ee3-82575bed5b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27c8813686d24b1690ff64aa831d9ddc'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:35.099473 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bc699e5a-146a-492c-8ee3-82575bed5b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27c8813686d24b1690ff64aa831d9ddc'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:35.117037 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5459276-2872-4e8e-91ae-1ca31d594582 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:35.131603 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9fb87-b1e4-41aa-8be5-68df63eb0cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:35.136292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9fb87-b1e4-41aa-8be5-68df63eb0cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:35.139030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9fb87-b1e4-41aa-8be5-68df63eb0cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:35.140295 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9fb87-b1e4-41aa-8be5-68df63eb0cd1 admin admin] PATH_INFO: `/v3/projects/8484e107e9054dc78f091f8d8152a4b8` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:35.143491 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9fb87-b1e4-41aa-8be5-68df63eb0cd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8484e107e9054dc78f091f8d8152a4b8)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:35.149707 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9fb87-b1e4-41aa-8be5-68df63eb0cd1 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:35.150586 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bc699e5a-146a-492c-8ee3-82575bed5b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27c8813686d24b1690ff64aa831d9ddc'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:35.179500 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-bc699e5a-146a-492c-8ee3-82575bed5b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27c8813686d24b1690ff64aa831d9ddc'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:35.205793 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1010/2005] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:34 2022] DELETE /identity/v3/users/27c8813686d24b1690ff64aa831d9ddc => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:35.296842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-82d9fb87-b1e4-41aa-8be5-68df63eb0cd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8484e107e9054dc78f091f8d8152a4b8', 'request_id': 'req-82d9fb87-b1e4-41aa-8be5-68df63eb0cd1'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:35.311165 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-82d9fb87-b1e4-41aa-8be5-68df63eb0cd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8484e107e9054dc78f091f8d8152a4b8', 'request_id': 'req-82d9fb87-b1e4-41aa-8be5-68df63eb0cd1'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:35.337154 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-82d9fb87-b1e4-41aa-8be5-68df63eb0cd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8484e107e9054dc78f091f8d8152a4b8', 'request_id': 'req-82d9fb87-b1e4-41aa-8be5-68df63eb0cd1'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:35.358628 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-82d9fb87-b1e4-41aa-8be5-68df63eb0cd1 admin admin] The token cache is being invalidate because project 8484e107e9054dc78f091f8d8152a4b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:35.359159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-82d9fb87-b1e4-41aa-8be5-68df63eb0cd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:35.361053 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-82d9fb87-b1e4-41aa-8be5-68df63eb0cd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:35.365846 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 996/2006] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:34 2022] DELETE /identity/v3/projects/8484e107e9054dc78f091f8d8152a4b8 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:35.367104 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc699e5a-146a-492c-8ee3-82575bed5b3f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:35.369401 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bc699e5a-146a-492c-8ee3-82575bed5b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:35.545072 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc699e5a-146a-492c-8ee3-82575bed5b3f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:35.719844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741b94f-cce8-4f1f-8fda-ff237fbd27e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:35.720841 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741b94f-cce8-4f1f-8fda-ff237fbd27e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:35.721339 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741b94f-cce8-4f1f-8fda-ff237fbd27e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:35.721753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741b94f-cce8-4f1f-8fda-ff237fbd27e1 admin admin] PATH_INFO: `/v3/users/4a10be83d64c432cb16e628a39a43ee6` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:35.725846 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741b94f-cce8-4f1f-8fda-ff237fbd27e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a10be83d64c432cb16e628a39a43ee6)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:35.735398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741b94f-cce8-4f1f-8fda-ff237fbd27e1 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:35.838070 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:35.844603 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d741b94f-cce8-4f1f-8fda-ff237fbd27e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a10be83d64c432cb16e628a39a43ee6'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:35.845895 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d741b94f-cce8-4f1f-8fda-ff237fbd27e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a10be83d64c432cb16e628a39a43ee6'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:35.859687 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d741b94f-cce8-4f1f-8fda-ff237fbd27e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a10be83d64c432cb16e628a39a43ee6'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:35.879105 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d741b94f-cce8-4f1f-8fda-ff237fbd27e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a10be83d64c432cb16e628a39a43ee6'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:35.898281 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d741b94f-cce8-4f1f-8fda-ff237fbd27e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a10be83d64c432cb16e628a39a43ee6'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:35.922007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1011/2007] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:35 2022] DELETE /identity/v3/users/4a10be83d64c432cb16e628a39a43ee6 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:36.195437 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9fb87-b1e4-41aa-8be5-68df63eb0cd1 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:36.199502 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-82d9fb87-b1e4-41aa-8be5-68df63eb0cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:36.262514 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9fb87-b1e4-41aa-8be5-68df63eb0cd1 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:36.409862 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:36.429885 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71b02b-4fe0-4669-b1f3-c4c4c2608a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:36.439131 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71b02b-4fe0-4669-b1f3-c4c4c2608a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:36.439131 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71b02b-4fe0-4669-b1f3-c4c4c2608a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:36.439131 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71b02b-4fe0-4669-b1f3-c4c4c2608a1a admin admin] PATH_INFO: `/v3/projects/f4833b2111aa4d26a4339cba125892b2` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:36.441937 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71b02b-4fe0-4669-b1f3-c4c4c2608a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4833b2111aa4d26a4339cba125892b2)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:36.443534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71b02b-4fe0-4669-b1f3-c4c4c2608a1a admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:36.542707 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-de71b02b-4fe0-4669-b1f3-c4c4c2608a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4833b2111aa4d26a4339cba125892b2', 'request_id': 'req-de71b02b-4fe0-4669-b1f3-c4c4c2608a1a'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:36.567088 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-de71b02b-4fe0-4669-b1f3-c4c4c2608a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4833b2111aa4d26a4339cba125892b2', 'request_id': 'req-de71b02b-4fe0-4669-b1f3-c4c4c2608a1a'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:36.584672 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-de71b02b-4fe0-4669-b1f3-c4c4c2608a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4833b2111aa4d26a4339cba125892b2', 'request_id': 'req-de71b02b-4fe0-4669-b1f3-c4c4c2608a1a'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:36.599601 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741b94f-cce8-4f1f-8fda-ff237fbd27e1 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:36.600766 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-de71b02b-4fe0-4669-b1f3-c4c4c2608a1a admin admin] The token cache is being invalidate because project f4833b2111aa4d26a4339cba125892b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:36.601058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-de71b02b-4fe0-4669-b1f3-c4c4c2608a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:36.601175 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d741b94f-cce8-4f1f-8fda-ff237fbd27e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:36.602060 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-de71b02b-4fe0-4669-b1f3-c4c4c2608a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:36.604980 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 997/2008] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:36 2022] DELETE /identity/v3/projects/f4833b2111aa4d26a4339cba125892b2 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:36.610161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b31f9d-3792-4c36-a642-de0d18615ec1 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:36.610577 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b31f9d-3792-4c36-a642-de0d18615ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:36.610981 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b31f9d-3792-4c36-a642-de0d18615ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:36.641117 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741b94f-cce8-4f1f-8fda-ff237fbd27e1 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:36.654126 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-a0b31f9d-3792-4c36-a642-de0d18615ec1 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:36.656351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a0b31f9d-3792-4c36-a642-de0d18615ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:36.757446 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721010b-b155-401b-90a5-0501ce95ef8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:36.758613 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721010b-b155-401b-90a5-0501ce95ef8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:36.759043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721010b-b155-401b-90a5-0501ce95ef8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:36.759488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721010b-b155-401b-90a5-0501ce95ef8c admin admin] PATH_INFO: `/v3/projects/2d096e850360483a85deaab78d8836d2` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:36.761608 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721010b-b155-401b-90a5-0501ce95ef8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d096e850360483a85deaab78d8836d2)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:36.763814 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721010b-b155-401b-90a5-0501ce95ef8c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:36.770885 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 998/2009] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:36.775740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51aa88-99bc-4242-9e24-c0c0284e5b8b None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:36.775740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51aa88-99bc-4242-9e24-c0c0284e5b8b None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:36.775740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51aa88-99bc-4242-9e24-c0c0284e5b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:36.816548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-df51aa88-99bc-4242-9e24-c0c0284e5b8b None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:36.818309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-df51aa88-99bc-4242-9e24-c0c0284e5b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:36.833908 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 999/2010] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:36.838266 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51aa88-99bc-4242-9e24-c0c0284e5b8b None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:36.849495 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51aa88-99bc-4242-9e24-c0c0284e5b8b None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:36.865410 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0721010b-b155-401b-90a5-0501ce95ef8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d096e850360483a85deaab78d8836d2', 'request_id': 'req-0721010b-b155-401b-90a5-0501ce95ef8c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:36.877249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0721010b-b155-401b-90a5-0501ce95ef8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d096e850360483a85deaab78d8836d2', 'request_id': 'req-0721010b-b155-401b-90a5-0501ce95ef8c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:36.887673 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0721010b-b155-401b-90a5-0501ce95ef8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d096e850360483a85deaab78d8836d2', 'request_id': 'req-0721010b-b155-401b-90a5-0501ce95ef8c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:36.912136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0721010b-b155-401b-90a5-0501ce95ef8c admin admin] The token cache is being invalidate because project 2d096e850360483a85deaab78d8836d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:36.912406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0721010b-b155-401b-90a5-0501ce95ef8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:36.915298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0721010b-b155-401b-90a5-0501ce95ef8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:36.923976 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1012/2011] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:36 2022] DELETE /identity/v3/projects/2d096e850360483a85deaab78d8836d2 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:30:36.926512 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09685f0-bcdf-49f2-89c3-ee2563de202e None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:36.927012 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09685f0-bcdf-49f2-89c3-ee2563de202e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:36.927294 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09685f0-bcdf-49f2-89c3-ee2563de202e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:36.946150 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02373acf-0f7d-4dec-8999-0b0a468e2822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:36.946150 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02373acf-0f7d-4dec-8999-0b0a468e2822 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:36.946150 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02373acf-0f7d-4dec-8999-0b0a468e2822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:36.946150 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02373acf-0f7d-4dec-8999-0b0a468e2822 admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:36.946529 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02373acf-0f7d-4dec-8999-0b0a468e2822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:30:36.946529 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02373acf-0f7d-4dec-8999-0b0a468e2822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:36.947551 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02373acf-0f7d-4dec-8999-0b0a468e2822 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:36.961332 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c09685f0-bcdf-49f2-89c3-ee2563de202e None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:36.963248 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c09685f0-bcdf-49f2-89c3-ee2563de202e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:36.975654 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1000/2012] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:30:36.980230 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1013/2013] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:30:36.984472 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02373acf-0f7d-4dec-8999-0b0a468e2822 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:36.986515 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-02373acf-0f7d-4dec-8999-0b0a468e2822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:36.988926 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac5387-dc81-4cb2-b002-82b4cff3dbdd None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:36.989205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac5387-dc81-4cb2-b002-82b4cff3dbdd None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:36.989472 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac5387-dc81-4cb2-b002-82b4cff3dbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:37.018233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-6aac5387-dc81-4cb2-b002-82b4cff3dbdd None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:37.019444 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6aac5387-dc81-4cb2-b002-82b4cff3dbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:37.022061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02373acf-0f7d-4dec-8999-0b0a468e2822 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:37.034483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f78f3d-9625-43a3-8525-ac0d27627d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:37.035224 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1014/2014] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:30:37.036347 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f78f3d-9625-43a3-8525-ac0d27627d53 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:37.036698 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f78f3d-9625-43a3-8525-ac0d27627d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:37.037857 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f78f3d-9625-43a3-8525-ac0d27627d53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:37.038600 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f78f3d-9625-43a3-8525-ac0d27627d53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:37.039349 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac5387-dc81-4cb2-b002-82b4cff3dbdd None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:37.040932 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f78f3d-9625-43a3-8525-ac0d27627d53 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:37.048251 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:37.060746 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac5387-dc81-4cb2-b002-82b4cff3dbdd None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:37.074989 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253a373-85cb-48e7-a1ab-eb3593ab0c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:37.075905 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253a373-85cb-48e7-a1ab-eb3593ab0c9a admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:37.077366 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253a373-85cb-48e7-a1ab-eb3593ab0c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:37.077366 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253a373-85cb-48e7-a1ab-eb3593ab0c9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:37.078753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253a373-85cb-48e7-a1ab-eb3593ab0c9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:30:37.079294 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253a373-85cb-48e7-a1ab-eb3593ab0c9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:37.082490 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253a373-85cb-48e7-a1ab-eb3593ab0c9a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:37.101638 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1015/2015] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:30:37.102113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1001/2016] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:36 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:37.109680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253a373-85cb-48e7-a1ab-eb3593ab0c9a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:37.110047 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f78f3d-9625-43a3-8525-ac0d27627d53 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:37.128274 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253a373-85cb-48e7-a1ab-eb3593ab0c9a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:37.173883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:37.277343 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6b070-77d3-4afe-b119-c328885baac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:37.277864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6b070-77d3-4afe-b119-c328885baac0 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:37.278627 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6b070-77d3-4afe-b119-c328885baac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:37.278627 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6b070-77d3-4afe-b119-c328885baac0 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:37.279054 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6b070-77d3-4afe-b119-c328885baac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:37.283185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6b070-77d3-4afe-b119-c328885baac0 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:37.285533 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f78f3d-9625-43a3-8525-ac0d27627d53 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:37.303813 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfe332-78e3-4df9-be57-b360ecf99dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:37.304720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfe332-78e3-4df9-be57-b360ecf99dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:37.305333 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfe332-78e3-4df9-be57-b360ecf99dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:37.305758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfe332-78e3-4df9-be57-b360ecf99dd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:37.306556 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfe332-78e3-4df9-be57-b360ecf99dd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:37.311278 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfe332-78e3-4df9-be57-b360ecf99dd4 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:37.331672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1016/2017] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:37 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:37.336092 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6b070-77d3-4afe-b119-c328885baac0 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:37.353320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6b070-77d3-4afe-b119-c328885baac0 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:37.359953 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33285b1e-57c8-453e-aa00-fbc0fc437eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:37.362144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33285b1e-57c8-453e-aa00-fbc0fc437eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:37.362628 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33285b1e-57c8-453e-aa00-fbc0fc437eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:37.362971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33285b1e-57c8-453e-aa00-fbc0fc437eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:37.363661 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33285b1e-57c8-453e-aa00-fbc0fc437eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:37.365507 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33285b1e-57c8-453e-aa00-fbc0fc437eeb admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:37.370167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1002/2018] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:37 2022] POST /identity/v3/projects => generated 407 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:37.375082 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfe332-78e3-4df9-be57-b360ecf99dd4 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:37.383760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1017/2019] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:30:37.391171 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33285b1e-57c8-453e-aa00-fbc0fc437eeb admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:37.405734 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33285b1e-57c8-453e-aa00-fbc0fc437eeb admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:37.489281 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76de1be-b2a3-4319-a5be-1ae3dcf679f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:37.490339 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76de1be-b2a3-4319-a5be-1ae3dcf679f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:37.490627 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76de1be-b2a3-4319-a5be-1ae3dcf679f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:37.490899 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76de1be-b2a3-4319-a5be-1ae3dcf679f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:37.491550 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76de1be-b2a3-4319-a5be-1ae3dcf679f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:37.493930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76de1be-b2a3-4319-a5be-1ae3dcf679f5 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:37.506393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfe332-78e3-4df9-be57-b360ecf99dd4 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:37.507262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1018/2020] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:37.508172 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76de1be-b2a3-4319-a5be-1ae3dcf679f5 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:37.511415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f76de1be-b2a3-4319-a5be-1ae3dcf679f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:37.513256 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc31550-9445-4915-839d-c31b17c3a7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:37.514306 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc31550-9445-4915-839d-c31b17c3a7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:37.514749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc31550-9445-4915-839d-c31b17c3a7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:37.515168 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc31550-9445-4915-839d-c31b17c3a7d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:37.516044 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc31550-9445-4915-839d-c31b17c3a7d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:37.532708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76de1be-b2a3-4319-a5be-1ae3dcf679f5 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:37.536119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc31550-9445-4915-839d-c31b17c3a7d2 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:37.538373 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226355d-6e68-4c55-8c5d-2385512336a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:37.539266 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226355d-6e68-4c55-8c5d-2385512336a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:37.539588 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226355d-6e68-4c55-8c5d-2385512336a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:37.539844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226355d-6e68-4c55-8c5d-2385512336a9 admin admin] PATH_INFO: `/v3/projects/9f84314073ec446f9c64d7c609928d95` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:37.541423 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226355d-6e68-4c55-8c5d-2385512336a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f84314073ec446f9c64d7c609928d95)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:37.543693 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226355d-6e68-4c55-8c5d-2385512336a9 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:37.593295 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1003/2021] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:37 2022] POST /identity/v3/users => generated 304 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:30:37.596935 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc31550-9445-4915-839d-c31b17c3a7d2 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:37.624501 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc31550-9445-4915-839d-c31b17c3a7d2 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:37.635257 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39d2b3-c69b-4a95-aff4-f86cbfa29ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:37.637287 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39d2b3-c69b-4a95-aff4-f86cbfa29ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:37.637559 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39d2b3-c69b-4a95-aff4-f86cbfa29ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:37.637834 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39d2b3-c69b-4a95-aff4-f86cbfa29ba0 admin admin] PATH_INFO: `/v3/projects/1955d6d7a9344b468cda9a57d6f608bd/users/cf8c961bd4104cf78f78e15cf29a8a1a/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:37.659653 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8226355d-6e68-4c55-8c5d-2385512336a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f84314073ec446f9c64d7c609928d95', 'request_id': 'req-8226355d-6e68-4c55-8c5d-2385512336a9'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:37.666430 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39d2b3-c69b-4a95-aff4-f86cbfa29ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1955d6d7a9344b468cda9a57d6f608bd, user_id=cf8c961bd4104cf78f78e15cf29a8a1a, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:37.670213 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39d2b3-c69b-4a95-aff4-f86cbfa29ba0 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:37.672841 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8226355d-6e68-4c55-8c5d-2385512336a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f84314073ec446f9c64d7c609928d95', 'request_id': 'req-8226355d-6e68-4c55-8c5d-2385512336a9'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:37.682934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8226355d-6e68-4c55-8c5d-2385512336a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f84314073ec446f9c64d7c609928d95', 'request_id': 'req-8226355d-6e68-4c55-8c5d-2385512336a9'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:37.696489 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1004/2022] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:37 2022] PUT /identity/v3/projects/1955d6d7a9344b468cda9a57d6f608bd/users/cf8c961bd4104cf78f78e15cf29a8a1a/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:37.706432 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39d2b3-c69b-4a95-aff4-f86cbfa29ba0 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:37.726339 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8226355d-6e68-4c55-8c5d-2385512336a9 admin admin] The token cache is being invalidate because project 9f84314073ec446f9c64d7c609928d95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:37.726757 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8226355d-6e68-4c55-8c5d-2385512336a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:37.727545 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8226355d-6e68-4c55-8c5d-2385512336a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:37.729350 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1019/2023] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:37 2022] DELETE /identity/v3/projects/9f84314073ec446f9c64d7c609928d95 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:37.734441 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55022b-8ef4-4079-b4e6-a8b54fb18d64 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:37.734695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55022b-8ef4-4079-b4e6-a8b54fb18d64 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:37.735168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55022b-8ef4-4079-b4e6-a8b54fb18d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:37.774551 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:37.789106 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-6e55022b-8ef4-4079-b4e6-a8b54fb18d64 None None] MFA Rules not processed for user `cf8c961bd4104cf78f78e15cf29a8a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:37.790317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6e55022b-8ef4-4079-b4e6-a8b54fb18d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:37.804431 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:37.814125 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39d2b3-c69b-4a95-aff4-f86cbfa29ba0 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:37.823075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b5701-955c-418b-be8d-5a0460edf698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:37.823758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b5701-955c-418b-be8d-5a0460edf698 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:37.824212 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b5701-955c-418b-be8d-5a0460edf698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:37.824499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b5701-955c-418b-be8d-5a0460edf698 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:37.825158 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b5701-955c-418b-be8d-5a0460edf698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:37.826818 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b5701-955c-418b-be8d-5a0460edf698 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:37.841182 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1005/2024] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:37.841182 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfb8e6-26dd-492a-a88c-5fc757c5152a None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:37.844543 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfb8e6-26dd-492a-a88c-5fc757c5152a None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:37.844543 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfb8e6-26dd-492a-a88c-5fc757c5152a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:37.870462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-89bfb8e6-26dd-492a-a88c-5fc757c5152a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:37.872237 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-89bfb8e6-26dd-492a-a88c-5fc757c5152a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:37.891822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1006/2025] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:37.892007 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfb8e6-26dd-492a-a88c-5fc757c5152a None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:37.894402 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-89bfb8e6-26dd-492a-a88c-5fc757c5152a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:37.900567 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1020/2026] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:37.908049 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec866e-b358-495a-9274-2c1bfa351a28 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:37.908416 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec866e-b358-495a-9274-2c1bfa351a28 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:37.908670 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec866e-b358-495a-9274-2c1bfa351a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:37.917754 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfb8e6-26dd-492a-a88c-5fc757c5152a None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:37.924579 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b571f5-2747-44b9-acf3-2e2e5802a221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:37.925362 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b571f5-2747-44b9-acf3-2e2e5802a221 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:37.925739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b571f5-2747-44b9-acf3-2e2e5802a221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:37.926191 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b571f5-2747-44b9-acf3-2e2e5802a221 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:37.926938 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b571f5-2747-44b9-acf3-2e2e5802a221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:37.928746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b571f5-2747-44b9-acf3-2e2e5802a221 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:37.941276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ddec866e-b358-495a-9274-2c1bfa351a28 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:37.943050 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ddec866e-b358-495a-9274-2c1bfa351a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:37.945503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1007/2027] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:37.946222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b571f5-2747-44b9-acf3-2e2e5802a221 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:37.948176 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-73b571f5-2747-44b9-acf3-2e2e5802a221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:37.955809 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1021/2028] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:37.956728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec866e-b358-495a-9274-2c1bfa351a28 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:37.964791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b571f5-2747-44b9-acf3-2e2e5802a221 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:37.967476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec866e-b358-495a-9274-2c1bfa351a28 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:37.970320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094e87e-b917-47c0-a0de-74f38de58a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:37.971025 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094e87e-b917-47c0-a0de-74f38de58a1a admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:37.971456 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094e87e-b917-47c0-a0de-74f38de58a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:37.971663 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094e87e-b917-47c0-a0de-74f38de58a1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:37.972379 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094e87e-b917-47c0-a0de-74f38de58a1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:37.973485 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b924f5-d4e5-4ebc-a0c1-d7315f6bc458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:37.974147 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b924f5-d4e5-4ebc-a0c1-d7315f6bc458 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:37.974336 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094e87e-b917-47c0-a0de-74f38de58a1a admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:37.974430 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b924f5-d4e5-4ebc-a0c1-d7315f6bc458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:37.974686 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b924f5-d4e5-4ebc-a0c1-d7315f6bc458 admin admin] PATH_INFO: `/v3/projects/b18ff5165c754764916c490f819f490d/users/542b09dadd0042aca96b424458dae04b/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:37.993131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b924f5-d4e5-4ebc-a0c1-d7315f6bc458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b18ff5165c754764916c490f819f490d, user_id=542b09dadd0042aca96b424458dae04b, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:37.996667 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b924f5-d4e5-4ebc-a0c1-d7315f6bc458 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:38.011622 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1022/2029] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:37 2022] PUT /identity/v3/projects/b18ff5165c754764916c490f819f490d/users/542b09dadd0042aca96b424458dae04b/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:38.012652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b924f5-d4e5-4ebc-a0c1-d7315f6bc458 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:38.016071 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1008/2030] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:37 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:38.016937 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094e87e-b917-47c0-a0de-74f38de58a1a admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:38.096293 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b924f5-d4e5-4ebc-a0c1-d7315f6bc458 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:38.096913 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094e87e-b917-47c0-a0de-74f38de58a1a admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:38.102087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6e446-5400-447c-b663-aca8ecd331d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:38.102701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6e446-5400-447c-b663-aca8ecd331d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:38.102980 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6e446-5400-447c-b663-aca8ecd331d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:38.103256 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6e446-5400-447c-b663-aca8ecd331d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:38.103584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda1f92-4b72-43ee-b0cf-e8c1fb7216ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:38.103913 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6e446-5400-447c-b663-aca8ecd331d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:38.104318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda1f92-4b72-43ee-b0cf-e8c1fb7216ec admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:38.104600 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda1f92-4b72-43ee-b0cf-e8c1fb7216ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:38.104871 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda1f92-4b72-43ee-b0cf-e8c1fb7216ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:38.105524 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda1f92-4b72-43ee-b0cf-e8c1fb7216ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:30:38.105829 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda1f92-4b72-43ee-b0cf-e8c1fb7216ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:38.106118 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6e446-5400-447c-b663-aca8ecd331d2 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:38.107528 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda1f92-4b72-43ee-b0cf-e8c1fb7216ec admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:38.122651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1023/2031] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:30:38.123990 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd2072-a3c9-48d5-8898-0b3457a5696b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:38.126996 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd2072-a3c9-48d5-8898-0b3457a5696b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:38.127300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd2072-a3c9-48d5-8898-0b3457a5696b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:38.138795 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1009/2032] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:38 2022] POST /identity/v3/users => generated 298 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:38.139734 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6e446-5400-447c-b663-aca8ecd331d2 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:38.152322 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6e446-5400-447c-b663-aca8ecd331d2 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:38.159636 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534925c0-0213-492e-b65d-9c0360f6ef0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:38.160302 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534925c0-0213-492e-b65d-9c0360f6ef0d admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:38.160573 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534925c0-0213-492e-b65d-9c0360f6ef0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:38.160841 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534925c0-0213-492e-b65d-9c0360f6ef0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:38.161473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534925c0-0213-492e-b65d-9c0360f6ef0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:38.163407 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534925c0-0213-492e-b65d-9c0360f6ef0d admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:38.173094 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-89fd2072-a3c9-48d5-8898-0b3457a5696b None None] MFA Rules not processed for user `542b09dadd0042aca96b424458dae04b`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:38.174496 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-89fd2072-a3c9-48d5-8898-0b3457a5696b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:38.200991 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1010/2033] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:38 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:38.202041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534925c0-0213-492e-b65d-9c0360f6ef0d admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:38.289629 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1024/2034] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:38 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:38.294746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534925c0-0213-492e-b65d-9c0360f6ef0d admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:38.295252 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd2072-a3c9-48d5-8898-0b3457a5696b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:38.304948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:38.308577 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae68eb-cf2d-4a44-ae2a-2228163b5cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:38.309355 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae68eb-cf2d-4a44-ae2a-2228163b5cdc admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:38.309740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae68eb-cf2d-4a44-ae2a-2228163b5cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:38.310116 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae68eb-cf2d-4a44-ae2a-2228163b5cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:38.310882 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae68eb-cf2d-4a44-ae2a-2228163b5cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:38.313410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae68eb-cf2d-4a44-ae2a-2228163b5cdc admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:38.318625 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:38.323881 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd2072-a3c9-48d5-8898-0b3457a5696b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:38.335519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0bc66-d184-4e2b-b08b-6287f281ad68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:38.336553 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1011/2035] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:38.337204 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0bc66-d184-4e2b-b08b-6287f281ad68 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:38.337409 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae68eb-cf2d-4a44-ae2a-2228163b5cdc admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:38.337878 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0bc66-d184-4e2b-b08b-6287f281ad68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:38.339297 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0bc66-d184-4e2b-b08b-6287f281ad68 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:38.340798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0bc66-d184-4e2b-b08b-6287f281ad68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:38.342965 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0bc66-d184-4e2b-b08b-6287f281ad68 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:38.357932 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae68eb-cf2d-4a44-ae2a-2228163b5cdc admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:38.366031 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ac5be-4fc4-4ac5-a970-af24e3283387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:38.366746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ac5be-4fc4-4ac5-a970-af24e3283387 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:38.367028 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ac5be-4fc4-4ac5-a970-af24e3283387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:38.367332 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ac5be-4fc4-4ac5-a970-af24e3283387 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:38.368387 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ac5be-4fc4-4ac5-a970-af24e3283387 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:38.372976 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ac5be-4fc4-4ac5-a970-af24e3283387 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:38.379082 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1025/2036] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:38 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:38.382660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0bc66-d184-4e2b-b08b-6287f281ad68 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:38.395035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0bc66-d184-4e2b-b08b-6287f281ad68 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:38.401880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e807b-40ae-4080-8761-4efeb2c4c264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:38.402214 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e807b-40ae-4080-8761-4efeb2c4c264 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:38.402538 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e807b-40ae-4080-8761-4efeb2c4c264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:38.402755 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e807b-40ae-4080-8761-4efeb2c4c264 admin admin] PATH_INFO: `/v3/projects/cefab45ef1014e558f9f482914fa8516/users/da105622239643c6a5b5632211281373/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:38.414953 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1012/2037] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:38 2022] POST /identity/v3/projects => generated 409 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:38.417269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ac5be-4fc4-4ac5-a970-af24e3283387 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:38.430512 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e807b-40ae-4080-8761-4efeb2c4c264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cefab45ef1014e558f9f482914fa8516, user_id=da105622239643c6a5b5632211281373, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:38.435238 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e807b-40ae-4080-8761-4efeb2c4c264 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:38.460683 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1026/2038] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:38 2022] PUT /identity/v3/projects/cefab45ef1014e558f9f482914fa8516/users/da105622239643c6a5b5632211281373/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:38.462732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e807b-40ae-4080-8761-4efeb2c4c264 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:38.532806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ac5be-4fc4-4ac5-a970-af24e3283387 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:38.643094 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e09d3-ecac-460a-8952-13973115d138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:38.644090 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e09d3-ecac-460a-8952-13973115d138 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:38.644376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e09d3-ecac-460a-8952-13973115d138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:38.644888 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e09d3-ecac-460a-8952-13973115d138 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:38.645544 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e09d3-ecac-460a-8952-13973115d138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:38.647220 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e09d3-ecac-460a-8952-13973115d138 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:38.648511 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e807b-40ae-4080-8761-4efeb2c4c264 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:38.654718 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7f400-c154-4d0f-8c9f-3a7102295896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:38.655527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7f400-c154-4d0f-8c9f-3a7102295896 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:38.655899 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7f400-c154-4d0f-8c9f-3a7102295896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:38.656232 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7f400-c154-4d0f-8c9f-3a7102295896 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:38.656942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7f400-c154-4d0f-8c9f-3a7102295896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:38.659870 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7f400-c154-4d0f-8c9f-3a7102295896 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:38.668204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1013/2039] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:38.669269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e09d3-ecac-460a-8952-13973115d138 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:38.691120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e09d3-ecac-460a-8952-13973115d138 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:38.696602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1027/2040] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:38 2022] POST /identity/v3/users => generated 311 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:38.704155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b46a7-87ee-496c-99cd-74d22674f5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:38.705295 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b46a7-87ee-496c-99cd-74d22674f5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:38.705472 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7f400-c154-4d0f-8c9f-3a7102295896 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:38.705964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b46a7-87ee-496c-99cd-74d22674f5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:38.706710 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b46a7-87ee-496c-99cd-74d22674f5c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:38.710073 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b46a7-87ee-496c-99cd-74d22674f5c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:38.710073 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b46a7-87ee-496c-99cd-74d22674f5c8 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:38.728021 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7f400-c154-4d0f-8c9f-3a7102295896 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:38.729167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1014/2041] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:38.730340 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b46a7-87ee-496c-99cd-74d22674f5c8 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:38.739055 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ed1b0-a20e-4767-bcd4-1e2683531682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:38.740059 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ed1b0-a20e-4767-bcd4-1e2683531682 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:38.740425 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ed1b0-a20e-4767-bcd4-1e2683531682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:38.740780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ed1b0-a20e-4767-bcd4-1e2683531682 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:38.741884 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ed1b0-a20e-4767-bcd4-1e2683531682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:38.742679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b46a7-87ee-496c-99cd-74d22674f5c8 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:38.744092 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ed1b0-a20e-4767-bcd4-1e2683531682 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:38.749003 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104301c6-4907-47df-a594-099d057683ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:38.749704 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104301c6-4907-47df-a594-099d057683ff admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:38.750027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104301c6-4907-47df-a594-099d057683ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:38.750337 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104301c6-4907-47df-a594-099d057683ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:38.751102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104301c6-4907-47df-a594-099d057683ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:38.753136 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104301c6-4907-47df-a594-099d057683ff admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:38.769246 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1015/2042] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:38.770077 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1028/2043] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:38.773812 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104301c6-4907-47df-a594-099d057683ff admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:38.774809 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ed1b0-a20e-4767-bcd4-1e2683531682 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:38.786567 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104301c6-4907-47df-a594-099d057683ff admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:38.788844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ed1b0-a20e-4767-bcd4-1e2683531682 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:38.793870 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d20d4-9e25-49fd-89f9-0760e73cf64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:38.794787 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d20d4-9e25-49fd-89f9-0760e73cf64e admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:38.795147 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d20d4-9e25-49fd-89f9-0760e73cf64e admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:38.795695 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d20d4-9e25-49fd-89f9-0760e73cf64e admin admin] PATH_INFO: `/v3/projects/cefab45ef1014e558f9f482914fa8516/users/da105622239643c6a5b5632211281373/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:38.798046 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d20d4-9e25-49fd-89f9-0760e73cf64e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cefab45ef1014e558f9f482914fa8516, user_id=da105622239643c6a5b5632211281373, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:38.800794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741b6c0-8d9a-40f1-a776-46139e722a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:38.800794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741b6c0-8d9a-40f1-a776-46139e722a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:38.800794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741b6c0-8d9a-40f1-a776-46139e722a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:38.801342 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d20d4-9e25-49fd-89f9-0760e73cf64e admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:38.801495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741b6c0-8d9a-40f1-a776-46139e722a74 admin admin] PATH_INFO: `/v3/projects/7e35b5cd64d54f0fa90083608d1f75ac/users/dba12a0d721540648abc495b41229ed7/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:38.826894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1016/2044] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:38 2022] PUT /identity/v3/projects/cefab45ef1014e558f9f482914fa8516/users/da105622239643c6a5b5632211281373/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:38.826894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d20d4-9e25-49fd-89f9-0760e73cf64e admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:38.827223 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741b6c0-8d9a-40f1-a776-46139e722a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e35b5cd64d54f0fa90083608d1f75ac, user_id=dba12a0d721540648abc495b41229ed7, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:38.827223 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741b6c0-8d9a-40f1-a776-46139e722a74 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:38.857327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1029/2045] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:38 2022] PUT /identity/v3/projects/7e35b5cd64d54f0fa90083608d1f75ac/users/dba12a0d721540648abc495b41229ed7/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:38.860636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7957c7-8217-46c3-9914-0741a6dbe5cc None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:38.860910 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7957c7-8217-46c3-9914-0741a6dbe5cc None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:38.861176 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7957c7-8217-46c3-9914-0741a6dbe5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:38.907699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-dd7957c7-8217-46c3-9914-0741a6dbe5cc None None] MFA Rules not processed for user `da105622239643c6a5b5632211281373`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:38.907926 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:38.912225 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-dd7957c7-8217-46c3-9914-0741a6dbe5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:38.930705 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d20d4-9e25-49fd-89f9-0760e73cf64e admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:39.015535 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1030/2046] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:39.018013 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de1898-bdd1-4f3c-bc5e-2e5fc12e97b9 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:39.018013 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de1898-bdd1-4f3c-bc5e-2e5fc12e97b9 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:39.018013 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de1898-bdd1-4f3c-bc5e-2e5fc12e97b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:39.029562 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b1c21-c1d8-4d79-9b7a-563e7ff67c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:39.030555 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b1c21-c1d8-4d79-9b7a-563e7ff67c2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:39.030849 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b1c21-c1d8-4d79-9b7a-563e7ff67c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:39.031131 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b1c21-c1d8-4d79-9b7a-563e7ff67c2f admin admin] PATH_INFO: `/v3/projects/ace42324b0e54a3f86d14b6216431157/users/baad251aa4d7489ebd532734f13dfcf2/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:39.035449 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:39.057715 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b1c21-c1d8-4d79-9b7a-563e7ff67c2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace42324b0e54a3f86d14b6216431157, user_id=baad251aa4d7489ebd532734f13dfcf2, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:39.060277 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b1c21-c1d8-4d79-9b7a-563e7ff67c2f admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:39.075538 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-55de1898-bdd1-4f3c-bc5e-2e5fc12e97b9 None None] MFA Rules not processed for user `dba12a0d721540648abc495b41229ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:39.077136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-55de1898-bdd1-4f3c-bc5e-2e5fc12e97b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:39.084906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1017/2047] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:38 2022] PUT /identity/v3/projects/ace42324b0e54a3f86d14b6216431157/users/baad251aa4d7489ebd532734f13dfcf2/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:39.085751 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b1c21-c1d8-4d79-9b7a-563e7ff67c2f admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:39.092325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-2d7b1c21-c1d8-4d79-9b7a-563e7ff67c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:39.193159 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1031/2048] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:39.194773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de1898-bdd1-4f3c-bc5e-2e5fc12e97b9 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:39.201105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b1c21-c1d8-4d79-9b7a-563e7ff67c2f admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:39.206293 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3226b24-1d31-4377-ac73-72354125b332 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:39.207556 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3226b24-1d31-4377-ac73-72354125b332 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:39.208120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3226b24-1d31-4377-ac73-72354125b332 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:39.208375 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3226b24-1d31-4377-ac73-72354125b332 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:39.309686 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de1898-bdd1-4f3c-bc5e-2e5fc12e97b9 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:39.318161 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b69736-62c7-48e1-a0bd-c59e6c4750cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:39.318930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b69736-62c7-48e1-a0bd-c59e6c4750cd admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:39.319266 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b69736-62c7-48e1-a0bd-c59e6c4750cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:39.319797 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b69736-62c7-48e1-a0bd-c59e6c4750cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:39.321408 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3226b24-1d31-4377-ac73-72354125b332 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:39.321825 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b69736-62c7-48e1-a0bd-c59e6c4750cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:39.321905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3226b24-1d31-4377-ac73-72354125b332 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:39.322247 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b69736-62c7-48e1-a0bd-c59e6c4750cd admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:39.333886 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1018/2049] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:39.334552 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3226b24-1d31-4377-ac73-72354125b332 service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:39.336008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f3226b24-1d31-4377-ac73-72354125b332 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:39.340897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1032/2050] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:39.341841 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b69736-62c7-48e1-a0bd-c59e6c4750cd admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:39.353513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b69736-62c7-48e1-a0bd-c59e6c4750cd admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:39.355812 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3226b24-1d31-4377-ac73-72354125b332 service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:39.358717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62b0a6-7426-4af0-8c46-05b43ea348ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:39.359384 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62b0a6-7426-4af0-8c46-05b43ea348ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:39.359659 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62b0a6-7426-4af0-8c46-05b43ea348ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:39.359993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62b0a6-7426-4af0-8c46-05b43ea348ed admin admin] PATH_INFO: `/v3/projects/ace42324b0e54a3f86d14b6216431157/users/baad251aa4d7489ebd532734f13dfcf2/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:39.361897 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339cff5-c3aa-4333-943a-802b377e0f6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:39.362836 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62b0a6-7426-4af0-8c46-05b43ea348ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace42324b0e54a3f86d14b6216431157, user_id=baad251aa4d7489ebd532734f13dfcf2, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:39.365739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339cff5-c3aa-4333-943a-802b377e0f6e service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:39.366167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339cff5-c3aa-4333-943a-802b377e0f6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:39.366371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62b0a6-7426-4af0-8c46-05b43ea348ed admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:39.366629 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339cff5-c3aa-4333-943a-802b377e0f6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:39.380144 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339cff5-c3aa-4333-943a-802b377e0f6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:39.381953 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339cff5-c3aa-4333-943a-802b377e0f6e service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:39.392860 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1033/2051] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:39 2022] PUT /identity/v3/projects/ace42324b0e54a3f86d14b6216431157/users/baad251aa4d7489ebd532734f13dfcf2/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:39.395211 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ec7b0-91a0-4f02-9835-62ed53319d01 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:39.395499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ec7b0-91a0-4f02-9835-62ed53319d01 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:39.395802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ec7b0-91a0-4f02-9835-62ed53319d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:39.398147 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1019/2052] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:39.425223 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339cff5-c3aa-4333-943a-802b377e0f6e service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:39.441132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-b04ec7b0-91a0-4f02-9835-62ed53319d01 None None] MFA Rules not processed for user `baad251aa4d7489ebd532734f13dfcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:39.443492 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b04ec7b0-91a0-4f02-9835-62ed53319d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:39.444159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339cff5-c3aa-4333-943a-802b377e0f6e service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:39.468803 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:39.597689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:39.598643 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007dbcfd-3c3a-458b-8687-2b0474d4e973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:39.600161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007dbcfd-3c3a-458b-8687-2b0474d4e973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:39.600781 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007dbcfd-3c3a-458b-8687-2b0474d4e973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:39.600919 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007dbcfd-3c3a-458b-8687-2b0474d4e973 admin admin] PATH_INFO: `/v3/users/dba12a0d721540648abc495b41229ed7` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:39.603078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007dbcfd-3c3a-458b-8687-2b0474d4e973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dba12a0d721540648abc495b41229ed7)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:39.608446 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007dbcfd-3c3a-458b-8687-2b0474d4e973 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:39.609362 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1034/2053] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:39 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:30:39.627011 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ec7b0-91a0-4f02-9835-62ed53319d01 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:39.750656 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-007dbcfd-3c3a-458b-8687-2b0474d4e973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dba12a0d721540648abc495b41229ed7'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:39.751973 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-007dbcfd-3c3a-458b-8687-2b0474d4e973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dba12a0d721540648abc495b41229ed7'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:39.782805 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-007dbcfd-3c3a-458b-8687-2b0474d4e973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dba12a0d721540648abc495b41229ed7'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:39.795469 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-007dbcfd-3c3a-458b-8687-2b0474d4e973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dba12a0d721540648abc495b41229ed7'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:39.796504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ec7b0-91a0-4f02-9835-62ed53319d01 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:39.805398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e745a5-9dfa-46a1-90a8-ee57b55368ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:39.806501 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e745a5-9dfa-46a1-90a8-ee57b55368ea service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:39.806749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e745a5-9dfa-46a1-90a8-ee57b55368ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:39.807269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e745a5-9dfa-46a1-90a8-ee57b55368ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:39.810419 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-007dbcfd-3c3a-458b-8687-2b0474d4e973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dba12a0d721540648abc495b41229ed7'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:39.821969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1020/2054] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:39 2022] DELETE /identity/v3/users/dba12a0d721540648abc495b41229ed7 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:39.826564 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e745a5-9dfa-46a1-90a8-ee57b55368ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:39.827468 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4a470-cf3a-492d-ae86-9b5b06b33220 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:39.828149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4a470-cf3a-492d-ae86-9b5b06b33220 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:39.828622 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4a470-cf3a-492d-ae86-9b5b06b33220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:39.830921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e745a5-9dfa-46a1-90a8-ee57b55368ea service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:39.856203 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1035/2055] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:39 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:30:39.861647 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-e7d4a470-cf3a-492d-ae86-9b5b06b33220 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:39.863451 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e7d4a470-cf3a-492d-ae86-9b5b06b33220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:40.011342 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1021/2056] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:40.028401 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e745a5-9dfa-46a1-90a8-ee57b55368ea service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:40.029964 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-74e745a5-9dfa-46a1-90a8-ee57b55368ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:40.219384 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e745a5-9dfa-46a1-90a8-ee57b55368ea service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:40.327800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46362eb4-2ff2-4b41-ac67-c3cf255c2cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:40.328897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46362eb4-2ff2-4b41-ac67-c3cf255c2cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:40.329182 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46362eb4-2ff2-4b41-ac67-c3cf255c2cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:40.329508 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46362eb4-2ff2-4b41-ac67-c3cf255c2cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:40.351267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46362eb4-2ff2-4b41-ac67-c3cf255c2cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:40.352890 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46362eb4-2ff2-4b41-ac67-c3cf255c2cf2 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:40.354966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4a470-cf3a-492d-ae86-9b5b06b33220 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:40.356718 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e7d4a470-cf3a-492d-ae86-9b5b06b33220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:40.364156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1036/2057] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:40.411337 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:40.438468 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4a470-cf3a-492d-ae86-9b5b06b33220 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:40.443041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15baf93-6a94-4257-bf93-345105c32f9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:40.443937 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15baf93-6a94-4257-bf93-345105c32f9f service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:40.444334 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15baf93-6a94-4257-bf93-345105c32f9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:40.444871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15baf93-6a94-4257-bf93-345105c32f9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:40.446747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f15baf93-6a94-4257-bf93-345105c32f9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:40.523838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15baf93-6a94-4257-bf93-345105c32f9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:40.526858 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15baf93-6a94-4257-bf93-345105c32f9f service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:40.538077 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1022/2058] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:40 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:40.727175 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46362eb4-2ff2-4b41-ac67-c3cf255c2cf2 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:40.728968 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-46362eb4-2ff2-4b41-ac67-c3cf255c2cf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:40.771308 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46362eb4-2ff2-4b41-ac67-c3cf255c2cf2 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:40.792277 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3b9a5-6732-45bf-a05e-b834325902a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:40.795813 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3b9a5-6732-45bf-a05e-b834325902a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:40.796133 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3b9a5-6732-45bf-a05e-b834325902a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:40.796413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3b9a5-6732-45bf-a05e-b834325902a0 admin admin] PATH_INFO: `/v3/projects/7e35b5cd64d54f0fa90083608d1f75ac` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:40.802078 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3b9a5-6732-45bf-a05e-b834325902a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e35b5cd64d54f0fa90083608d1f75ac)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:40.804085 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3b9a5-6732-45bf-a05e-b834325902a0 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:41.005304 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6fb3b9a5-6732-45bf-a05e-b834325902a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e35b5cd64d54f0fa90083608d1f75ac', 'request_id': 'req-6fb3b9a5-6732-45bf-a05e-b834325902a0'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:41.012882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:41.015247 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6fb3b9a5-6732-45bf-a05e-b834325902a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e35b5cd64d54f0fa90083608d1f75ac', 'request_id': 'req-6fb3b9a5-6732-45bf-a05e-b834325902a0'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:41.040087 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6fb3b9a5-6732-45bf-a05e-b834325902a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e35b5cd64d54f0fa90083608d1f75ac', 'request_id': 'req-6fb3b9a5-6732-45bf-a05e-b834325902a0'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:41.074943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6fb3b9a5-6732-45bf-a05e-b834325902a0 admin admin] The token cache is being invalidate because project 7e35b5cd64d54f0fa90083608d1f75ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:41.075323 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6fb3b9a5-6732-45bf-a05e-b834325902a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:41.076979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6fb3b9a5-6732-45bf-a05e-b834325902a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:41.079752 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1037/2059] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:40 2022] DELETE /identity/v3/projects/7e35b5cd64d54f0fa90083608d1f75ac => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:41.091391 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672ac0d-75d4-46c2-886f-247204f15900 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:41.092322 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672ac0d-75d4-46c2-886f-247204f15900 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:41.093437 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672ac0d-75d4-46c2-886f-247204f15900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:41.145233 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-b672ac0d-75d4-46c2-886f-247204f15900 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:41.150197 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b672ac0d-75d4-46c2-886f-247204f15900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:41.236220 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3b9a5-6732-45bf-a05e-b834325902a0 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:41.239594 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6fb3b9a5-6732-45bf-a05e-b834325902a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:41.310168 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1023/2060] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:41.311856 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebc61f-ad69-499e-9d27-7902be7750cc None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:41.312329 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebc61f-ad69-499e-9d27-7902be7750cc None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:41.312755 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebc61f-ad69-499e-9d27-7902be7750cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:41.341089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-efebc61f-ad69-499e-9d27-7902be7750cc None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:41.342319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-efebc61f-ad69-499e-9d27-7902be7750cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:41.365080 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1024/2061] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:41.370882 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebc61f-ad69-499e-9d27-7902be7750cc None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:41.407138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebc61f-ad69-499e-9d27-7902be7750cc None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:41.429388 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55468a-2e56-4490-913f-06fb79d8376c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:41.430015 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55468a-2e56-4490-913f-06fb79d8376c admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:41.430546 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55468a-2e56-4490-913f-06fb79d8376c admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:41.430826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55468a-2e56-4490-913f-06fb79d8376c admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:41.431478 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55468a-2e56-4490-913f-06fb79d8376c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:30:41.431802 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55468a-2e56-4490-913f-06fb79d8376c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:41.441471 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55468a-2e56-4490-913f-06fb79d8376c admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:41.445495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3b9a5-6732-45bf-a05e-b834325902a0 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:41.466876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d419f-e82c-408a-842c-0348b427491b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:41.467696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d419f-e82c-408a-842c-0348b427491b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:41.469531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d419f-e82c-408a-842c-0348b427491b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:41.469806 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d419f-e82c-408a-842c-0348b427491b admin admin] PATH_INFO: `/v3/users/b3c6de2ddc4249268af78f1139c9789d` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:41.472595 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1025/2062] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:30:41.474143 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d419f-e82c-408a-842c-0348b427491b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3c6de2ddc4249268af78f1139c9789d)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:41.476146 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d419f-e82c-408a-842c-0348b427491b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:41.480182 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55468a-2e56-4490-913f-06fb79d8376c admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:41.513896 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55468a-2e56-4490-913f-06fb79d8376c admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:41.530325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b35ea-5ea8-4696-a379-e457e12a6f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:41.530325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b35ea-5ea8-4696-a379-e457e12a6f86 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:41.530325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b35ea-5ea8-4696-a379-e457e12a6f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:41.530325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b35ea-5ea8-4696-a379-e457e12a6f86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:41.531416 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b35ea-5ea8-4696-a379-e457e12a6f86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:41.533635 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b35ea-5ea8-4696-a379-e457e12a6f86 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:41.605119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-456d419f-e82c-408a-842c-0348b427491b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3c6de2ddc4249268af78f1139c9789d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:41.606108 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-456d419f-e82c-408a-842c-0348b427491b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3c6de2ddc4249268af78f1139c9789d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:41.618519 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1026/2063] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:41 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:41.628130 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b35ea-5ea8-4696-a379-e457e12a6f86 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:41.633569 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-456d419f-e82c-408a-842c-0348b427491b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3c6de2ddc4249268af78f1139c9789d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:41.668315 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-456d419f-e82c-408a-842c-0348b427491b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3c6de2ddc4249268af78f1139c9789d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:41.709638 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-456d419f-e82c-408a-842c-0348b427491b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3c6de2ddc4249268af78f1139c9789d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:41.720741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1038/2064] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:41 2022] DELETE /identity/v3/users/b3c6de2ddc4249268af78f1139c9789d => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:30:41.726189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efeb87-ff61-477f-8daf-16bbd0671ce3 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:41.726515 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efeb87-ff61-477f-8daf-16bbd0671ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:41.726970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efeb87-ff61-477f-8daf-16bbd0671ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:41.781565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f8efeb87-ff61-477f-8daf-16bbd0671ce3 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:41.782901 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f8efeb87-ff61-477f-8daf-16bbd0671ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:41.802304 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:41.845973 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b35ea-5ea8-4696-a379-e457e12a6f86 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:41.952589 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1039/2065] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:41.959978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efeb87-ff61-477f-8daf-16bbd0671ce3 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:41.964892 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f8efeb87-ff61-477f-8daf-16bbd0671ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:41.986638 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:42.075854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e252cf7-00c2-4f29-b574-7606fffb9a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:42.076608 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e252cf7-00c2-4f29-b574-7606fffb9a3e admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:42.076911 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e252cf7-00c2-4f29-b574-7606fffb9a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:42.077204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e252cf7-00c2-4f29-b574-7606fffb9a3e admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:42.077954 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e252cf7-00c2-4f29-b574-7606fffb9a3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:42.080141 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e252cf7-00c2-4f29-b574-7606fffb9a3e admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:42.117672 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1027/2066] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:41 2022] POST /identity/v3/users => generated 288 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:42.118617 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e252cf7-00c2-4f29-b574-7606fffb9a3e admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:42.121204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-5e252cf7-00c2-4f29-b574-7606fffb9a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:42.124303 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efeb87-ff61-477f-8daf-16bbd0671ce3 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:42.136772 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ceb00-1d28-4ed5-a2b5-ff3399e1924a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:42.137823 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ceb00-1d28-4ed5-a2b5-ff3399e1924a service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:42.138529 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ceb00-1d28-4ed5-a2b5-ff3399e1924a service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:42.140033 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ceb00-1d28-4ed5-a2b5-ff3399e1924a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:42.144539 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e252cf7-00c2-4f29-b574-7606fffb9a3e admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:42.153279 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cac0cb-4545-44a6-a8a1-fad179f56c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:42.153971 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cac0cb-4545-44a6-a8a1-fad179f56c9f admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:42.154252 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cac0cb-4545-44a6-a8a1-fad179f56c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:42.154542 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cac0cb-4545-44a6-a8a1-fad179f56c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:42.155181 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cac0cb-4545-44a6-a8a1-fad179f56c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:42.156823 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cac0cb-4545-44a6-a8a1-fad179f56c9f admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:42.166802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ceb00-1d28-4ed5-a2b5-ff3399e1924a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:42.166802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ceb00-1d28-4ed5-a2b5-ff3399e1924a service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:42.185361 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1028/2067] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:42.186396 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cac0cb-4545-44a6-a8a1-fad179f56c9f admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:42.208007 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cac0cb-4545-44a6-a8a1-fad179f56c9f admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:42.219237 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842156e-08a6-4e56-b4f6-1ea4bb8beea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:42.219772 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842156e-08a6-4e56-b4f6-1ea4bb8beea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:42.220029 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842156e-08a6-4e56-b4f6-1ea4bb8beea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:42.220328 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842156e-08a6-4e56-b4f6-1ea4bb8beea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:42.220950 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842156e-08a6-4e56-b4f6-1ea4bb8beea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:42.222565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842156e-08a6-4e56-b4f6-1ea4bb8beea0 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:42.226592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1040/2068] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:42.251097 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1029/2069] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:42.255158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ceb00-1d28-4ed5-a2b5-ff3399e1924a service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:42.271659 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ceb00-1d28-4ed5-a2b5-ff3399e1924a service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:42.291851 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53b608-3bb1-44cb-babb-c739e0016885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:42.297046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53b608-3bb1-44cb-babb-c739e0016885 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:42.297555 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53b608-3bb1-44cb-babb-c739e0016885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:42.298618 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53b608-3bb1-44cb-babb-c739e0016885 admin admin] PATH_INFO: `/v3/projects/57c6277902234a5e9edd59673dbd7085/users/0735ce6dacd04c26ada60764df03c143/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:42.367373 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53b608-3bb1-44cb-babb-c739e0016885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57c6277902234a5e9edd59673dbd7085, user_id=0735ce6dacd04c26ada60764df03c143, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:42.378863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53b608-3bb1-44cb-babb-c739e0016885 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:42.424983 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1041/2070] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:42 2022] PUT /identity/v3/projects/57c6277902234a5e9edd59673dbd7085/users/0735ce6dacd04c26ada60764df03c143/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:30:42.429219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbefc3b-c5fe-4047-a215-eea243871f5a None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:42.430274 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbefc3b-c5fe-4047-a215-eea243871f5a None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:42.432522 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbefc3b-c5fe-4047-a215-eea243871f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:42.587052 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-fdbefc3b-c5fe-4047-a215-eea243871f5a None None] MFA Rules not processed for user `0735ce6dacd04c26ada60764df03c143`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:42.589041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-fdbefc3b-c5fe-4047-a215-eea243871f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:42.837457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1030/2071] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:42.849128 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53b608-3bb1-44cb-babb-c739e0016885 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:42.898743 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbefc3b-c5fe-4047-a215-eea243871f5a None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:42.904406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-fdbefc3b-c5fe-4047-a215-eea243871f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:43.014037 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53b608-3bb1-44cb-babb-c739e0016885 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:43.020536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054f8e0-32e9-4835-99d6-95d2961ce16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:43.020784 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054f8e0-32e9-4835-99d6-95d2961ce16d admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:43.021213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054f8e0-32e9-4835-99d6-95d2961ce16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:43.021514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054f8e0-32e9-4835-99d6-95d2961ce16d admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:43.022386 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054f8e0-32e9-4835-99d6-95d2961ce16d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:43.027660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054f8e0-32e9-4835-99d6-95d2961ce16d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:43.071296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:43.090842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbefc3b-c5fe-4047-a215-eea243871f5a None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:43.091414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1042/2072] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:42 2022] POST /identity/v3/projects => generated 373 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:43.095435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054f8e0-32e9-4835-99d6-95d2961ce16d admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:43.195568 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1584c0-ff56-4e7b-8d6f-74343ac8a60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:43.196386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1584c0-ff56-4e7b-8d6f-74343ac8a60b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:43.196846 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1584c0-ff56-4e7b-8d6f-74343ac8a60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:43.197721 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1584c0-ff56-4e7b-8d6f-74343ac8a60b admin admin] PATH_INFO: `/v3/projects/212597ca2ac342759cb96979d1700c14` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:43.199270 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1584c0-ff56-4e7b-8d6f-74343ac8a60b admin admin] RBAC: Authorizing `identity:delete_project(project_id=212597ca2ac342759cb96979d1700c14)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:43.201290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1584c0-ff56-4e7b-8d6f-74343ac8a60b admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:43.253373 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054f8e0-32e9-4835-99d6-95d2961ce16d admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:43.260677 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd80ce-56d2-4044-bee6-7ef713aaf6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:43.261407 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd80ce-56d2-4044-bee6-7ef713aaf6fa admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:43.261702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd80ce-56d2-4044-bee6-7ef713aaf6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:43.261978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd80ce-56d2-4044-bee6-7ef713aaf6fa admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:43.262641 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd80ce-56d2-4044-bee6-7ef713aaf6fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:43.265059 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd80ce-56d2-4044-bee6-7ef713aaf6fa admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:43.294150 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:43.294466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1043/2073] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:43 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:30:43.306479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd80ce-56d2-4044-bee6-7ef713aaf6fa admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:43.319951 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd80ce-56d2-4044-bee6-7ef713aaf6fa admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:43.341041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-df1584c0-ff56-4e7b-8d6f-74343ac8a60b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '212597ca2ac342759cb96979d1700c14', 'request_id': 'req-df1584c0-ff56-4e7b-8d6f-74343ac8a60b'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:43.351133 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-df1584c0-ff56-4e7b-8d6f-74343ac8a60b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '212597ca2ac342759cb96979d1700c14', 'request_id': 'req-df1584c0-ff56-4e7b-8d6f-74343ac8a60b'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:43.383292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-df1584c0-ff56-4e7b-8d6f-74343ac8a60b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '212597ca2ac342759cb96979d1700c14', 'request_id': 'req-df1584c0-ff56-4e7b-8d6f-74343ac8a60b'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:43.405316 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-df1584c0-ff56-4e7b-8d6f-74343ac8a60b admin admin] The token cache is being invalidate because project 212597ca2ac342759cb96979d1700c14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:43.405762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-df1584c0-ff56-4e7b-8d6f-74343ac8a60b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:43.407225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-df1584c0-ff56-4e7b-8d6f-74343ac8a60b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:43.411236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1031/2074] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:42 2022] DELETE /identity/v3/projects/212597ca2ac342759cb96979d1700c14 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:43.415676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda29de6-1cf0-4aeb-9f78-434db2d7b453 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:43.418268 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda29de6-1cf0-4aeb-9f78-434db2d7b453 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:43.419258 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda29de6-1cf0-4aeb-9f78-434db2d7b453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:43.453084 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-cda29de6-1cf0-4aeb-9f78-434db2d7b453 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:43.455249 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-cda29de6-1cf0-4aeb-9f78-434db2d7b453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:43.500683 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfe409-ba81-4fb6-a781-91f735047ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:43.501326 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfe409-ba81-4fb6-a781-91f735047ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:43.501602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfe409-ba81-4fb6-a781-91f735047ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:43.501865 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfe409-ba81-4fb6-a781-91f735047ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:43.502524 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfe409-ba81-4fb6-a781-91f735047ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:43.504430 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfe409-ba81-4fb6-a781-91f735047ea0 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:43.547020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1044/2075] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:30:43.551876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfe409-ba81-4fb6-a781-91f735047ea0 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:43.560501 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-65bfe409-ba81-4fb6-a781-91f735047ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:43.601274 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfe409-ba81-4fb6-a781-91f735047ea0 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:43.609921 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1032/2076] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:30:43.612565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce654b53-c777-45b5-96a1-89b0a35a6491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:43.613757 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce654b53-c777-45b5-96a1-89b0a35a6491 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:43.615641 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce654b53-c777-45b5-96a1-89b0a35a6491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:43.616739 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce654b53-c777-45b5-96a1-89b0a35a6491 admin admin] PATH_INFO: `/v3/projects/fa86bd1d348c475291d46ba55a0d4939/users/dc83c7f5c66d4786bbd1cc2a6a5ab58e/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:43.629619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff81468-7cd9-4a40-babf-9cda98a2d137 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:43.629912 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff81468-7cd9-4a40-babf-9cda98a2d137 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:43.630197 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff81468-7cd9-4a40-babf-9cda98a2d137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:43.677520 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce654b53-c777-45b5-96a1-89b0a35a6491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa86bd1d348c475291d46ba55a0d4939, user_id=dc83c7f5c66d4786bbd1cc2a6a5ab58e, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:43.689694 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce654b53-c777-45b5-96a1-89b0a35a6491 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:43.695740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-dff81468-7cd9-4a40-babf-9cda98a2d137 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:43.699149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-dff81468-7cd9-4a40-babf-9cda98a2d137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:43.751759 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1033/2077] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:30:43.755449 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1045/2078] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:43 2022] PUT /identity/v3/projects/fa86bd1d348c475291d46ba55a0d4939/users/dc83c7f5c66d4786bbd1cc2a6a5ab58e/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:43.757098 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce654b53-c777-45b5-96a1-89b0a35a6491 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:43.757792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff81468-7cd9-4a40-babf-9cda98a2d137 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:43.771398 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff81468-7cd9-4a40-babf-9cda98a2d137 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:43.850835 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:43.942962 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b9295-ecf4-4613-8dbc-45e4619fc98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:43.943573 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b9295-ecf4-4613-8dbc-45e4619fc98a admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:43.943970 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b9295-ecf4-4613-8dbc-45e4619fc98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:43.944251 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b9295-ecf4-4613-8dbc-45e4619fc98a admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:43.945777 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b9295-ecf4-4613-8dbc-45e4619fc98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:43.947755 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b9295-ecf4-4613-8dbc-45e4619fc98a admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:43.966718 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1034/2079] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:43.969509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b9295-ecf4-4613-8dbc-45e4619fc98a admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:43.986083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b9295-ecf4-4613-8dbc-45e4619fc98a admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:44.000093 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce654b53-c777-45b5-96a1-89b0a35a6491 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:44.003878 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa34b5c-2188-412e-80d9-1b1208bf3f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:44.004720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa34b5c-2188-412e-80d9-1b1208bf3f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:44.005006 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa34b5c-2188-412e-80d9-1b1208bf3f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:44.005316 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa34b5c-2188-412e-80d9-1b1208bf3f8c admin admin] PATH_INFO: `/v3/projects/fa86bd1d348c475291d46ba55a0d4939/users/dc83c7f5c66d4786bbd1cc2a6a5ab58e/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:44.008805 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa34b5c-2188-412e-80d9-1b1208bf3f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa86bd1d348c475291d46ba55a0d4939, user_id=dc83c7f5c66d4786bbd1cc2a6a5ab58e, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:44.012477 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa34b5c-2188-412e-80d9-1b1208bf3f8c admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:44.029075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1035/2080] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:43 2022] PUT /identity/v3/projects/fa86bd1d348c475291d46ba55a0d4939/users/dc83c7f5c66d4786bbd1cc2a6a5ab58e/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:30:44.039608 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70de9c7-8628-4196-bd9e-9e087474e0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:44.040322 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70de9c7-8628-4196-bd9e-9e087474e0de admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:44.041287 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70de9c7-8628-4196-bd9e-9e087474e0de admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:44.041287 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70de9c7-8628-4196-bd9e-9e087474e0de admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:44.042072 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a316d-6269-4ccb-a2f4-44793b3334f6 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:44.042155 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70de9c7-8628-4196-bd9e-9e087474e0de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:30:44.042241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a316d-6269-4ccb-a2f4-44793b3334f6 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:44.042457 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70de9c7-8628-4196-bd9e-9e087474e0de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:44.043400 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a316d-6269-4ccb-a2f4-44793b3334f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:44.044025 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70de9c7-8628-4196-bd9e-9e087474e0de admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:44.090150 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1046/2081] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:30:44.093580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70de9c7-8628-4196-bd9e-9e087474e0de admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:44.116051 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70de9c7-8628-4196-bd9e-9e087474e0de admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:44.158509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-279a316d-6269-4ccb-a2f4-44793b3334f6 None None] MFA Rules not processed for user `dc83c7f5c66d4786bbd1cc2a6a5ab58e`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:44.161513 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-279a316d-6269-4ccb-a2f4-44793b3334f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:44.240543 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddf140-efab-4f98-a255-16b93233bb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:44.241188 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddf140-efab-4f98-a255-16b93233bb8d admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:44.241664 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddf140-efab-4f98-a255-16b93233bb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:44.241934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddf140-efab-4f98-a255-16b93233bb8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:44.242626 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ddf140-efab-4f98-a255-16b93233bb8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:44.245104 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ddf140-efab-4f98-a255-16b93233bb8d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:44.256855 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:44.291640 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1047/2082] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:44 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:44.293381 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddf140-efab-4f98-a255-16b93233bb8d admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:44.307316 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1036/2083] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:44.308509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a316d-6269-4ccb-a2f4-44793b3334f6 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:44.310757 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-279a316d-6269-4ccb-a2f4-44793b3334f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:44.392987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a316d-6269-4ccb-a2f4-44793b3334f6 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:44.412075 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddf140-efab-4f98-a255-16b93233bb8d admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:44.418084 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727b52b-f817-460c-b175-64b4bcb88770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:44.418705 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727b52b-f817-460c-b175-64b4bcb88770 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:44.418985 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727b52b-f817-460c-b175-64b4bcb88770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:44.419259 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727b52b-f817-460c-b175-64b4bcb88770 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:44.419947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727b52b-f817-460c-b175-64b4bcb88770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:44.421902 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727b52b-f817-460c-b175-64b4bcb88770 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:44.452287 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1048/2084] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:44 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:30:44.457266 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727b52b-f817-460c-b175-64b4bcb88770 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:44.469977 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:44.476013 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727b52b-f817-460c-b175-64b4bcb88770 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:44.481902 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8ad2f-0fe8-4cb6-9168-cca2eef657c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:44.482147 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8ad2f-0fe8-4cb6-9168-cca2eef657c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:44.495588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8ad2f-0fe8-4cb6-9168-cca2eef657c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:44.495588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8ad2f-0fe8-4cb6-9168-cca2eef657c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:44.495912 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ada8f-70ce-4b1b-a460-d930014efbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:44.495912 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ada8f-70ce-4b1b-a460-d930014efbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:44.495912 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ada8f-70ce-4b1b-a460-d930014efbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:44.495912 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ada8f-70ce-4b1b-a460-d930014efbb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:44.496190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ada8f-70ce-4b1b-a460-d930014efbb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:44.496190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ada8f-70ce-4b1b-a460-d930014efbb4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:44.496328 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-35f8ad2f-0fe8-4cb6-9168-cca2eef657c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:44.515918 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1049/2085] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:30:44.519929 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ada8f-70ce-4b1b-a460-d930014efbb4 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:44.538506 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ada8f-70ce-4b1b-a460-d930014efbb4 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:44.547413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c7398-73ae-450a-bedb-b669a030c690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:44.548109 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c7398-73ae-450a-bedb-b669a030c690 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:44.548383 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c7398-73ae-450a-bedb-b669a030c690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:44.548805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c7398-73ae-450a-bedb-b669a030c690 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:44.549463 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c7398-73ae-450a-bedb-b669a030c690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:44.555657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c7398-73ae-450a-bedb-b669a030c690 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:44.564745 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1050/2086] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:30:44.568942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c7398-73ae-450a-bedb-b669a030c690 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:44.581013 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c7398-73ae-450a-bedb-b669a030c690 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:44.594720 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a9e3e-e3c0-41aa-8f18-bbaf0d4cbe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:44.598162 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a9e3e-e3c0-41aa-8f18-bbaf0d4cbe88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:44.599204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8ad2f-0fe8-4cb6-9168-cca2eef657c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:44.600339 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a9e3e-e3c0-41aa-8f18-bbaf0d4cbe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:44.600596 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a9e3e-e3c0-41aa-8f18-bbaf0d4cbe88 admin admin] PATH_INFO: `/v3/projects/6e9a2b1bd3fc419895e4acb3771be429/users/fec677f5ce70433a920f9c1a24f0ffe6/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:44.601122 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8ad2f-0fe8-4cb6-9168-cca2eef657c9 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:44.613878 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1037/2087] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:44.644756 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a9e3e-e3c0-41aa-8f18-bbaf0d4cbe88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9a2b1bd3fc419895e4acb3771be429, user_id=fec677f5ce70433a920f9c1a24f0ffe6, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:44.647687 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a9e3e-e3c0-41aa-8f18-bbaf0d4cbe88 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:44.665515 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1051/2088] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:44 2022] PUT /identity/v3/projects/6e9a2b1bd3fc419895e4acb3771be429/users/fec677f5ce70433a920f9c1a24f0ffe6/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:44.676941 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f36b6e-9ed8-4209-9413-2304432b80b6 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:44.677745 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f36b6e-9ed8-4209-9413-2304432b80b6 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:44.678007 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f36b6e-9ed8-4209-9413-2304432b80b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:44.718928 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-05f36b6e-9ed8-4209-9413-2304432b80b6 None None] MFA Rules not processed for user `fec677f5ce70433a920f9c1a24f0ffe6`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:44.720283 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-05f36b6e-9ed8-4209-9413-2304432b80b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:44.806058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1038/2089] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:44.811683 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a9e3e-e3c0-41aa-8f18-bbaf0d4cbe88 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:44.931679 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a9e3e-e3c0-41aa-8f18-bbaf0d4cbe88 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:44.938465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf5806-f089-4a6b-93af-b74431f5a484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:44.939329 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf5806-f089-4a6b-93af-b74431f5a484 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:44.939684 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf5806-f089-4a6b-93af-b74431f5a484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:44.940000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf5806-f089-4a6b-93af-b74431f5a484 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:44.940960 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf5806-f089-4a6b-93af-b74431f5a484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:44.942961 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf5806-f089-4a6b-93af-b74431f5a484 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:44.999758 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1052/2090] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:44 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:45.004358 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f36b6e-9ed8-4209-9413-2304432b80b6 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:45.019695 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f36b6e-9ed8-4209-9413-2304432b80b6 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:45.118376 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf5806-f089-4a6b-93af-b74431f5a484 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:45.120902 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e6bf5806-f089-4a6b-93af-b74431f5a484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:45.145035 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f75427-180a-4cd9-9f4e-3f982ac9aad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:45.145671 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f75427-180a-4cd9-9f4e-3f982ac9aad1 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:45.145949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f75427-180a-4cd9-9f4e-3f982ac9aad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:45.146331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f75427-180a-4cd9-9f4e-3f982ac9aad1 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:45.147146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f75427-180a-4cd9-9f4e-3f982ac9aad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:45.149292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f75427-180a-4cd9-9f4e-3f982ac9aad1 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:45.158283 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:45.183227 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1039/2091] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:45 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:45.184929 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f75427-180a-4cd9-9f4e-3f982ac9aad1 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:45.196137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f75427-180a-4cd9-9f4e-3f982ac9aad1 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:45.203212 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2895e-e138-4a29-b168-f35b8b21c9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:45.204400 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2895e-e138-4a29-b168-f35b8b21c9cb admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:45.204699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2895e-e138-4a29-b168-f35b8b21c9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:45.204949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2895e-e138-4a29-b168-f35b8b21c9cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:45.205780 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2895e-e138-4a29-b168-f35b8b21c9cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:45.207993 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2895e-e138-4a29-b168-f35b8b21c9cb admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:45.215498 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf5806-f089-4a6b-93af-b74431f5a484 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:45.219843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d935de-5706-4531-a35a-07db455abf04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:45.220639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1040/2092] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:30:45.220771 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d935de-5706-4531-a35a-07db455abf04 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:45.220957 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d935de-5706-4531-a35a-07db455abf04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:45.221291 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d935de-5706-4531-a35a-07db455abf04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:45.223142 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-59d935de-5706-4531-a35a-07db455abf04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:45.225000 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2895e-e138-4a29-b168-f35b8b21c9cb admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:45.238535 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2895e-e138-4a29-b168-f35b8b21c9cb admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:45.246280 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cedbf4-72a9-43e5-94b0-4ae5c34e2490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:45.247182 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cedbf4-72a9-43e5-94b0-4ae5c34e2490 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:45.247798 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cedbf4-72a9-43e5-94b0-4ae5c34e2490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:45.248253 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cedbf4-72a9-43e5-94b0-4ae5c34e2490 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:45.249085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cedbf4-72a9-43e5-94b0-4ae5c34e2490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:45.250796 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cedbf4-72a9-43e5-94b0-4ae5c34e2490 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:45.263149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:45.278584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1041/2093] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:30:45.280194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cedbf4-72a9-43e5-94b0-4ae5c34e2490 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:45.293185 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cedbf4-72a9-43e5-94b0-4ae5c34e2490 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:45.298442 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2eb4ed-7875-4761-9457-112fcc3d5923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:45.299187 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eb4ed-7875-4761-9457-112fcc3d5923 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:45.299535 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eb4ed-7875-4761-9457-112fcc3d5923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:45.299948 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eb4ed-7875-4761-9457-112fcc3d5923 admin admin] PATH_INFO: `/v3/projects/6355fef0863c41f1b72f368e121150d1/users/00ddc5d33f54420ca975d37d28c1b6ba/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:45.320722 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2eb4ed-7875-4761-9457-112fcc3d5923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6355fef0863c41f1b72f368e121150d1, user_id=00ddc5d33f54420ca975d37d28c1b6ba, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:45.324149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2eb4ed-7875-4761-9457-112fcc3d5923 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:45.332355 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d935de-5706-4531-a35a-07db455abf04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:45.333903 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d935de-5706-4531-a35a-07db455abf04 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:45.340313 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1042/2094] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:45 2022] PUT /identity/v3/projects/6355fef0863c41f1b72f368e121150d1/users/00ddc5d33f54420ca975d37d28c1b6ba/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:45.345466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1053/2095] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:45.352201 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a662e0-cd28-47a7-aac8-6f66ef68a1c7 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:45.352539 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a662e0-cd28-47a7-aac8-6f66ef68a1c7 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:45.353333 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a662e0-cd28-47a7-aac8-6f66ef68a1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:45.383112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-95a662e0-cd28-47a7-aac8-6f66ef68a1c7 None None] MFA Rules not processed for user `00ddc5d33f54420ca975d37d28c1b6ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:45.384451 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-95a662e0-cd28-47a7-aac8-6f66ef68a1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:45.466055 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1043/2096] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:45.471047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d935de-5706-4531-a35a-07db455abf04 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:45.491660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d935de-5706-4531-a35a-07db455abf04 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:45.577015 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c4fb1-f263-4a79-8a1c-d0f0194598bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:45.577630 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c4fb1-f263-4a79-8a1c-d0f0194598bf admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:45.578018 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c4fb1-f263-4a79-8a1c-d0f0194598bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:45.578360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c4fb1-f263-4a79-8a1c-d0f0194598bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:45.578857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c4fb1-f263-4a79-8a1c-d0f0194598bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:45.580850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c4fb1-f263-4a79-8a1c-d0f0194598bf admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:45.615466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1054/2097] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:45 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:45.619781 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a662e0-cd28-47a7-aac8-6f66ef68a1c7 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:45.632961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a662e0-cd28-47a7-aac8-6f66ef68a1c7 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:45.725219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58235cf4-551b-4bd9-8900-d72efd782439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:45.725219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58235cf4-551b-4bd9-8900-d72efd782439 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:45.725219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58235cf4-551b-4bd9-8900-d72efd782439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:45.725219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58235cf4-551b-4bd9-8900-d72efd782439 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:45.725955 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58235cf4-551b-4bd9-8900-d72efd782439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:45.727917 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58235cf4-551b-4bd9-8900-d72efd782439 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:45.768404 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1044/2098] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:45 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:45.775077 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c4fb1-f263-4a79-8a1c-d0f0194598bf admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:45.797673 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c4fb1-f263-4a79-8a1c-d0f0194598bf admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:45.802995 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee84ae-48d8-4ff4-8876-6851abdc74e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:45.804116 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee84ae-48d8-4ff4-8876-6851abdc74e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:45.805863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee84ae-48d8-4ff4-8876-6851abdc74e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:45.806421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee84ae-48d8-4ff4-8876-6851abdc74e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:45.808317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee84ae-48d8-4ff4-8876-6851abdc74e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:45.811368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee84ae-48d8-4ff4-8876-6851abdc74e4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:45.830552 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1055/2099] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:45.836532 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58235cf4-551b-4bd9-8900-d72efd782439 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:45.851206 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58235cf4-551b-4bd9-8900-d72efd782439 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:45.858713 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3816f43-79e9-4d66-95c4-e4d85197dadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:45.859484 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3816f43-79e9-4d66-95c4-e4d85197dadd admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:45.859798 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3816f43-79e9-4d66-95c4-e4d85197dadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:45.860487 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3816f43-79e9-4d66-95c4-e4d85197dadd admin admin] PATH_INFO: `/v3/projects/0e5f2149b37e458ab8a0b29e7107c2d0/users/152bc07314ed4be59ca2193cd868736a/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:45.881864 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3816f43-79e9-4d66-95c4-e4d85197dadd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5f2149b37e458ab8a0b29e7107c2d0, user_id=152bc07314ed4be59ca2193cd868736a, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:45.885569 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3816f43-79e9-4d66-95c4-e4d85197dadd admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:45.899220 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1045/2100] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:45 2022] PUT /identity/v3/projects/0e5f2149b37e458ab8a0b29e7107c2d0/users/152bc07314ed4be59ca2193cd868736a/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:30:45.903828 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee84ae-48d8-4ff4-8876-6851abdc74e4 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:45.914011 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee84ae-48d8-4ff4-8876-6851abdc74e4 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:45.973704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:45.999996 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae57853-9e43-41de-b432-59c58543a2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:46.000908 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae57853-9e43-41de-b432-59c58543a2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:46.001330 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae57853-9e43-41de-b432-59c58543a2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:46.001743 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae57853-9e43-41de-b432-59c58543a2e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:46.002739 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae57853-9e43-41de-b432-59c58543a2e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:46.005474 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae57853-9e43-41de-b432-59c58543a2e1 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:46.027396 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1056/2101] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:46.028990 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3816f43-79e9-4d66-95c4-e4d85197dadd admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:46.040034 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3816f43-79e9-4d66-95c4-e4d85197dadd admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:46.045549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7eafb6-9a7d-4ea6-ad63-0cfb85db3de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:46.046244 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7eafb6-9a7d-4ea6-ad63-0cfb85db3de6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:46.046528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7eafb6-9a7d-4ea6-ad63-0cfb85db3de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:46.046799 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7eafb6-9a7d-4ea6-ad63-0cfb85db3de6 admin admin] PATH_INFO: `/v3/projects/0e5f2149b37e458ab8a0b29e7107c2d0/users/152bc07314ed4be59ca2193cd868736a/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:46.048781 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7eafb6-9a7d-4ea6-ad63-0cfb85db3de6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5f2149b37e458ab8a0b29e7107c2d0, user_id=152bc07314ed4be59ca2193cd868736a, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:46.051443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7eafb6-9a7d-4ea6-ad63-0cfb85db3de6 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:46.063265 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1046/2102] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:46 2022] PUT /identity/v3/projects/0e5f2149b37e458ab8a0b29e7107c2d0/users/152bc07314ed4be59ca2193cd868736a/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:46.075154 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa4002-aa6b-4557-8e58-0abbf71f3e6c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:46.075401 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa4002-aa6b-4557-8e58-0abbf71f3e6c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:46.075678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa4002-aa6b-4557-8e58-0abbf71f3e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:46.113162 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-edaa4002-aa6b-4557-8e58-0abbf71f3e6c None None] MFA Rules not processed for user `152bc07314ed4be59ca2193cd868736a`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:46.114293 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-edaa4002-aa6b-4557-8e58-0abbf71f3e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:46.194528 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1057/2103] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:46.209337 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7eafb6-9a7d-4ea6-ad63-0cfb85db3de6 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:46.246998 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:46.292157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7eafb6-9a7d-4ea6-ad63-0cfb85db3de6 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:46.297113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacb899-91a9-4b02-82c4-5a5f27a5e4d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:46.297863 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacb899-91a9-4b02-82c4-5a5f27a5e4d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:46.298203 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacb899-91a9-4b02-82c4-5a5f27a5e4d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:46.298538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacb899-91a9-4b02-82c4-5a5f27a5e4d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:46.368632 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacb899-91a9-4b02-82c4-5a5f27a5e4d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:46.373367 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacb899-91a9-4b02-82c4-5a5f27a5e4d7 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:46.386385 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1047/2104] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:47.162378 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa4002-aa6b-4557-8e58-0abbf71f3e6c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:47.164582 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-edaa4002-aa6b-4557-8e58-0abbf71f3e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:47.238446 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa4002-aa6b-4557-8e58-0abbf71f3e6c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:47.243477 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4829274-5210-465d-9600-99b68fc3ccae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:47.244176 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4829274-5210-465d-9600-99b68fc3ccae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:47.245210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4829274-5210-465d-9600-99b68fc3ccae admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:47.245513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4829274-5210-465d-9600-99b68fc3ccae admin admin] PATH_INFO: `/v3/users/542b09dadd0042aca96b424458dae04b` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:47.246646 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4829274-5210-465d-9600-99b68fc3ccae admin admin] RBAC: Authorizing `identity:delete_user(user_id=542b09dadd0042aca96b424458dae04b)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:47.248625 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4829274-5210-465d-9600-99b68fc3ccae admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:47.300299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a4829274-5210-465d-9600-99b68fc3ccae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '542b09dadd0042aca96b424458dae04b'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:47.300959 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a4829274-5210-465d-9600-99b68fc3ccae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '542b09dadd0042aca96b424458dae04b'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:47.308958 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a4829274-5210-465d-9600-99b68fc3ccae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '542b09dadd0042aca96b424458dae04b'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:47.317975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:47.323637 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a4829274-5210-465d-9600-99b68fc3ccae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '542b09dadd0042aca96b424458dae04b'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:47.331640 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a4829274-5210-465d-9600-99b68fc3ccae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '542b09dadd0042aca96b424458dae04b'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:47.337724 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1058/2105] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:47 2022] DELETE /identity/v3/users/542b09dadd0042aca96b424458dae04b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:47.343329 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fcaa3-1a0d-42db-b3e8-16d09e6092e4 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:47.343876 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fcaa3-1a0d-42db-b3e8-16d09e6092e4 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:47.344123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fcaa3-1a0d-42db-b3e8-16d09e6092e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:47.364534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-ca4fcaa3-1a0d-42db-b3e8-16d09e6092e4 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:47.365775 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-ca4fcaa3-1a0d-42db-b3e8-16d09e6092e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:47.427789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1048/2106] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:47.438649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4829274-5210-465d-9600-99b68fc3ccae admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:47.440125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a4829274-5210-465d-9600-99b68fc3ccae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:47.505652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4829274-5210-465d-9600-99b68fc3ccae admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:47.509371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e3f28-0d65-4e8c-a7db-ca4026b02446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:47.509981 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e3f28-0d65-4e8c-a7db-ca4026b02446 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:47.510259 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e3f28-0d65-4e8c-a7db-ca4026b02446 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:47.510530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e3f28-0d65-4e8c-a7db-ca4026b02446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:47.520158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e3f28-0d65-4e8c-a7db-ca4026b02446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:47.521596 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e3f28-0d65-4e8c-a7db-ca4026b02446 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:47.533162 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1059/2107] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:47.824037 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fcaa3-1a0d-42db-b3e8-16d09e6092e4 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:47.825522 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-ca4fcaa3-1a0d-42db-b3e8-16d09e6092e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:47.837915 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fcaa3-1a0d-42db-b3e8-16d09e6092e4 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:47.843285 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67ec37-a79c-411a-ab5c-e1b9aa91746d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:47.844034 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67ec37-a79c-411a-ab5c-e1b9aa91746d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:47.844238 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67ec37-a79c-411a-ab5c-e1b9aa91746d admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:47.844511 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67ec37-a79c-411a-ab5c-e1b9aa91746d admin admin] PATH_INFO: `/v3/projects/b18ff5165c754764916c490f819f490d` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:47.845895 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67ec37-a79c-411a-ab5c-e1b9aa91746d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b18ff5165c754764916c490f819f490d)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:47.848050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67ec37-a79c-411a-ab5c-e1b9aa91746d admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:47.925409 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-6e67ec37-a79c-411a-ab5c-e1b9aa91746d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b18ff5165c754764916c490f819f490d', 'request_id': 'req-6e67ec37-a79c-411a-ab5c-e1b9aa91746d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:47.933417 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-6e67ec37-a79c-411a-ab5c-e1b9aa91746d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b18ff5165c754764916c490f819f490d', 'request_id': 'req-6e67ec37-a79c-411a-ab5c-e1b9aa91746d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:47.948182 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-6e67ec37-a79c-411a-ab5c-e1b9aa91746d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b18ff5165c754764916c490f819f490d', 'request_id': 'req-6e67ec37-a79c-411a-ab5c-e1b9aa91746d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:47.957222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:47.972557 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-6e67ec37-a79c-411a-ab5c-e1b9aa91746d admin admin] The token cache is being invalidate because project b18ff5165c754764916c490f819f490d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:47.974285 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-6e67ec37-a79c-411a-ab5c-e1b9aa91746d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:47.974285 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-6e67ec37-a79c-411a-ab5c-e1b9aa91746d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:47.982045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1049/2108] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:47 2022] DELETE /identity/v3/projects/b18ff5165c754764916c490f819f490d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:47.983356 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e3f28-0d65-4e8c-a7db-ca4026b02446 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:48.000561 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e3f28-0d65-4e8c-a7db-ca4026b02446 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:48.080449 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ca509-5516-43c6-8acd-1b6fb3fc8393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:48.081239 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ca509-5516-43c6-8acd-1b6fb3fc8393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:48.081732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ca509-5516-43c6-8acd-1b6fb3fc8393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:48.082313 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ca509-5516-43c6-8acd-1b6fb3fc8393 admin admin] PATH_INFO: `/v3/users/baad251aa4d7489ebd532734f13dfcf2` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:48.084138 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ca509-5516-43c6-8acd-1b6fb3fc8393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baad251aa4d7489ebd532734f13dfcf2)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:48.085766 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ca509-5516-43c6-8acd-1b6fb3fc8393 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:48.144098 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2e9ca509-5516-43c6-8acd-1b6fb3fc8393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baad251aa4d7489ebd532734f13dfcf2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:48.145033 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2e9ca509-5516-43c6-8acd-1b6fb3fc8393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baad251aa4d7489ebd532734f13dfcf2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:48.164527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2e9ca509-5516-43c6-8acd-1b6fb3fc8393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baad251aa4d7489ebd532734f13dfcf2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:48.181426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2e9ca509-5516-43c6-8acd-1b6fb3fc8393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baad251aa4d7489ebd532734f13dfcf2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:48.191826 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2e9ca509-5516-43c6-8acd-1b6fb3fc8393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baad251aa4d7489ebd532734f13dfcf2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:48.205995 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1060/2109] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:47 2022] DELETE /identity/v3/users/baad251aa4d7489ebd532734f13dfcf2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:48.294764 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67ec37-a79c-411a-ab5c-e1b9aa91746d admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:48.296129 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-6e67ec37-a79c-411a-ab5c-e1b9aa91746d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:48.411311 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67ec37-a79c-411a-ab5c-e1b9aa91746d admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:48.422215 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ca509-5516-43c6-8acd-1b6fb3fc8393 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:48.424629 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2e9ca509-5516-43c6-8acd-1b6fb3fc8393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:48.434201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:48.482378 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72794e0-1e69-47df-8539-1d21beaba013 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:48.482993 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72794e0-1e69-47df-8539-1d21beaba013 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:48.483271 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72794e0-1e69-47df-8539-1d21beaba013 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:48.483672 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72794e0-1e69-47df-8539-1d21beaba013 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:48.485353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b72794e0-1e69-47df-8539-1d21beaba013 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:48.517152 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ca509-5516-43c6-8acd-1b6fb3fc8393 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:48.522939 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca5224-3646-4462-a907-1d138d2f2cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:48.522939 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca5224-3646-4462-a907-1d138d2f2cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:48.522939 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca5224-3646-4462-a907-1d138d2f2cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:48.523265 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca5224-3646-4462-a907-1d138d2f2cb6 admin admin] PATH_INFO: `/v3/users/0735ce6dacd04c26ada60764df03c143` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:48.533016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca5224-3646-4462-a907-1d138d2f2cb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0735ce6dacd04c26ada60764df03c143)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:48.534828 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca5224-3646-4462-a907-1d138d2f2cb6 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:48.554169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72794e0-1e69-47df-8539-1d21beaba013 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:48.555700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72794e0-1e69-47df-8539-1d21beaba013 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:48.568806 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1050/2110] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:48.596583 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-85ca5224-3646-4462-a907-1d138d2f2cb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0735ce6dacd04c26ada60764df03c143'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:48.597419 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-85ca5224-3646-4462-a907-1d138d2f2cb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0735ce6dacd04c26ada60764df03c143'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:48.599686 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72794e0-1e69-47df-8539-1d21beaba013 service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:48.601990 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b72794e0-1e69-47df-8539-1d21beaba013 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:48.618438 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-85ca5224-3646-4462-a907-1d138d2f2cb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0735ce6dacd04c26ada60764df03c143'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:48.622556 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72794e0-1e69-47df-8539-1d21beaba013 service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:48.627899 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea95b9-c168-48d3-b76d-8861b349d65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:48.628590 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea95b9-c168-48d3-b76d-8861b349d65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:48.628870 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea95b9-c168-48d3-b76d-8861b349d65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:48.629141 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea95b9-c168-48d3-b76d-8861b349d65d admin admin] PATH_INFO: `/v3/projects/ace42324b0e54a3f86d14b6216431157` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:48.630508 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea95b9-c168-48d3-b76d-8861b349d65d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace42324b0e54a3f86d14b6216431157)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:48.633322 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea95b9-c168-48d3-b76d-8861b349d65d admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:48.634590 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-85ca5224-3646-4462-a907-1d138d2f2cb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0735ce6dacd04c26ada60764df03c143'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:48.643485 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-85ca5224-3646-4462-a907-1d138d2f2cb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0735ce6dacd04c26ada60764df03c143'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:48.651827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1061/2111] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:48 2022] DELETE /identity/v3/users/0735ce6dacd04c26ada60764df03c143 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:30:48.656289 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f521800-75ad-47af-9ae0-60568f50505b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:48.656678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f521800-75ad-47af-9ae0-60568f50505b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:48.656952 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f521800-75ad-47af-9ae0-60568f50505b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:48.678460 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-2f521800-75ad-47af-9ae0-60568f50505b None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:48.679677 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2f521800-75ad-47af-9ae0-60568f50505b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:48.692348 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-04ea95b9-c168-48d3-b76d-8861b349d65d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace42324b0e54a3f86d14b6216431157', 'request_id': 'req-04ea95b9-c168-48d3-b76d-8861b349d65d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:48.701501 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-04ea95b9-c168-48d3-b76d-8861b349d65d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace42324b0e54a3f86d14b6216431157', 'request_id': 'req-04ea95b9-c168-48d3-b76d-8861b349d65d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:48.710233 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-04ea95b9-c168-48d3-b76d-8861b349d65d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace42324b0e54a3f86d14b6216431157', 'request_id': 'req-04ea95b9-c168-48d3-b76d-8861b349d65d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:48.712469 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:48.736398 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-04ea95b9-c168-48d3-b76d-8861b349d65d admin admin] The token cache is being invalidate because project ace42324b0e54a3f86d14b6216431157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:48.736996 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-04ea95b9-c168-48d3-b76d-8861b349d65d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:48.738273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-04ea95b9-c168-48d3-b76d-8861b349d65d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:48.741043 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1051/2112] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:48 2022] DELETE /identity/v3/projects/ace42324b0e54a3f86d14b6216431157 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:48.748039 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766627ba-b859-4f55-a162-4de03606cd46 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:48.748400 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766627ba-b859-4f55-a162-4de03606cd46 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:48.748702 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766627ba-b859-4f55-a162-4de03606cd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:48.771099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1062/2113] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:30:48.778061 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f521800-75ad-47af-9ae0-60568f50505b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:48.779992 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2f521800-75ad-47af-9ae0-60568f50505b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:48.781900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-766627ba-b859-4f55-a162-4de03606cd46 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:48.783248 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-766627ba-b859-4f55-a162-4de03606cd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:48.800922 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1052/2114] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:48.803205 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ec505-f8ed-4a22-aaf7-4fac6291c4e1 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:48.803494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ec505-f8ed-4a22-aaf7-4fac6291c4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:48.803799 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ec505-f8ed-4a22-aaf7-4fac6291c4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:48.824411 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:48.830645 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-c51ec505-f8ed-4a22-aaf7-4fac6291c4e1 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:48.833301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-c51ec505-f8ed-4a22-aaf7-4fac6291c4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:48.844185 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1053/2115] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:30:48.849622 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ec505-f8ed-4a22-aaf7-4fac6291c4e1 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:48.860572 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ec505-f8ed-4a22-aaf7-4fac6291c4e1 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:48.866052 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70df9ad-d047-4efd-a345-ee68ccd49758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:48.866904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70df9ad-d047-4efd-a345-ee68ccd49758 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:48.867358 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70df9ad-d047-4efd-a345-ee68ccd49758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:48.867880 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70df9ad-d047-4efd-a345-ee68ccd49758 admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:48.868671 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70df9ad-d047-4efd-a345-ee68ccd49758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:30:48.869070 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70df9ad-d047-4efd-a345-ee68ccd49758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:48.871410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70df9ad-d047-4efd-a345-ee68ccd49758 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:48.881525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f521800-75ad-47af-9ae0-60568f50505b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:48.884608 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1054/2116] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:30:48.889416 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70df9ad-d047-4efd-a345-ee68ccd49758 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:48.891526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18309363-9ba9-4534-b208-e40a2c6b0f08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:48.893115 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18309363-9ba9-4534-b208-e40a2c6b0f08 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:48.893398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18309363-9ba9-4534-b208-e40a2c6b0f08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:48.894707 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18309363-9ba9-4534-b208-e40a2c6b0f08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:48.903039 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70df9ad-d047-4efd-a345-ee68ccd49758 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:48.908667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a804d62-c27e-443d-9ca8-54e58b11e180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:48.909470 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a804d62-c27e-443d-9ca8-54e58b11e180 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:48.909941 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a804d62-c27e-443d-9ca8-54e58b11e180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:48.910359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a804d62-c27e-443d-9ca8-54e58b11e180 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:48.911098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a804d62-c27e-443d-9ca8-54e58b11e180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:48.913255 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a804d62-c27e-443d-9ca8-54e58b11e180 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:48.921125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18309363-9ba9-4534-b208-e40a2c6b0f08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:48.923435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18309363-9ba9-4534-b208-e40a2c6b0f08 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:48.938951 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1063/2117] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:48.950470 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1055/2118] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:48 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:30:48.951838 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18309363-9ba9-4534-b208-e40a2c6b0f08 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:48.964392 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18309363-9ba9-4534-b208-e40a2c6b0f08 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:49.039905 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fca98-a7ec-4af9-8437-c2581673925a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:49.040543 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fca98-a7ec-4af9-8437-c2581673925a admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:49.040819 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fca98-a7ec-4af9-8437-c2581673925a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:49.041088 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fca98-a7ec-4af9-8437-c2581673925a admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:49.041851 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fca98-a7ec-4af9-8437-c2581673925a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:49.043807 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fca98-a7ec-4af9-8437-c2581673925a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:49.077407 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1064/2119] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:48 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:49.087971 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a804d62-c27e-443d-9ca8-54e58b11e180 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:49.108789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a804d62-c27e-443d-9ca8-54e58b11e180 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:49.114105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254d663-3fbc-46c6-8fc5-7eeb0daeed92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:49.114954 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254d663-3fbc-46c6-8fc5-7eeb0daeed92 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:49.115335 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254d663-3fbc-46c6-8fc5-7eeb0daeed92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:49.115672 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254d663-3fbc-46c6-8fc5-7eeb0daeed92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:49.116424 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254d663-3fbc-46c6-8fc5-7eeb0daeed92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:49.118342 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254d663-3fbc-46c6-8fc5-7eeb0daeed92 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:49.139581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fca98-a7ec-4af9-8437-c2581673925a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:49.150012 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1056/2120] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:30:49.157303 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fca98-a7ec-4af9-8437-c2581673925a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:49.163771 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a65847-8737-4431-a1d5-6bb4f94e1b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:49.164487 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a65847-8737-4431-a1d5-6bb4f94e1b7b admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:49.165428 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a65847-8737-4431-a1d5-6bb4f94e1b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:49.165762 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a65847-8737-4431-a1d5-6bb4f94e1b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:49.166522 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a65847-8737-4431-a1d5-6bb4f94e1b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:49.168617 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a65847-8737-4431-a1d5-6bb4f94e1b7b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:49.188634 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1065/2121] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:49.189960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254d663-3fbc-46c6-8fc5-7eeb0daeed92 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:49.204025 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254d663-3fbc-46c6-8fc5-7eeb0daeed92 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:49.215342 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d3037-5bf1-4190-8270-c2b82d6ebfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:49.216602 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d3037-5bf1-4190-8270-c2b82d6ebfe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:49.217200 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d3037-5bf1-4190-8270-c2b82d6ebfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:49.217602 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d3037-5bf1-4190-8270-c2b82d6ebfe3 admin admin] PATH_INFO: `/v3/projects/42249da8b2ed480595b36a861c402b4e/users/11325494a879498b943645ea442e7aeb/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:49.237470 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d3037-5bf1-4190-8270-c2b82d6ebfe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42249da8b2ed480595b36a861c402b4e, user_id=11325494a879498b943645ea442e7aeb, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:49.248679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d3037-5bf1-4190-8270-c2b82d6ebfe3 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:49.264478 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1057/2122] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:49 2022] PUT /identity/v3/projects/42249da8b2ed480595b36a861c402b4e/users/11325494a879498b943645ea442e7aeb/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:30:49.277272 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfd3a1-be4f-4839-b5c3-36228a1b7a0b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:49.277828 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfd3a1-be4f-4839-b5c3-36228a1b7a0b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:49.278108 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfd3a1-be4f-4839-b5c3-36228a1b7a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:49.320030 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-31dfd3a1-be4f-4839-b5c3-36228a1b7a0b None None] MFA Rules not processed for user `11325494a879498b943645ea442e7aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:49.320030 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-31dfd3a1-be4f-4839-b5c3-36228a1b7a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:49.438451 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d3037-5bf1-4190-8270-c2b82d6ebfe3 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:49.441501 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-035d3037-5bf1-4190-8270-c2b82d6ebfe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:49.496246 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1066/2123] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:49.531504 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d3037-5bf1-4190-8270-c2b82d6ebfe3 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:49.549321 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808486e-6f35-4985-b7aa-ea4d9d683a10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:49.550013 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808486e-6f35-4985-b7aa-ea4d9d683a10 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:49.564258 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808486e-6f35-4985-b7aa-ea4d9d683a10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:49.564258 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808486e-6f35-4985-b7aa-ea4d9d683a10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:49.564991 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d808486e-6f35-4985-b7aa-ea4d9d683a10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:49.615767 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfd3a1-be4f-4839-b5c3-36228a1b7a0b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:49.617452 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-31dfd3a1-be4f-4839-b5c3-36228a1b7a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:49.639000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfd3a1-be4f-4839-b5c3-36228a1b7a0b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:49.646129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df7ccf-efce-4e78-bafa-a852e4731315 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:49.647076 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df7ccf-efce-4e78-bafa-a852e4731315 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:49.647353 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df7ccf-efce-4e78-bafa-a852e4731315 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:49.647674 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df7ccf-efce-4e78-bafa-a852e4731315 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:49.668974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df7ccf-efce-4e78-bafa-a852e4731315 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:49.670723 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df7ccf-efce-4e78-bafa-a852e4731315 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:49.695398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1067/2124] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:49.697808 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808486e-6f35-4985-b7aa-ea4d9d683a10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:49.699311 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808486e-6f35-4985-b7aa-ea4d9d683a10 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:49.721576 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1058/2125] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:49.927108 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df7ccf-efce-4e78-bafa-a852e4731315 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:49.928977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-30df7ccf-efce-4e78-bafa-a852e4731315 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:49.982600 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:50.060921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df7ccf-efce-4e78-bafa-a852e4731315 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:50.074176 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ee970-e07e-4bbb-997b-22589015b804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:50.074910 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ee970-e07e-4bbb-997b-22589015b804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:50.075362 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ee970-e07e-4bbb-997b-22589015b804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:50.075659 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ee970-e07e-4bbb-997b-22589015b804 admin admin] PATH_INFO: `/v3/projects/57c6277902234a5e9edd59673dbd7085` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:50.078967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ee970-e07e-4bbb-997b-22589015b804 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57c6277902234a5e9edd59673dbd7085)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:50.080987 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ee970-e07e-4bbb-997b-22589015b804 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:50.201848 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-700ee970-e07e-4bbb-997b-22589015b804 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57c6277902234a5e9edd59673dbd7085', 'request_id': 'req-700ee970-e07e-4bbb-997b-22589015b804'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:50.216618 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-700ee970-e07e-4bbb-997b-22589015b804 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57c6277902234a5e9edd59673dbd7085', 'request_id': 'req-700ee970-e07e-4bbb-997b-22589015b804'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:50.246912 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-700ee970-e07e-4bbb-997b-22589015b804 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57c6277902234a5e9edd59673dbd7085', 'request_id': 'req-700ee970-e07e-4bbb-997b-22589015b804'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:50.265211 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-700ee970-e07e-4bbb-997b-22589015b804 admin admin] The token cache is being invalidate because project 57c6277902234a5e9edd59673dbd7085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:50.265715 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-700ee970-e07e-4bbb-997b-22589015b804 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:50.266425 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-700ee970-e07e-4bbb-997b-22589015b804 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:50.268038 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1068/2126] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:49 2022] DELETE /identity/v3/projects/57c6277902234a5e9edd59673dbd7085 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:50.272196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808486e-6f35-4985-b7aa-ea4d9d683a10 service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:50.288441 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808486e-6f35-4985-b7aa-ea4d9d683a10 service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:50.308733 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:50.365822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa835307-6bc1-41a3-be61-bdab3626211e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:50.366390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa835307-6bc1-41a3-be61-bdab3626211e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:50.366664 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa835307-6bc1-41a3-be61-bdab3626211e admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:50.366929 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa835307-6bc1-41a3-be61-bdab3626211e admin admin] PATH_INFO: `/v3/users/dc83c7f5c66d4786bbd1cc2a6a5ab58e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:50.368071 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa835307-6bc1-41a3-be61-bdab3626211e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc83c7f5c66d4786bbd1cc2a6a5ab58e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:50.370664 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa835307-6bc1-41a3-be61-bdab3626211e admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:50.420428 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-aa835307-6bc1-41a3-be61-bdab3626211e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc83c7f5c66d4786bbd1cc2a6a5ab58e'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:50.421690 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-aa835307-6bc1-41a3-be61-bdab3626211e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc83c7f5c66d4786bbd1cc2a6a5ab58e'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:50.434416 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-aa835307-6bc1-41a3-be61-bdab3626211e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc83c7f5c66d4786bbd1cc2a6a5ab58e'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:50.442977 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-aa835307-6bc1-41a3-be61-bdab3626211e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc83c7f5c66d4786bbd1cc2a6a5ab58e'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:50.450456 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-aa835307-6bc1-41a3-be61-bdab3626211e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc83c7f5c66d4786bbd1cc2a6a5ab58e'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:50.456542 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1059/2127] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:50 2022] DELETE /identity/v3/users/dc83c7f5c66d4786bbd1cc2a6a5ab58e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:50.795079 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ee970-e07e-4bbb-997b-22589015b804 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:50.796613 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-700ee970-e07e-4bbb-997b-22589015b804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:50.814399 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ee970-e07e-4bbb-997b-22589015b804 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:50.898215 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa835307-6bc1-41a3-be61-bdab3626211e admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:50.899701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-aa835307-6bc1-41a3-be61-bdab3626211e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:50.931304 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1b225-ba40-4b77-8b23-6a0a53b749a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:50.933837 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1b225-ba40-4b77-8b23-6a0a53b749a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:50.934136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1b225-ba40-4b77-8b23-6a0a53b749a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:50.934418 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1b225-ba40-4b77-8b23-6a0a53b749a2 admin admin] PATH_INFO: `/v3/projects/fa86bd1d348c475291d46ba55a0d4939` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:50.938976 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1b225-ba40-4b77-8b23-6a0a53b749a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa86bd1d348c475291d46ba55a0d4939)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:50.945351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1b225-ba40-4b77-8b23-6a0a53b749a2 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:50.985895 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa835307-6bc1-41a3-be61-bdab3626211e admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:51.004619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38488ae7-90d5-43d9-b2d2-ff53c152af13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:51.006091 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38488ae7-90d5-43d9-b2d2-ff53c152af13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:51.006380 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38488ae7-90d5-43d9-b2d2-ff53c152af13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:51.006653 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38488ae7-90d5-43d9-b2d2-ff53c152af13 admin admin] PATH_INFO: `/v3/users/cf8c961bd4104cf78f78e15cf29a8a1a` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:51.011633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38488ae7-90d5-43d9-b2d2-ff53c152af13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf8c961bd4104cf78f78e15cf29a8a1a)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:51.016717 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38488ae7-90d5-43d9-b2d2-ff53c152af13 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:51.060898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-73d1b225-ba40-4b77-8b23-6a0a53b749a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa86bd1d348c475291d46ba55a0d4939', 'request_id': 'req-73d1b225-ba40-4b77-8b23-6a0a53b749a2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:51.076938 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:51.083000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-73d1b225-ba40-4b77-8b23-6a0a53b749a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa86bd1d348c475291d46ba55a0d4939', 'request_id': 'req-73d1b225-ba40-4b77-8b23-6a0a53b749a2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:51.105971 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:51.106365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-73d1b225-ba40-4b77-8b23-6a0a53b749a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa86bd1d348c475291d46ba55a0d4939', 'request_id': 'req-73d1b225-ba40-4b77-8b23-6a0a53b749a2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:51.136845 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-73d1b225-ba40-4b77-8b23-6a0a53b749a2 admin admin] The token cache is being invalidate because project fa86bd1d348c475291d46ba55a0d4939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:51.137695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-73d1b225-ba40-4b77-8b23-6a0a53b749a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:51.141101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-73d1b225-ba40-4b77-8b23-6a0a53b749a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:51.141987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-38488ae7-90d5-43d9-b2d2-ff53c152af13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf8c961bd4104cf78f78e15cf29a8a1a'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:51.143255 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-38488ae7-90d5-43d9-b2d2-ff53c152af13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf8c961bd4104cf78f78e15cf29a8a1a'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:51.151439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1069/2128] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:50 2022] DELETE /identity/v3/projects/fa86bd1d348c475291d46ba55a0d4939 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:51.153772 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8248d-055c-43c4-a41f-7a8e54d98b0b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:51.155093 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8248d-055c-43c4-a41f-7a8e54d98b0b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:51.155459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8248d-055c-43c4-a41f-7a8e54d98b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:51.180005 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-38488ae7-90d5-43d9-b2d2-ff53c152af13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf8c961bd4104cf78f78e15cf29a8a1a'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:51.193803 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-38488ae7-90d5-43d9-b2d2-ff53c152af13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf8c961bd4104cf78f78e15cf29a8a1a'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:51.202510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-4dc8248d-055c-43c4-a41f-7a8e54d98b0b None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:51.204681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-38488ae7-90d5-43d9-b2d2-ff53c152af13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf8c961bd4104cf78f78e15cf29a8a1a'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:51.206649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4dc8248d-055c-43c4-a41f-7a8e54d98b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:51.214614 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1060/2129] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:50 2022] DELETE /identity/v3/users/cf8c961bd4104cf78f78e15cf29a8a1a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:30:51.221166 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b7fda-9e1d-4425-a004-34ef4f33022c None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:51.221594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b7fda-9e1d-4425-a004-34ef4f33022c None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:51.221939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b7fda-9e1d-4425-a004-34ef4f33022c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:51.301822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-213b7fda-9e1d-4425-a004-34ef4f33022c None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:51.305035 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-213b7fda-9e1d-4425-a004-34ef4f33022c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:51.427050 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1070/2130] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:51.439459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12930b-3f4b-4ab5-a399-366050869815 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:51.439790 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12930b-3f4b-4ab5-a399-366050869815 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:51.440066 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12930b-3f4b-4ab5-a399-366050869815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:51.493060 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-1f12930b-3f4b-4ab5-a399-366050869815 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:51.493060 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1f12930b-3f4b-4ab5-a399-366050869815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:51.507690 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1061/2131] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:51.525121 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b7fda-9e1d-4425-a004-34ef4f33022c None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:51.530804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1071/2132] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:51.530944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-213b7fda-9e1d-4425-a004-34ef4f33022c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:51.535278 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12930b-3f4b-4ab5-a399-366050869815 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:51.562972 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12930b-3f4b-4ab5-a399-366050869815 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:51.574529 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f4b8a-f454-4206-bb8d-edb1b62bb1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:51.576801 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f4b8a-f454-4206-bb8d-edb1b62bb1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:51.577278 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f4b8a-f454-4206-bb8d-edb1b62bb1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:51.577386 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f4b8a-f454-4206-bb8d-edb1b62bb1d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:51.579246 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f4b8a-f454-4206-bb8d-edb1b62bb1d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:30:51.579700 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f4b8a-f454-4206-bb8d-edb1b62bb1d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:51.583546 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f4b8a-f454-4206-bb8d-edb1b62bb1d6 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:51.627453 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1072/2133] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:30:51.628990 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f4b8a-f454-4206-bb8d-edb1b62bb1d6 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:51.647588 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f4b8a-f454-4206-bb8d-edb1b62bb1d6 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:51.653566 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591dbd7-a777-4492-ab82-8db6e880d1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:51.654818 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591dbd7-a777-4492-ab82-8db6e880d1ee admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:51.654960 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591dbd7-a777-4492-ab82-8db6e880d1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:51.655278 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591dbd7-a777-4492-ab82-8db6e880d1ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:51.657447 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591dbd7-a777-4492-ab82-8db6e880d1ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:51.660347 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591dbd7-a777-4492-ab82-8db6e880d1ee admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:51.677287 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b7fda-9e1d-4425-a004-34ef4f33022c None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:51.683084 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bfe5c-828e-4df6-91c2-4bd61d378905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:51.683967 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bfe5c-828e-4df6-91c2-4bd61d378905 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:51.684340 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bfe5c-828e-4df6-91c2-4bd61d378905 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:51.684678 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bfe5c-828e-4df6-91c2-4bd61d378905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:51.703391 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1073/2134] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:51 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:30:51.703672 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bfe5c-828e-4df6-91c2-4bd61d378905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:51.703672 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bfe5c-828e-4df6-91c2-4bd61d378905 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:51.705376 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591dbd7-a777-4492-ab82-8db6e880d1ee admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:51.716012 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1062/2135] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:30:51.814827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591dbd7-a777-4492-ab82-8db6e880d1ee admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:51.832841 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de4439-ac22-4ca7-9639-94f400ae2d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:51.833917 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de4439-ac22-4ca7-9639-94f400ae2d92 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:51.834622 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de4439-ac22-4ca7-9639-94f400ae2d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:51.835097 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de4439-ac22-4ca7-9639-94f400ae2d92 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:51.836300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de4439-ac22-4ca7-9639-94f400ae2d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:51.844086 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de4439-ac22-4ca7-9639-94f400ae2d92 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:51.896224 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1074/2136] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:51 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:30:51.898990 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bfe5c-828e-4df6-91c2-4bd61d378905 service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:51.915172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bfe5c-828e-4df6-91c2-4bd61d378905 service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:51.929781 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594305b-efec-4344-a83c-b1b380d044d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:51.930888 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594305b-efec-4344-a83c-b1b380d044d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:51.931406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594305b-efec-4344-a83c-b1b380d044d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:51.931511 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594305b-efec-4344-a83c-b1b380d044d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:51.933850 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594305b-efec-4344-a83c-b1b380d044d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:51.937630 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594305b-efec-4344-a83c-b1b380d044d8 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:51.969313 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1063/2137] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:51.973301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de4439-ac22-4ca7-9639-94f400ae2d92 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:51.988638 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de4439-ac22-4ca7-9639-94f400ae2d92 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:51.993822 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b83117-c611-45d2-951d-e95754f8c78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:51.995285 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b83117-c611-45d2-951d-e95754f8c78b admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:51.995862 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b83117-c611-45d2-951d-e95754f8c78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:51.996312 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b83117-c611-45d2-951d-e95754f8c78b admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:51.997183 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b83117-c611-45d2-951d-e95754f8c78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:51.998850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b83117-c611-45d2-951d-e95754f8c78b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:52.011945 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1075/2138] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:52.016353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594305b-efec-4344-a83c-b1b380d044d8 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:52.031029 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594305b-efec-4344-a83c-b1b380d044d8 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:52.040069 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d99576-e42d-4749-a5a8-d260e93804f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:52.040937 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d99576-e42d-4749-a5a8-d260e93804f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:52.041259 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d99576-e42d-4749-a5a8-d260e93804f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:52.041535 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d99576-e42d-4749-a5a8-d260e93804f5 admin admin] PATH_INFO: `/v3/projects/4906855743624a2a8aa6debd5f1fac02/users/0cc5cb5e634240159b537db9e27ec51c/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:52.064492 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d99576-e42d-4749-a5a8-d260e93804f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4906855743624a2a8aa6debd5f1fac02, user_id=0cc5cb5e634240159b537db9e27ec51c, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:52.069040 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d99576-e42d-4749-a5a8-d260e93804f5 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:52.106299 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1064/2139] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:52 2022] PUT /identity/v3/projects/4906855743624a2a8aa6debd5f1fac02/users/0cc5cb5e634240159b537db9e27ec51c/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:30:52.109085 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e7181-bb25-4160-814d-b17c49dc7432 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:52.109586 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e7181-bb25-4160-814d-b17c49dc7432 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:52.109887 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e7181-bb25-4160-814d-b17c49dc7432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:52.113992 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d99576-e42d-4749-a5a8-d260e93804f5 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:52.115649 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-92d99576-e42d-4749-a5a8-d260e93804f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:52.156654 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-6d7e7181-bb25-4160-814d-b17c49dc7432 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:52.159837 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6d7e7181-bb25-4160-814d-b17c49dc7432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:52.172030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:52.184638 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:52.240682 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d99576-e42d-4749-a5a8-d260e93804f5 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:52.248352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fdfcb6-7b66-401a-bdbd-6fe8b3898c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:52.249413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdfcb6-7b66-401a-bdbd-6fe8b3898c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:52.249911 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdfcb6-7b66-401a-bdbd-6fe8b3898c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:52.250386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdfcb6-7b66-401a-bdbd-6fe8b3898c34 admin admin] PATH_INFO: `/v3/projects/1955d6d7a9344b468cda9a57d6f608bd` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:52.252417 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fdfcb6-7b66-401a-bdbd-6fe8b3898c34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1955d6d7a9344b468cda9a57d6f608bd)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:52.256029 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fdfcb6-7b66-401a-bdbd-6fe8b3898c34 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:52.266099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1076/2140] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:52.280228 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e7181-bb25-4160-814d-b17c49dc7432 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:52.281659 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6d7e7181-bb25-4160-814d-b17c49dc7432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:52.336674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-82fdfcb6-7b66-401a-bdbd-6fe8b3898c34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1955d6d7a9344b468cda9a57d6f608bd', 'request_id': 'req-82fdfcb6-7b66-401a-bdbd-6fe8b3898c34'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:52.344702 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-82fdfcb6-7b66-401a-bdbd-6fe8b3898c34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1955d6d7a9344b468cda9a57d6f608bd', 'request_id': 'req-82fdfcb6-7b66-401a-bdbd-6fe8b3898c34'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:52.355218 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-82fdfcb6-7b66-401a-bdbd-6fe8b3898c34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1955d6d7a9344b468cda9a57d6f608bd', 'request_id': 'req-82fdfcb6-7b66-401a-bdbd-6fe8b3898c34'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:52.367039 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e7181-bb25-4160-814d-b17c49dc7432 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:52.374071 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-82fdfcb6-7b66-401a-bdbd-6fe8b3898c34 admin admin] The token cache is being invalidate because project 1955d6d7a9344b468cda9a57d6f608bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:52.374531 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-82fdfcb6-7b66-401a-bdbd-6fe8b3898c34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:52.375375 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-82fdfcb6-7b66-401a-bdbd-6fe8b3898c34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:52.377651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1065/2141] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:52 2022] DELETE /identity/v3/projects/1955d6d7a9344b468cda9a57d6f608bd => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:52.382707 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fdfcb6-7b66-401a-bdbd-6fe8b3898c34 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:52.384725 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-82fdfcb6-7b66-401a-bdbd-6fe8b3898c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:52.466257 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547817b-4895-4ef2-a944-569f609619e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:52.467091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547817b-4895-4ef2-a944-569f609619e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:52.467267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547817b-4895-4ef2-a944-569f609619e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:52.467501 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547817b-4895-4ef2-a944-569f609619e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:52.469314 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5547817b-4895-4ef2-a944-569f609619e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:52.526574 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fdfcb6-7b66-401a-bdbd-6fe8b3898c34 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:52.534156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4ab67-3ef2-4da7-b937-8925553a1c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:52.535150 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4ab67-3ef2-4da7-b937-8925553a1c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:52.535810 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4ab67-3ef2-4da7-b937-8925553a1c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:52.536098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4ab67-3ef2-4da7-b937-8925553a1c81 admin admin] PATH_INFO: `/v3/users/da105622239643c6a5b5632211281373` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:52.537989 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4ab67-3ef2-4da7-b937-8925553a1c81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da105622239643c6a5b5632211281373)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:52.542110 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4ab67-3ef2-4da7-b937-8925553a1c81 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:52.584156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547817b-4895-4ef2-a944-569f609619e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:52.586725 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547817b-4895-4ef2-a944-569f609619e3 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:52.627600 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-d2f4ab67-3ef2-4da7-b937-8925553a1c81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da105622239643c6a5b5632211281373'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:52.628346 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-d2f4ab67-3ef2-4da7-b937-8925553a1c81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da105622239643c6a5b5632211281373'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:52.634503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:52.642766 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1077/2142] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:52.649734 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-d2f4ab67-3ef2-4da7-b937-8925553a1c81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da105622239643c6a5b5632211281373'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:52.660938 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-d2f4ab67-3ef2-4da7-b937-8925553a1c81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da105622239643c6a5b5632211281373'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:52.673431 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-d2f4ab67-3ef2-4da7-b937-8925553a1c81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da105622239643c6a5b5632211281373'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:52.692366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1066/2143] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:52 2022] DELETE /identity/v3/users/da105622239643c6a5b5632211281373 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:53.423902 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547817b-4895-4ef2-a944-569f609619e3 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:53.442142 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547817b-4895-4ef2-a944-569f609619e3 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:53.493413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:53.566426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626bbd7-633f-40aa-be16-2b842624da1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:53.567433 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626bbd7-633f-40aa-be16-2b842624da1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:53.567565 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626bbd7-633f-40aa-be16-2b842624da1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:53.568003 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626bbd7-633f-40aa-be16-2b842624da1a admin admin] PATH_INFO: `/v3/projects/cefab45ef1014e558f9f482914fa8516` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:53.569263 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626bbd7-633f-40aa-be16-2b842624da1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cefab45ef1014e558f9f482914fa8516)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:53.571426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626bbd7-633f-40aa-be16-2b842624da1a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:53.627141 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-7626bbd7-633f-40aa-be16-2b842624da1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cefab45ef1014e558f9f482914fa8516', 'request_id': 'req-7626bbd7-633f-40aa-be16-2b842624da1a'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:53.633074 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-7626bbd7-633f-40aa-be16-2b842624da1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cefab45ef1014e558f9f482914fa8516', 'request_id': 'req-7626bbd7-633f-40aa-be16-2b842624da1a'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:53.641406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-7626bbd7-633f-40aa-be16-2b842624da1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cefab45ef1014e558f9f482914fa8516', 'request_id': 'req-7626bbd7-633f-40aa-be16-2b842624da1a'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:53.661026 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-7626bbd7-633f-40aa-be16-2b842624da1a admin admin] The token cache is being invalidate because project cefab45ef1014e558f9f482914fa8516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:53.661290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-7626bbd7-633f-40aa-be16-2b842624da1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:53.662511 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-7626bbd7-633f-40aa-be16-2b842624da1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:53.665562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1078/2144] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:53 2022] DELETE /identity/v3/projects/cefab45ef1014e558f9f482914fa8516 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:53.672406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae1149-b38d-4a35-a47a-420261f709ca None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:53.672962 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae1149-b38d-4a35-a47a-420261f709ca None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:53.672962 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae1149-b38d-4a35-a47a-420261f709ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:53.699133 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-4bae1149-b38d-4a35-a47a-420261f709ca None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:53.700378 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-4bae1149-b38d-4a35-a47a-420261f709ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:53.765774 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1067/2145] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:53.774472 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b6d79-317f-4533-9a1c-33c6479c2fb5 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:53.774737 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b6d79-317f-4533-9a1c-33c6479c2fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:53.775037 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b6d79-317f-4533-9a1c-33c6479c2fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:53.801692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-2d5b6d79-317f-4533-9a1c-33c6479c2fb5 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:53.802965 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2d5b6d79-317f-4533-9a1c-33c6479c2fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:53.813232 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1079/2146] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:53.817926 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae1149-b38d-4a35-a47a-420261f709ca None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:53.832151 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae1149-b38d-4a35-a47a-420261f709ca None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:53.839014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf090ccf-efa2-446e-8590-e7628ccd7eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:53.839770 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf090ccf-efa2-446e-8590-e7628ccd7eac admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:53.840056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf090ccf-efa2-446e-8590-e7628ccd7eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:53.840325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf090ccf-efa2-446e-8590-e7628ccd7eac admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:53.841180 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf090ccf-efa2-446e-8590-e7628ccd7eac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:30:53.841630 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf090ccf-efa2-446e-8590-e7628ccd7eac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:53.844116 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf090ccf-efa2-446e-8590-e7628ccd7eac admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:53.861985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1068/2147] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:30:53.863990 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b6d79-317f-4533-9a1c-33c6479c2fb5 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:53.874450 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b6d79-317f-4533-9a1c-33c6479c2fb5 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:53.879566 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19d9ca-bdc9-4fd5-b12a-0a30f83415ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:53.880247 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19d9ca-bdc9-4fd5-b12a-0a30f83415ae admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:53.880508 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19d9ca-bdc9-4fd5-b12a-0a30f83415ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:53.880755 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19d9ca-bdc9-4fd5-b12a-0a30f83415ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:53.881413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19d9ca-bdc9-4fd5-b12a-0a30f83415ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:53.883469 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19d9ca-bdc9-4fd5-b12a-0a30f83415ae admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:53.911081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2214284-a7e2-4303-9857-02a398fa120d None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:53.911647 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2214284-a7e2-4303-9857-02a398fa120d None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:53.912092 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2214284-a7e2-4303-9857-02a398fa120d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:53.923638 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1080/2148] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:53 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:53.928851 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19d9ca-bdc9-4fd5-b12a-0a30f83415ae admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:53.958755 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-e2214284-a7e2-4303-9857-02a398fa120d None None] MFA Rules not processed for user `0cc5cb5e634240159b537db9e27ec51c`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:53.960042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e2214284-a7e2-4303-9857-02a398fa120d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:54.026509 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19d9ca-bdc9-4fd5-b12a-0a30f83415ae admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:54.034498 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348f871-2424-4a30-be4c-5f27fce05044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:54.035674 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348f871-2424-4a30-be4c-5f27fce05044 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:54.036080 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348f871-2424-4a30-be4c-5f27fce05044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:54.036445 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348f871-2424-4a30-be4c-5f27fce05044 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:54.037380 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9348f871-2424-4a30-be4c-5f27fce05044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:54.040197 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9348f871-2424-4a30-be4c-5f27fce05044 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:54.065945 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1081/2149] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:53 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:54.066919 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1069/2150] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:30:54.069859 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348f871-2424-4a30-be4c-5f27fce05044 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:54.079177 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2214284-a7e2-4303-9857-02a398fa120d None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:54.080711 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e2214284-a7e2-4303-9857-02a398fa120d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:54.082337 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348f871-2424-4a30-be4c-5f27fce05044 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:54.087570 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33680dc-7938-46b5-a43f-298f86acd2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:54.088977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33680dc-7938-46b5-a43f-298f86acd2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:54.089269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33680dc-7938-46b5-a43f-298f86acd2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:54.089531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33680dc-7938-46b5-a43f-298f86acd2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:54.090721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33680dc-7938-46b5-a43f-298f86acd2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:54.092355 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33680dc-7938-46b5-a43f-298f86acd2c2 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:54.107319 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1082/2151] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:30:54.108622 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33680dc-7938-46b5-a43f-298f86acd2c2 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:54.118842 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33680dc-7938-46b5-a43f-298f86acd2c2 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:54.124789 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7776d8d-c860-4143-b06c-7af853ba303f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:54.125572 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7776d8d-c860-4143-b06c-7af853ba303f admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:54.125849 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7776d8d-c860-4143-b06c-7af853ba303f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:54.126125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7776d8d-c860-4143-b06c-7af853ba303f admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:54.126762 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7776d8d-c860-4143-b06c-7af853ba303f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:54.128385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7776d8d-c860-4143-b06c-7af853ba303f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:54.129866 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:54.142732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1083/2152] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:30:54.146649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7776d8d-c860-4143-b06c-7af853ba303f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:54.147760 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:54.152186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2214284-a7e2-4303-9857-02a398fa120d None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:54.157745 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7776d8d-c860-4143-b06c-7af853ba303f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:54.157916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b21df-fc1c-4983-bf7e-dfb7b7bc8dd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:54.158740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b21df-fc1c-4983-bf7e-dfb7b7bc8dd0 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:54.159201 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b21df-fc1c-4983-bf7e-dfb7b7bc8dd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:54.159676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b21df-fc1c-4983-bf7e-dfb7b7bc8dd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:54.162757 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0fbb2-9e85-4784-a34c-abd201a26d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:54.163415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0fbb2-9e85-4784-a34c-abd201a26d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:54.163721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0fbb2-9e85-4784-a34c-abd201a26d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:54.164020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0fbb2-9e85-4784-a34c-abd201a26d5a admin admin] PATH_INFO: `/v3/projects/ea4200236c9a4fa7be2ee5545d1e56e2/users/f1d53447f030413da4992add26ce2ede/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:54.169674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b21df-fc1c-4983-bf7e-dfb7b7bc8dd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:54.171191 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b21df-fc1c-4983-bf7e-dfb7b7bc8dd0 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:54.181218 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0fbb2-9e85-4784-a34c-abd201a26d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea4200236c9a4fa7be2ee5545d1e56e2, user_id=f1d53447f030413da4992add26ce2ede, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:54.183443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1070/2153] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:30:54.184506 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0fbb2-9e85-4784-a34c-abd201a26d5a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:54.199639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1084/2154] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:54 2022] PUT /identity/v3/projects/ea4200236c9a4fa7be2ee5545d1e56e2/users/f1d53447f030413da4992add26ce2ede/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:30:54.212242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19ebcd-7a5c-4498-8075-6075e60fc7d5 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:54.212709 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19ebcd-7a5c-4498-8075-6075e60fc7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:54.213742 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19ebcd-7a5c-4498-8075-6075e60fc7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:54.244835 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-8f19ebcd-7a5c-4498-8075-6075e60fc7d5 None None] MFA Rules not processed for user `f1d53447f030413da4992add26ce2ede`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:54.246161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-8f19ebcd-7a5c-4498-8075-6075e60fc7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:54.330918 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1071/2155] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:54.335594 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0fbb2-9e85-4784-a34c-abd201a26d5a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:54.390026 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19ebcd-7a5c-4498-8075-6075e60fc7d5 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:54.391444 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-8f19ebcd-7a5c-4498-8075-6075e60fc7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:54.423371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0fbb2-9e85-4784-a34c-abd201a26d5a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:54.429378 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92829410-5b6c-4eb2-aaba-c88268a7fee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:54.431103 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92829410-5b6c-4eb2-aaba-c88268a7fee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:54.431390 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92829410-5b6c-4eb2-aaba-c88268a7fee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:54.432234 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92829410-5b6c-4eb2-aaba-c88268a7fee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:54.433128 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92829410-5b6c-4eb2-aaba-c88268a7fee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:54.435508 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92829410-5b6c-4eb2-aaba-c88268a7fee8 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:54.474405 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1085/2156] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:54 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:54.478317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92829410-5b6c-4eb2-aaba-c88268a7fee8 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:54.488243 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19ebcd-7a5c-4498-8075-6075e60fc7d5 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:54.584938 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d0e40-e8e4-4c30-8ade-d14e7a56be89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:54.586095 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d0e40-e8e4-4c30-8ade-d14e7a56be89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:54.586095 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d0e40-e8e4-4c30-8ade-d14e7a56be89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:54.586095 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d0e40-e8e4-4c30-8ade-d14e7a56be89 admin admin] PATH_INFO: `/v3/users/fec677f5ce70433a920f9c1a24f0ffe6` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:54.587311 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d0e40-e8e4-4c30-8ade-d14e7a56be89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fec677f5ce70433a920f9c1a24f0ffe6)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:54.589391 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d0e40-e8e4-4c30-8ade-d14e7a56be89 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:54.625782 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92829410-5b6c-4eb2-aaba-c88268a7fee8 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:54.631803 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff3b9b-47e1-45ff-bdfe-dbe58f863df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:54.632497 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff3b9b-47e1-45ff-bdfe-dbe58f863df7 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:54.632845 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff3b9b-47e1-45ff-bdfe-dbe58f863df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:54.633190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff3b9b-47e1-45ff-bdfe-dbe58f863df7 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:54.633919 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff3b9b-47e1-45ff-bdfe-dbe58f863df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:54.636189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff3b9b-47e1-45ff-bdfe-dbe58f863df7 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:54.639214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:54.660033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ed8d0e40-e8e4-4c30-8ade-d14e7a56be89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fec677f5ce70433a920f9c1a24f0ffe6'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:54.660033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ed8d0e40-e8e4-4c30-8ade-d14e7a56be89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fec677f5ce70433a920f9c1a24f0ffe6'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:54.663628 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1086/2157] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:54 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:30:54.668764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff3b9b-47e1-45ff-bdfe-dbe58f863df7 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:54.676729 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ed8d0e40-e8e4-4c30-8ade-d14e7a56be89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fec677f5ce70433a920f9c1a24f0ffe6'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:54.684343 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff3b9b-47e1-45ff-bdfe-dbe58f863df7 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:54.691947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34b5ea-e769-4420-aa45-6cc212db6376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:54.692714 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34b5ea-e769-4420-aa45-6cc212db6376 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:54.693148 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34b5ea-e769-4420-aa45-6cc212db6376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:54.693574 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34b5ea-e769-4420-aa45-6cc212db6376 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:54.694265 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34b5ea-e769-4420-aa45-6cc212db6376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:54.694570 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ed8d0e40-e8e4-4c30-8ade-d14e7a56be89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fec677f5ce70433a920f9c1a24f0ffe6'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:54.696206 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34b5ea-e769-4420-aa45-6cc212db6376 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:54.705114 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ed8d0e40-e8e4-4c30-8ade-d14e7a56be89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fec677f5ce70433a920f9c1a24f0ffe6'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:54.708115 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1087/2158] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:30:54.712459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34b5ea-e769-4420-aa45-6cc212db6376 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:54.715084 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-eb34b5ea-e769-4420-aa45-6cc212db6376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:54.717071 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1072/2159] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:54 2022] DELETE /identity/v3/users/fec677f5ce70433a920f9c1a24f0ffe6 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:30:54.724566 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79ef3b-5f07-4b76-b5b1-8b7896928ca5 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:54.724857 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79ef3b-5f07-4b76-b5b1-8b7896928ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:54.725132 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79ef3b-5f07-4b76-b5b1-8b7896928ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:54.733390 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34b5ea-e769-4420-aa45-6cc212db6376 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:54.749127 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-1a79ef3b-5f07-4b76-b5b1-8b7896928ca5 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:54.751127 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-1a79ef3b-5f07-4b76-b5b1-8b7896928ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:54.777217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:54.817188 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f780c2-fc2c-412d-a822-cd4d8e21a35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:54.818547 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f780c2-fc2c-412d-a822-cd4d8e21a35b admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:54.819106 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f780c2-fc2c-412d-a822-cd4d8e21a35b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:54.820503 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f780c2-fc2c-412d-a822-cd4d8e21a35b admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:54.821133 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f780c2-fc2c-412d-a822-cd4d8e21a35b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:54.824088 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f780c2-fc2c-412d-a822-cd4d8e21a35b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:54.840119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1088/2160] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:30:54.840119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f780c2-fc2c-412d-a822-cd4d8e21a35b admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:54.849699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f780c2-fc2c-412d-a822-cd4d8e21a35b admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:54.852168 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1073/2161] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:54.855629 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab1a10-cf10-4761-8ea6-e50ca075b22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:54.856460 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab1a10-cf10-4761-8ea6-e50ca075b22d admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:54.856790 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab1a10-cf10-4761-8ea6-e50ca075b22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:54.857120 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab1a10-cf10-4761-8ea6-e50ca075b22d admin admin] PATH_INFO: `/v3/projects/4783a1d24f174fed93b974e981e7d5d6/users/90f4b22d73c64c62a42745d15ea47a77/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:54.866522 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79ef3b-5f07-4b76-b5b1-8b7896928ca5 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:54.871039 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-1a79ef3b-5f07-4b76-b5b1-8b7896928ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:54.876842 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab1a10-cf10-4761-8ea6-e50ca075b22d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4783a1d24f174fed93b974e981e7d5d6, user_id=90f4b22d73c64c62a42745d15ea47a77, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:54.881958 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab1a10-cf10-4761-8ea6-e50ca075b22d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:54.896222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1089/2162] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:54 2022] PUT /identity/v3/projects/4783a1d24f174fed93b974e981e7d5d6/users/90f4b22d73c64c62a42745d15ea47a77/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:54.907863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9366a-7d7c-4084-bd73-2925f4079634 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:54.908222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9366a-7d7c-4084-bd73-2925f4079634 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:54.908568 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9366a-7d7c-4084-bd73-2925f4079634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:54.944096 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-77c9366a-7d7c-4084-bd73-2925f4079634 None None] MFA Rules not processed for user `90f4b22d73c64c62a42745d15ea47a77`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:54.945381 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-77c9366a-7d7c-4084-bd73-2925f4079634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:54.953347 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79ef3b-5f07-4b76-b5b1-8b7896928ca5 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:55.011391 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b949e5-a648-45e2-90cb-e03e8de1298e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:55.012039 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b949e5-a648-45e2-90cb-e03e8de1298e service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:55.012325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b949e5-a648-45e2-90cb-e03e8de1298e service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:55.012598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b949e5-a648-45e2-90cb-e03e8de1298e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:55.021305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1090/2163] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:55.026031 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9366a-7d7c-4084-bd73-2925f4079634 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:55.033885 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:55.096154 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b949e5-a648-45e2-90cb-e03e8de1298e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:55.097516 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b949e5-a648-45e2-90cb-e03e8de1298e service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:55.106385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9366a-7d7c-4084-bd73-2925f4079634 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:55.109117 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1074/2164] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:55.111452 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa011f-916d-48db-bdd4-3e016c762e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:55.112113 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa011f-916d-48db-bdd4-3e016c762e7a admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:55.112391 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa011f-916d-48db-bdd4-3e016c762e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:55.112661 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa011f-916d-48db-bdd4-3e016c762e7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:55.113297 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa011f-916d-48db-bdd4-3e016c762e7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:55.115446 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa011f-916d-48db-bdd4-3e016c762e7a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:55.148914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1091/2165] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:55 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:55.154979 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b949e5-a648-45e2-90cb-e03e8de1298e service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:55.165831 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b949e5-a648-45e2-90cb-e03e8de1298e service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:55.258978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fc854-3998-4309-b2c9-09831da16349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:55.259959 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fc854-3998-4309-b2c9-09831da16349 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:55.260533 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fc854-3998-4309-b2c9-09831da16349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:55.261272 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fc854-3998-4309-b2c9-09831da16349 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:55.262935 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fc854-3998-4309-b2c9-09831da16349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:55.265303 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fc854-3998-4309-b2c9-09831da16349 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:55.305011 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1075/2166] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:55 2022] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:55.306292 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa011f-916d-48db-bdd4-3e016c762e7a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:55.319160 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa011f-916d-48db-bdd4-3e016c762e7a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:55.328052 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aef4df-353d-4980-998d-1c519c642ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:55.329127 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aef4df-353d-4980-998d-1c519c642ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:55.329263 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aef4df-353d-4980-998d-1c519c642ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:55.329465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aef4df-353d-4980-998d-1c519c642ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:55.330107 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aef4df-353d-4980-998d-1c519c642ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:55.331748 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aef4df-353d-4980-998d-1c519c642ce9 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:55.347328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1092/2167] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:55.348285 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fc854-3998-4309-b2c9-09831da16349 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:55.361247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fc854-3998-4309-b2c9-09831da16349 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:55.369026 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d87e6-556e-44e7-80ab-679f97f278db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:55.370198 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d87e6-556e-44e7-80ab-679f97f278db admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:55.370726 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d87e6-556e-44e7-80ab-679f97f278db admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:55.371953 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d87e6-556e-44e7-80ab-679f97f278db admin admin] PATH_INFO: `/v3/projects/1906c0e50457418fb5d960d6cc879a63/users/f8e8986077964447b68e33530f89fac6/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:55.406362 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d87e6-556e-44e7-80ab-679f97f278db admin admin] RBAC: Authorizing `identity:create_grant(project_id=1906c0e50457418fb5d960d6cc879a63, user_id=f8e8986077964447b68e33530f89fac6, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:55.409932 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d87e6-556e-44e7-80ab-679f97f278db admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:55.424271 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1076/2168] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:55 2022] PUT /identity/v3/projects/1906c0e50457418fb5d960d6cc879a63/users/f8e8986077964447b68e33530f89fac6/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:30:55.428720 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aef4df-353d-4980-998d-1c519c642ce9 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:55.441039 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aef4df-353d-4980-998d-1c519c642ce9 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:55.451605 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:55.466681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d87e6-556e-44e7-80ab-679f97f278db admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:55.468956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e54d87e6-556e-44e7-80ab-679f97f278db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:55.537215 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6695676-4bee-47da-9523-e185112b2288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:55.537724 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6695676-4bee-47da-9523-e185112b2288 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:55.538000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6695676-4bee-47da-9523-e185112b2288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:55.538269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6695676-4bee-47da-9523-e185112b2288 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:55.538915 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6695676-4bee-47da-9523-e185112b2288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:55.540543 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6695676-4bee-47da-9523-e185112b2288 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:55.555541 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d87e6-556e-44e7-80ab-679f97f278db admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:55.556754 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1093/2169] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:30:55.562254 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6695676-4bee-47da-9523-e185112b2288 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:55.563046 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392ba47-d727-4d96-82ba-6a26e3687ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:55.563459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392ba47-d727-4d96-82ba-6a26e3687ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:55.563770 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392ba47-d727-4d96-82ba-6a26e3687ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:55.564048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392ba47-d727-4d96-82ba-6a26e3687ec8 admin admin] PATH_INFO: `/v3/projects/6e9a2b1bd3fc419895e4acb3771be429` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:55.565185 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392ba47-d727-4d96-82ba-6a26e3687ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9a2b1bd3fc419895e4acb3771be429)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:55.567357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392ba47-d727-4d96-82ba-6a26e3687ec8 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:55.574697 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6695676-4bee-47da-9523-e185112b2288 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:55.582420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32e460-2a9e-4e34-be90-3e1d335fc2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:55.583165 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32e460-2a9e-4e34-be90-3e1d335fc2e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:55.584071 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32e460-2a9e-4e34-be90-3e1d335fc2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:55.584502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32e460-2a9e-4e34-be90-3e1d335fc2e1 admin admin] PATH_INFO: `/v3/projects/1906c0e50457418fb5d960d6cc879a63/users/f8e8986077964447b68e33530f89fac6/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:55.587173 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32e460-2a9e-4e34-be90-3e1d335fc2e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1906c0e50457418fb5d960d6cc879a63, user_id=f8e8986077964447b68e33530f89fac6, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:55.592629 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32e460-2a9e-4e34-be90-3e1d335fc2e1 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:55.605895 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:55.627806 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1094/2170] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:55 2022] PUT /identity/v3/projects/1906c0e50457418fb5d960d6cc879a63/users/f8e8986077964447b68e33530f89fac6/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:55.635585 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e8740-2ee1-4822-bd45-266136de2b5d None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:55.636003 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e8740-2ee1-4822-bd45-266136de2b5d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:55.644958 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e8740-2ee1-4822-bd45-266136de2b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:55.668159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b392ba47-d727-4d96-82ba-6a26e3687ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9a2b1bd3fc419895e4acb3771be429', 'request_id': 'req-b392ba47-d727-4d96-82ba-6a26e3687ec8'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:55.673582 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-532e8740-2ee1-4822-bd45-266136de2b5d None None] MFA Rules not processed for user `f8e8986077964447b68e33530f89fac6`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:55.674834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-532e8740-2ee1-4822-bd45-266136de2b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:55.675340 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b392ba47-d727-4d96-82ba-6a26e3687ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9a2b1bd3fc419895e4acb3771be429', 'request_id': 'req-b392ba47-d727-4d96-82ba-6a26e3687ec8'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:55.688119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b392ba47-d727-4d96-82ba-6a26e3687ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9a2b1bd3fc419895e4acb3771be429', 'request_id': 'req-b392ba47-d727-4d96-82ba-6a26e3687ec8'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:55.704541 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b392ba47-d727-4d96-82ba-6a26e3687ec8 admin admin] The token cache is being invalidate because project 6e9a2b1bd3fc419895e4acb3771be429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:55.704899 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b392ba47-d727-4d96-82ba-6a26e3687ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:55.705500 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b392ba47-d727-4d96-82ba-6a26e3687ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:55.707623 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1077/2171] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:55 2022] DELETE /identity/v3/projects/6e9a2b1bd3fc419895e4acb3771be429 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:55.709069 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bb90a-5a99-4b3c-98f1-33ddeb06f0b1 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:55.709350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bb90a-5a99-4b3c-98f1-33ddeb06f0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:55.709623 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bb90a-5a99-4b3c-98f1-33ddeb06f0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:55.732358 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-834bb90a-5a99-4b3c-98f1-33ddeb06f0b1 None None] MFA Rules not processed for user `0cc5cb5e634240159b537db9e27ec51c`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:55.733620 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-834bb90a-5a99-4b3c-98f1-33ddeb06f0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:55.763584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1095/2172] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:55.764675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e8740-2ee1-4822-bd45-266136de2b5d None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:55.766325 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-532e8740-2ee1-4822-bd45-266136de2b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:55.802204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1078/2173] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:55.803349 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bb90a-5a99-4b3c-98f1-33ddeb06f0b1 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:55.805808 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-834bb90a-5a99-4b3c-98f1-33ddeb06f0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:55.866777 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e8740-2ee1-4822-bd45-266136de2b5d None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:55.873793 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8d4bd-96f3-416b-a18c-58827a79cb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:55.874501 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8d4bd-96f3-416b-a18c-58827a79cb09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:55.874783 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8d4bd-96f3-416b-a18c-58827a79cb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:55.875055 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8d4bd-96f3-416b-a18c-58827a79cb09 admin admin] PATH_INFO: `/v3/users/00ddc5d33f54420ca975d37d28c1b6ba` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:55.876270 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8d4bd-96f3-416b-a18c-58827a79cb09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00ddc5d33f54420ca975d37d28c1b6ba)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:55.880127 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8d4bd-96f3-416b-a18c-58827a79cb09 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:55.883353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bb90a-5a99-4b3c-98f1-33ddeb06f0b1 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:55.888171 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22c4b9-3a62-4a09-985f-73763b21e5bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:55.891490 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22c4b9-3a62-4a09-985f-73763b21e5bb service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:55.891490 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22c4b9-3a62-4a09-985f-73763b21e5bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:55.891490 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22c4b9-3a62-4a09-985f-73763b21e5bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:55.892288 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-7d22c4b9-3a62-4a09-985f-73763b21e5bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:55.929527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:55.961939 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4ba8d4bd-96f3-416b-a18c-58827a79cb09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00ddc5d33f54420ca975d37d28c1b6ba'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:55.962615 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4ba8d4bd-96f3-416b-a18c-58827a79cb09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00ddc5d33f54420ca975d37d28c1b6ba'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:55.966320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22c4b9-3a62-4a09-985f-73763b21e5bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:55.968133 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22c4b9-3a62-4a09-985f-73763b21e5bb service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:55.972655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4ba8d4bd-96f3-416b-a18c-58827a79cb09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00ddc5d33f54420ca975d37d28c1b6ba'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:55.980042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1079/2174] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:55.988173 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4ba8d4bd-96f3-416b-a18c-58827a79cb09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00ddc5d33f54420ca975d37d28c1b6ba'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:55.989072 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22c4b9-3a62-4a09-985f-73763b21e5bb service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:55.993726 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-7d22c4b9-3a62-4a09-985f-73763b21e5bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:55.996878 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4ba8d4bd-96f3-416b-a18c-58827a79cb09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00ddc5d33f54420ca975d37d28c1b6ba'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:56.003245 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1096/2175] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:55 2022] DELETE /identity/v3/users/00ddc5d33f54420ca975d37d28c1b6ba => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:56.017255 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22c4b9-3a62-4a09-985f-73763b21e5bb service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:56.024517 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:56.101046 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ededa69-66ab-44eb-885a-30b689f7a392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:56.101842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ededa69-66ab-44eb-885a-30b689f7a392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:56.102221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ededa69-66ab-44eb-885a-30b689f7a392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:56.102594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ededa69-66ab-44eb-885a-30b689f7a392 admin admin] PATH_INFO: `/v3/users/11325494a879498b943645ea442e7aeb` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:56.104686 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ededa69-66ab-44eb-885a-30b689f7a392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11325494a879498b943645ea442e7aeb)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:56.106552 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ededa69-66ab-44eb-885a-30b689f7a392 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:56.182110 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9ededa69-66ab-44eb-885a-30b689f7a392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11325494a879498b943645ea442e7aeb'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:56.183382 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9ededa69-66ab-44eb-885a-30b689f7a392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11325494a879498b943645ea442e7aeb'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:56.212092 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9ededa69-66ab-44eb-885a-30b689f7a392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11325494a879498b943645ea442e7aeb'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:56.223739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9ededa69-66ab-44eb-885a-30b689f7a392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11325494a879498b943645ea442e7aeb'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:56.239278 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9ededa69-66ab-44eb-885a-30b689f7a392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11325494a879498b943645ea442e7aeb'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:56.248716 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1080/2176] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:55 2022] DELETE /identity/v3/users/11325494a879498b943645ea442e7aeb => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:56.253839 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a6532-7956-4509-8db2-a23547fa2d4e None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:56.254373 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a6532-7956-4509-8db2-a23547fa2d4e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:56.254796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a6532-7956-4509-8db2-a23547fa2d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:56.282857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-142a6532-7956-4509-8db2-a23547fa2d4e None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:56.284314 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-142a6532-7956-4509-8db2-a23547fa2d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:56.370098 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1097/2177] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:56.380588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ededa69-66ab-44eb-885a-30b689f7a392 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:56.382242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-9ededa69-66ab-44eb-885a-30b689f7a392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:56.468459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ededa69-66ab-44eb-885a-30b689f7a392 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:56.472169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37532f37-d2bf-4854-bc9b-d23c9ba48b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:56.472809 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37532f37-d2bf-4854-bc9b-d23c9ba48b47 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:56.473085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37532f37-d2bf-4854-bc9b-d23c9ba48b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:56.473360 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37532f37-d2bf-4854-bc9b-d23c9ba48b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:56.483231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37532f37-d2bf-4854-bc9b-d23c9ba48b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:56.484891 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37532f37-d2bf-4854-bc9b-d23c9ba48b47 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:56.496278 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1081/2178] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:56.810598 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a6532-7956-4509-8db2-a23547fa2d4e None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:56.812168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-142a6532-7956-4509-8db2-a23547fa2d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:56.826432 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a6532-7956-4509-8db2-a23547fa2d4e None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:56.839753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26d9da-d31d-48dc-8b9d-2564ee961542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:56.841254 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26d9da-d31d-48dc-8b9d-2564ee961542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:56.841779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26d9da-d31d-48dc-8b9d-2564ee961542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:56.842281 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26d9da-d31d-48dc-8b9d-2564ee961542 admin admin] PATH_INFO: `/v3/projects/42249da8b2ed480595b36a861c402b4e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:56.844307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26d9da-d31d-48dc-8b9d-2564ee961542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42249da8b2ed480595b36a861c402b4e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:56.846612 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26d9da-d31d-48dc-8b9d-2564ee961542 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:56.859797 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37532f37-d2bf-4854-bc9b-d23c9ba48b47 service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:56.868191 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-37532f37-d2bf-4854-bc9b-d23c9ba48b47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:56.915604 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37532f37-d2bf-4854-bc9b-d23c9ba48b47 service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:56.932179 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250510a-4ec8-4373-95d5-861e01c005ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:56.933543 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250510a-4ec8-4373-95d5-861e01c005ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:56.933827 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250510a-4ec8-4373-95d5-861e01c005ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:56.934157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250510a-4ec8-4373-95d5-861e01c005ac admin admin] PATH_INFO: `/v3/projects/6355fef0863c41f1b72f368e121150d1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:56.935896 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250510a-4ec8-4373-95d5-861e01c005ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=6355fef0863c41f1b72f368e121150d1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:56.937977 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250510a-4ec8-4373-95d5-861e01c005ac admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:56.949535 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-3a26d9da-d31d-48dc-8b9d-2564ee961542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42249da8b2ed480595b36a861c402b4e', 'request_id': 'req-3a26d9da-d31d-48dc-8b9d-2564ee961542'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:56.971362 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-3a26d9da-d31d-48dc-8b9d-2564ee961542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42249da8b2ed480595b36a861c402b4e', 'request_id': 'req-3a26d9da-d31d-48dc-8b9d-2564ee961542'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:56.980441 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-3a26d9da-d31d-48dc-8b9d-2564ee961542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42249da8b2ed480595b36a861c402b4e', 'request_id': 'req-3a26d9da-d31d-48dc-8b9d-2564ee961542'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:57.002114 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:57.008028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-3a26d9da-d31d-48dc-8b9d-2564ee961542 admin admin] The token cache is being invalidate because project 42249da8b2ed480595b36a861c402b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:57.008669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-3a26d9da-d31d-48dc-8b9d-2564ee961542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:57.011322 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-3a26d9da-d31d-48dc-8b9d-2564ee961542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:57.015229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1098/2179] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:56 2022] DELETE /identity/v3/projects/42249da8b2ed480595b36a861c402b4e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:57.022639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a828d7-922e-4ce6-b0b4-f6a8c511d260 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:57.023428 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a828d7-922e-4ce6-b0b4-f6a8c511d260 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:57.024258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a828d7-922e-4ce6-b0b4-f6a8c511d260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:57.027300 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-1250510a-4ec8-4373-95d5-861e01c005ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6355fef0863c41f1b72f368e121150d1', 'request_id': 'req-1250510a-4ec8-4373-95d5-861e01c005ac'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:57.036274 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-1250510a-4ec8-4373-95d5-861e01c005ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6355fef0863c41f1b72f368e121150d1', 'request_id': 'req-1250510a-4ec8-4373-95d5-861e01c005ac'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:57.047758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-1250510a-4ec8-4373-95d5-861e01c005ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6355fef0863c41f1b72f368e121150d1', 'request_id': 'req-1250510a-4ec8-4373-95d5-861e01c005ac'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:57.064312 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-1250510a-4ec8-4373-95d5-861e01c005ac admin admin] The token cache is being invalidate because project 6355fef0863c41f1b72f368e121150d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:57.064683 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-1250510a-4ec8-4373-95d5-861e01c005ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:57.066333 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-1250510a-4ec8-4373-95d5-861e01c005ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:57.071373 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1082/2180] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:56 2022] DELETE /identity/v3/projects/6355fef0863c41f1b72f368e121150d1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:57.072414 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250510a-4ec8-4373-95d5-861e01c005ac admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:57.074793 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-1250510a-4ec8-4373-95d5-861e01c005ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:57.080360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c0a828d7-922e-4ce6-b0b4-f6a8c511d260 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:57.082534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c0a828d7-922e-4ce6-b0b4-f6a8c511d260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:57.124260 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:57.171341 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250510a-4ec8-4373-95d5-861e01c005ac admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:57.177223 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2014ed-8196-4eda-902a-881459926127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:57.178057 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2014ed-8196-4eda-902a-881459926127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:57.178490 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2014ed-8196-4eda-902a-881459926127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:57.178865 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2014ed-8196-4eda-902a-881459926127 admin admin] PATH_INFO: `/v3/users/152bc07314ed4be59ca2193cd868736a` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:57.180232 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2014ed-8196-4eda-902a-881459926127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=152bc07314ed4be59ca2193cd868736a)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:57.184035 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2014ed-8196-4eda-902a-881459926127 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:57.203879 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1099/2181] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:57.218741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe0159-f1ff-4dda-8033-149d79ba8bc6 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:57.219412 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe0159-f1ff-4dda-8033-149d79ba8bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:57.219921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe0159-f1ff-4dda-8033-149d79ba8bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:57.248497 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-0bbe0159-f1ff-4dda-8033-149d79ba8bc6 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:57.249410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9b2014ed-8196-4eda-902a-881459926127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '152bc07314ed4be59ca2193cd868736a'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:57.249716 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0bbe0159-f1ff-4dda-8033-149d79ba8bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:57.250512 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9b2014ed-8196-4eda-902a-881459926127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '152bc07314ed4be59ca2193cd868736a'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:57.260436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1100/2182] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:57.267094 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe0159-f1ff-4dda-8033-149d79ba8bc6 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:57.271905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9b2014ed-8196-4eda-902a-881459926127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '152bc07314ed4be59ca2193cd868736a'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:57.282725 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9b2014ed-8196-4eda-902a-881459926127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '152bc07314ed4be59ca2193cd868736a'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:57.289319 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe0159-f1ff-4dda-8033-149d79ba8bc6 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:57.299347 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9b2014ed-8196-4eda-902a-881459926127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '152bc07314ed4be59ca2193cd868736a'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:57.305124 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1c307-d441-419a-9056-c6a377e78d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:57.305761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1c307-d441-419a-9056-c6a377e78d87 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:57.306041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1c307-d441-419a-9056-c6a377e78d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:57.306310 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1c307-d441-419a-9056-c6a377e78d87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:57.307497 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1c307-d441-419a-9056-c6a377e78d87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:30:57.307972 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1c307-d441-419a-9056-c6a377e78d87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:57.309781 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1c307-d441-419a-9056-c6a377e78d87 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:57.315949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1083/2183] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:30:57 2022] DELETE /identity/v3/users/152bc07314ed4be59ca2193cd868736a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:57.334836 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1101/2184] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:30:57.343338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2014ed-8196-4eda-902a-881459926127 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:57.346435 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-9b2014ed-8196-4eda-902a-881459926127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:57.421585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:57.487254 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2014ed-8196-4eda-902a-881459926127 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:57.557351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a67a9c-cc34-4bac-9863-6cafbfbdefb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:57.560770 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a67a9c-cc34-4bac-9863-6cafbfbdefb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:57.561211 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a67a9c-cc34-4bac-9863-6cafbfbdefb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:57.561646 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a67a9c-cc34-4bac-9863-6cafbfbdefb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:57.563035 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a67a9c-cc34-4bac-9863-6cafbfbdefb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:57.565928 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a67a9c-cc34-4bac-9863-6cafbfbdefb3 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:57.611336 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1084/2185] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:30:57 2022] POST /identity/v3/projects => generated 375 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:57.619782 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1c307-d441-419a-9056-c6a377e78d87 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:57.628740 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1c307-d441-419a-9056-c6a377e78d87 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:57.714134 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6b386-d977-4f8e-8b29-2160466418ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:57.715203 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6b386-d977-4f8e-8b29-2160466418ec admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:57.715665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6b386-d977-4f8e-8b29-2160466418ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:57.716149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6b386-d977-4f8e-8b29-2160466418ec admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:57.717244 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6b386-d977-4f8e-8b29-2160466418ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:57.720969 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6b386-d977-4f8e-8b29-2160466418ec admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:57.742735 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a67a9c-cc34-4bac-9863-6cafbfbdefb3 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:57.745698 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-09a67a9c-cc34-4bac-9863-6cafbfbdefb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:57.760102 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1102/2186] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:30:57 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:30:57.762504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6b386-d977-4f8e-8b29-2160466418ec admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:57.781494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a67a9c-cc34-4bac-9863-6cafbfbdefb3 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:57.787450 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9abe9-2afb-4815-8cc1-60f3a4900b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:57.788280 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9abe9-2afb-4815-8cc1-60f3a4900b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:57.788544 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9abe9-2afb-4815-8cc1-60f3a4900b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:57.788811 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9abe9-2afb-4815-8cc1-60f3a4900b68 admin admin] PATH_INFO: `/v3/projects/0e5f2149b37e458ab8a0b29e7107c2d0` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:57.790503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9abe9-2afb-4815-8cc1-60f3a4900b68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e5f2149b37e458ab8a0b29e7107c2d0)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:57.793827 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9abe9-2afb-4815-8cc1-60f3a4900b68 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:57.797429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6b386-d977-4f8e-8b29-2160466418ec admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:57.803197 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd9266-85b4-4a43-bdf5-c579749ed9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:57.803911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd9266-85b4-4a43-bdf5-c579749ed9bf admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:57.804199 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd9266-85b4-4a43-bdf5-c579749ed9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:57.804508 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd9266-85b4-4a43-bdf5-c579749ed9bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:57.805349 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd9266-85b4-4a43-bdf5-c579749ed9bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:57.816148 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd9266-85b4-4a43-bdf5-c579749ed9bf admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:57.852542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1103/2187] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:30:57.854181 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd9266-85b4-4a43-bdf5-c579749ed9bf admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:57.856029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-33fd9266-85b4-4a43-bdf5-c579749ed9bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:57.863519 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9bd9abe9-2afb-4815-8cc1-60f3a4900b68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e5f2149b37e458ab8a0b29e7107c2d0', 'request_id': 'req-9bd9abe9-2afb-4815-8cc1-60f3a4900b68'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:57.873687 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9bd9abe9-2afb-4815-8cc1-60f3a4900b68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e5f2149b37e458ab8a0b29e7107c2d0', 'request_id': 'req-9bd9abe9-2afb-4815-8cc1-60f3a4900b68'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:57.890352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9bd9abe9-2afb-4815-8cc1-60f3a4900b68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e5f2149b37e458ab8a0b29e7107c2d0', 'request_id': 'req-9bd9abe9-2afb-4815-8cc1-60f3a4900b68'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:57.921651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9bd9abe9-2afb-4815-8cc1-60f3a4900b68 admin admin] The token cache is being invalidate because project 0e5f2149b37e458ab8a0b29e7107c2d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:30:57.924183 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9bd9abe9-2afb-4815-8cc1-60f3a4900b68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:57.927211 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9bd9abe9-2afb-4815-8cc1-60f3a4900b68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:30:57.930986 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1085/2188] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:30:57 2022] DELETE /identity/v3/projects/0e5f2149b37e458ab8a0b29e7107c2d0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:57.935763 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9abe9-2afb-4815-8cc1-60f3a4900b68 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:57.945695 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-9bd9abe9-2afb-4815-8cc1-60f3a4900b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:58.048173 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd9266-85b4-4a43-bdf5-c579749ed9bf admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:58.126389 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9abe9-2afb-4815-8cc1-60f3a4900b68 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:58.139180 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556f316-c75f-41d4-8480-4daccf20dc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:58.140009 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556f316-c75f-41d4-8480-4daccf20dc86 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:58.140345 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556f316-c75f-41d4-8480-4daccf20dc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:58.140622 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556f316-c75f-41d4-8480-4daccf20dc86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:58.141299 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556f316-c75f-41d4-8480-4daccf20dc86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:58.142966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556f316-c75f-41d4-8480-4daccf20dc86 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:58.164726 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:58.167229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1086/2189] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:30:58.171912 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556f316-c75f-41d4-8480-4daccf20dc86 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:58.189927 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e6f05-dc07-46a7-9746-cf5a5f14690e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:58.190861 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e6f05-dc07-46a7-9746-cf5a5f14690e service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:58.191002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556f316-c75f-41d4-8480-4daccf20dc86 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:58.191474 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e6f05-dc07-46a7-9746-cf5a5f14690e service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:58.191693 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e6f05-dc07-46a7-9746-cf5a5f14690e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:58.199173 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f93e6f05-dc07-46a7-9746-cf5a5f14690e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:58.203169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bface05-b634-4921-8076-20f90215a79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:58.203960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bface05-b634-4921-8076-20f90215a79f admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:58.204514 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bface05-b634-4921-8076-20f90215a79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:58.204869 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bface05-b634-4921-8076-20f90215a79f admin admin] PATH_INFO: `/v3/projects/ef1edfba4e6a459a8892a5457b6b5c13/users/cc43e930a6ca4e969c1d3bce095dcac6/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:58.231087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bface05-b634-4921-8076-20f90215a79f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1edfba4e6a459a8892a5457b6b5c13, user_id=cc43e930a6ca4e969c1d3bce095dcac6, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:58.231087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bface05-b634-4921-8076-20f90215a79f admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:58.252446 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1087/2190] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:30:58 2022] PUT /identity/v3/projects/ef1edfba4e6a459a8892a5457b6b5c13/users/cc43e930a6ca4e969c1d3bce095dcac6/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:30:58.270996 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9e273-fa2d-45f7-a60b-48a372519dcf None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:58.271406 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9e273-fa2d-45f7-a60b-48a372519dcf None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:58.271811 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9e273-fa2d-45f7-a60b-48a372519dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:58.325965 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:58.336168 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-4ce9e273-fa2d-45f7-a60b-48a372519dcf None None] MFA Rules not processed for user `cc43e930a6ca4e969c1d3bce095dcac6`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:30:58.338482 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-4ce9e273-fa2d-45f7-a60b-48a372519dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:58.340339 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e6f05-dc07-46a7-9746-cf5a5f14690e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:58.342451 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e6f05-dc07-46a7-9746-cf5a5f14690e service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:58.367832 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1104/2191] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:58.450394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1088/2192] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:30:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:30:58.458718 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e6f05-dc07-46a7-9746-cf5a5f14690e service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:58.460246 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f93e6f05-dc07-46a7-9746-cf5a5f14690e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:58.475497 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e6f05-dc07-46a7-9746-cf5a5f14690e service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:58.559273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b17e84-8e55-400a-b72d-c294539c35eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:58.560079 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b17e84-8e55-400a-b72d-c294539c35eb service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:58.560443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b17e84-8e55-400a-b72d-c294539c35eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:58.560793 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b17e84-8e55-400a-b72d-c294539c35eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:58.571734 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b17e84-8e55-400a-b72d-c294539c35eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:58.574102 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b17e84-8e55-400a-b72d-c294539c35eb service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:58.589639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1105/2193] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:30:59.198828 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9e273-fa2d-45f7-a60b-48a372519dcf None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:30:59.212050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9e273-fa2d-45f7-a60b-48a372519dcf None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:30:59.217869 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60710de-c5a7-462e-898e-f8250098e979 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:30:59.218513 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60710de-c5a7-462e-898e-f8250098e979 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:30:59.218792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60710de-c5a7-462e-898e-f8250098e979 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:30:59.219063 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60710de-c5a7-462e-898e-f8250098e979 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:30:59.221525 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b60710de-c5a7-462e-898e-f8250098e979 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:30:59.352545 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60710de-c5a7-462e-898e-f8250098e979 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:30:59.358112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60710de-c5a7-462e-898e-f8250098e979 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:30:59.371085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1089/2194] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:30:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:31:00.171610 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0321a0-b4a1-4bb0-a65e-1bc7aa744611 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:00.172476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0321a0-b4a1-4bb0-a65e-1bc7aa744611 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:00.172476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0321a0-b4a1-4bb0-a65e-1bc7aa744611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:00.195484 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-af0321a0-b4a1-4bb0-a65e-1bc7aa744611 None None] MFA Rules not processed for user `cc43e930a6ca4e969c1d3bce095dcac6`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:00.196872 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-af0321a0-b4a1-4bb0-a65e-1bc7aa744611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:00.205498 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1106/2195] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:31:00.611053 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbae07-5263-4406-9180-80091ed4325c None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:00.611545 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbae07-5263-4406-9180-80091ed4325c None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:00.611647 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbae07-5263-4406-9180-80091ed4325c None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:00.613267 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1090/2196] 10.222.0.62 () {54 vars in 921 bytes} [Tue Oct 4 14:31:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:31:00.653745 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598d99a-5e2a-4059-9ca5-232a4a930e1c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:00.653745 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598d99a-5e2a-4059-9ca5-232a4a930e1c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:00.654087 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598d99a-5e2a-4059-9ca5-232a4a930e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:00.700330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbae07-5263-4406-9180-80091ed4325c None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:00.702283 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-82cbae07-5263-4406-9180-80091ed4325c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:00.704857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-8598d99a-5e2a-4059-9ca5-232a4a930e1c None None] MFA Rules not processed for user `6f98c07455a241398784d221df273aba`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:00.706550 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8598d99a-5e2a-4059-9ca5-232a4a930e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:00.829549 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1107/2197] 10.222.0.62 () {58 vars in 1018 bytes} [Tue Oct 4 14:31:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:31:00.847298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbae07-5263-4406-9180-80091ed4325c None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:00.848417 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598d99a-5e2a-4059-9ca5-232a4a930e1c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:00.850808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8598d99a-5e2a-4059-9ca5-232a4a930e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:00.852810 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c649f-540a-44ad-abf7-72b4965cc7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:00.854010 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c649f-540a-44ad-abf7-72b4965cc7da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:00.854481 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c649f-540a-44ad-abf7-72b4965cc7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:00.854715 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c649f-540a-44ad-abf7-72b4965cc7da admin admin] PATH_INFO: `/v3/users/61af523e48ec4687918b3f3f19490577` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:00.856022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c649f-540a-44ad-abf7-72b4965cc7da admin admin] RBAC: Authorizing `identity:delete_user(user_id=61af523e48ec4687918b3f3f19490577)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:00.858163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c649f-540a-44ad-abf7-72b4965cc7da admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:00.874837 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598d99a-5e2a-4059-9ca5-232a4a930e1c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:00.880526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c98bc-d30f-4610-9cb3-4d5ff375b388 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f98c07455a241398784d221df273aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:00.881150 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c98bc-d30f-4610-9cb3-4d5ff375b388 service placement] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:00.881439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c98bc-d30f-4610-9cb3-4d5ff375b388 service placement] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:00.881750 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c98bc-d30f-4610-9cb3-4d5ff375b388 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:00.898585 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c98bc-d30f-4610-9cb3-4d5ff375b388 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:00.901564 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c98bc-d30f-4610-9cb3-4d5ff375b388 service placement] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:00.927943 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:00.930184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1108/2198] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:31:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:31:00.953798 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-522c649f-540a-44ad-abf7-72b4965cc7da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61af523e48ec4687918b3f3f19490577'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:00.957839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-522c649f-540a-44ad-abf7-72b4965cc7da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61af523e48ec4687918b3f3f19490577'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:00.986871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-522c649f-540a-44ad-abf7-72b4965cc7da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61af523e48ec4687918b3f3f19490577'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:01.000028 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-522c649f-540a-44ad-abf7-72b4965cc7da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61af523e48ec4687918b3f3f19490577'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:01.012573 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-522c649f-540a-44ad-abf7-72b4965cc7da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61af523e48ec4687918b3f3f19490577'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:01.023821 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1091/2199] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:31:00 2022] DELETE /identity/v3/users/61af523e48ec4687918b3f3f19490577 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:01.282379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c98bc-d30f-4610-9cb3-4d5ff375b388 service placement] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:01.298297 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c98bc-d30f-4610-9cb3-4d5ff375b388 service placement] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:01.313536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:01.375669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bb2b1-ff81-4b1d-9152-28c4a352cb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:01.376634 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bb2b1-ff81-4b1d-9152-28c4a352cb87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:01.376978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bb2b1-ff81-4b1d-9152-28c4a352cb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:01.377450 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bb2b1-ff81-4b1d-9152-28c4a352cb87 admin admin] PATH_INFO: `/v3/projects/ff1d781a0f0146da87d2370eba6c3599` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:01.378605 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bb2b1-ff81-4b1d-9152-28c4a352cb87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff1d781a0f0146da87d2370eba6c3599)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:01.380824 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bb2b1-ff81-4b1d-9152-28c4a352cb87 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:01.468884 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-db0bb2b1-ff81-4b1d-9152-28c4a352cb87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1d781a0f0146da87d2370eba6c3599', 'request_id': 'req-db0bb2b1-ff81-4b1d-9152-28c4a352cb87'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:01.475431 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-db0bb2b1-ff81-4b1d-9152-28c4a352cb87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1d781a0f0146da87d2370eba6c3599', 'request_id': 'req-db0bb2b1-ff81-4b1d-9152-28c4a352cb87'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:01.484727 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-db0bb2b1-ff81-4b1d-9152-28c4a352cb87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1d781a0f0146da87d2370eba6c3599', 'request_id': 'req-db0bb2b1-ff81-4b1d-9152-28c4a352cb87'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:01.499949 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-db0bb2b1-ff81-4b1d-9152-28c4a352cb87 admin admin] The token cache is being invalidate because project ff1d781a0f0146da87d2370eba6c3599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:31:01.500283 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-db0bb2b1-ff81-4b1d-9152-28c4a352cb87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:01.500957 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-db0bb2b1-ff81-4b1d-9152-28c4a352cb87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:01.506602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1109/2200] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:31:01 2022] DELETE /identity/v3/projects/ff1d781a0f0146da87d2370eba6c3599 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:01.507996 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54289c0c-fc61-4f35-b6c5-c308a8f6d22e None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:01.508287 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54289c0c-fc61-4f35-b6c5-c308a8f6d22e None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:01.508560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54289c0c-fc61-4f35-b6c5-c308a8f6d22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:01.537158 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-54289c0c-fc61-4f35-b6c5-c308a8f6d22e None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:01.538656 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-54289c0c-fc61-4f35-b6c5-c308a8f6d22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:01.628937 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1092/2201] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:01.636694 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2f7ab-9baf-4bf7-b79a-c880de1cba3b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:01.636929 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2f7ab-9baf-4bf7-b79a-c880de1cba3b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:01.637163 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2f7ab-9baf-4bf7-b79a-c880de1cba3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:01.658927 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-31c2f7ab-9baf-4bf7-b79a-c880de1cba3b None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:01.660024 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-31c2f7ab-9baf-4bf7-b79a-c880de1cba3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:01.669454 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1110/2202] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:01.674701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54289c0c-fc61-4f35-b6c5-c308a8f6d22e None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:01.686593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54289c0c-fc61-4f35-b6c5-c308a8f6d22e None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:01.692731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93d082-34f7-4395-9efd-501fcf00e3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:01.693124 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93d082-34f7-4395-9efd-501fcf00e3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:01.693397 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93d082-34f7-4395-9efd-501fcf00e3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:01.693755 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93d082-34f7-4395-9efd-501fcf00e3b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:01.694418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93d082-34f7-4395-9efd-501fcf00e3b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:31:01.694613 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93d082-34f7-4395-9efd-501fcf00e3b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:01.696325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93d082-34f7-4395-9efd-501fcf00e3b6 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:01.711594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1093/2203] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:31:01.716727 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2f7ab-9baf-4bf7-b79a-c880de1cba3b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:01.730182 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2f7ab-9baf-4bf7-b79a-c880de1cba3b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:01.736449 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5b7ab-41f3-42a7-969f-a2ce0fec3de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:01.737123 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5b7ab-41f3-42a7-969f-a2ce0fec3de5 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:01.737409 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5b7ab-41f3-42a7-969f-a2ce0fec3de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:01.737685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5b7ab-41f3-42a7-969f-a2ce0fec3de5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:01.738368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5b7ab-41f3-42a7-969f-a2ce0fec3de5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:01.741369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5b7ab-41f3-42a7-969f-a2ce0fec3de5 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:01.776205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1111/2204] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:31:01 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:31:01.780619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93d082-34f7-4395-9efd-501fcf00e3b6 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:01.800957 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93d082-34f7-4395-9efd-501fcf00e3b6 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:01.872482 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bcdb3-a569-427d-8deb-68e51163d768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:01.873621 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bcdb3-a569-427d-8deb-68e51163d768 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:01.873621 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bcdb3-a569-427d-8deb-68e51163d768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:01.873848 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bcdb3-a569-427d-8deb-68e51163d768 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:01.874398 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bcdb3-a569-427d-8deb-68e51163d768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:01.876837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bcdb3-a569-427d-8deb-68e51163d768 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:01.902683 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1094/2205] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:31:01 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:31:01.906456 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5b7ab-41f3-42a7-969f-a2ce0fec3de5 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:01.917868 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5b7ab-41f3-42a7-969f-a2ce0fec3de5 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:01.924068 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31a6f3-aae4-4199-aab3-6a9f3b441b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:01.924695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31a6f3-aae4-4199-aab3-6a9f3b441b6b admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:01.925112 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31a6f3-aae4-4199-aab3-6a9f3b441b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:01.925391 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31a6f3-aae4-4199-aab3-6a9f3b441b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:01.926039 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31a6f3-aae4-4199-aab3-6a9f3b441b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:01.927634 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31a6f3-aae4-4199-aab3-6a9f3b441b6b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:01.941358 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1112/2206] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:31:01.942786 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bcdb3-a569-427d-8deb-68e51163d768 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:01.953968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bcdb3-a569-427d-8deb-68e51163d768 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:01.958741 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871f7d7-1ebb-4517-baac-0125f1550ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:01.959339 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871f7d7-1ebb-4517-baac-0125f1550ace admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:01.959613 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871f7d7-1ebb-4517-baac-0125f1550ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:01.960006 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871f7d7-1ebb-4517-baac-0125f1550ace admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:01.960800 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871f7d7-1ebb-4517-baac-0125f1550ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:01.962409 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871f7d7-1ebb-4517-baac-0125f1550ace admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:01.977027 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1095/2207] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:31:01.982312 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31a6f3-aae4-4199-aab3-6a9f3b441b6b admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:01.995869 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31a6f3-aae4-4199-aab3-6a9f3b441b6b admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:02.001315 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1dc9f-622e-49c4-970c-a68b6d4af5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:02.002217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1dc9f-622e-49c4-970c-a68b6d4af5b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:02.002750 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1dc9f-622e-49c4-970c-a68b6d4af5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:02.003113 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1dc9f-622e-49c4-970c-a68b6d4af5b8 admin admin] PATH_INFO: `/v3/projects/196c8659ad454057b90315d40374f61d/users/663b625456394f10a3dcff14e5d23699/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:02.027331 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1dc9f-622e-49c4-970c-a68b6d4af5b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=196c8659ad454057b90315d40374f61d, user_id=663b625456394f10a3dcff14e5d23699, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:02.030269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1dc9f-622e-49c4-970c-a68b6d4af5b8 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:02.060049 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1113/2208] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:31:01 2022] PUT /identity/v3/projects/196c8659ad454057b90315d40374f61d/users/663b625456394f10a3dcff14e5d23699/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:31:02.074708 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75804df-5910-4475-bba6-158ce6b82b26 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:02.075569 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75804df-5910-4475-bba6-158ce6b82b26 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:02.075952 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75804df-5910-4475-bba6-158ce6b82b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:02.130085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-e75804df-5910-4475-bba6-158ce6b82b26 None None] MFA Rules not processed for user `663b625456394f10a3dcff14e5d23699`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:02.133444 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e75804df-5910-4475-bba6-158ce6b82b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:02.154279 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:02.241668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1096/2209] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:02.253539 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1dc9f-622e-49c4-970c-a68b6d4af5b8 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:02.255484 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-dcd1dc9f-622e-49c4-970c-a68b6d4af5b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:02.318894 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:02.360213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1dc9f-622e-49c4-970c-a68b6d4af5b8 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:02.378568 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272543e2-3e8e-4475-a89d-0bdd7333031a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:02.385040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272543e2-3e8e-4475-a89d-0bdd7333031a service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:02.385557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272543e2-3e8e-4475-a89d-0bdd7333031a service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:02.386323 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272543e2-3e8e-4475-a89d-0bdd7333031a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:02.395484 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272543e2-3e8e-4475-a89d-0bdd7333031a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:02.399852 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272543e2-3e8e-4475-a89d-0bdd7333031a service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:02.410076 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1114/2210] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:31:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:31:03.604978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75804df-5910-4475-bba6-158ce6b82b26 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:03.606513 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e75804df-5910-4475-bba6-158ce6b82b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:03.677268 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75804df-5910-4475-bba6-158ce6b82b26 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:03.682637 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3052e5-5a3b-43ae-b43e-faaf79a9bcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:03.683432 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3052e5-5a3b-43ae-b43e-faaf79a9bcfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:03.683781 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3052e5-5a3b-43ae-b43e-faaf79a9bcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:03.684054 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3052e5-5a3b-43ae-b43e-faaf79a9bcfc admin admin] PATH_INFO: `/v3/users/f1d53447f030413da4992add26ce2ede` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:03.685191 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3052e5-5a3b-43ae-b43e-faaf79a9bcfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d53447f030413da4992add26ce2ede)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:03.687123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3052e5-5a3b-43ae-b43e-faaf79a9bcfc admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:03.736147 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ee3052e5-5a3b-43ae-b43e-faaf79a9bcfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d53447f030413da4992add26ce2ede'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:03.736835 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ee3052e5-5a3b-43ae-b43e-faaf79a9bcfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d53447f030413da4992add26ce2ede'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:03.750168 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ee3052e5-5a3b-43ae-b43e-faaf79a9bcfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d53447f030413da4992add26ce2ede'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:03.757843 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ee3052e5-5a3b-43ae-b43e-faaf79a9bcfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d53447f030413da4992add26ce2ede'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:03.766289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ee3052e5-5a3b-43ae-b43e-faaf79a9bcfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d53447f030413da4992add26ce2ede'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:03.772270 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1097/2211] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:31:03 2022] DELETE /identity/v3/users/f1d53447f030413da4992add26ce2ede => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:03.777054 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c70fd-4de4-49c9-b76b-4454863fe2d7 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:03.777520 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c70fd-4de4-49c9-b76b-4454863fe2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:03.777644 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c70fd-4de4-49c9-b76b-4454863fe2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:03.797755 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-762c70fd-4de4-49c9-b76b-4454863fe2d7 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:03.799109 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-762c70fd-4de4-49c9-b76b-4454863fe2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:03.862165 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1115/2212] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:03.887190 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3052e5-5a3b-43ae-b43e-faaf79a9bcfc admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:03.888644 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-ee3052e5-5a3b-43ae-b43e-faaf79a9bcfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:03.929731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:03.961638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3052e5-5a3b-43ae-b43e-faaf79a9bcfc admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:03.971401 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b062d77-8604-41e7-a76a-e2bc0d40de6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:03.972138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b062d77-8604-41e7-a76a-e2bc0d40de6b service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:03.972473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b062d77-8604-41e7-a76a-e2bc0d40de6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:03.972895 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b062d77-8604-41e7-a76a-e2bc0d40de6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:03.983473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b062d77-8604-41e7-a76a-e2bc0d40de6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:03.985038 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b062d77-8604-41e7-a76a-e2bc0d40de6b service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:03.995602 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1098/2213] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:31:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:31:04.292627 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c70fd-4de4-49c9-b76b-4454863fe2d7 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:04.294455 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-762c70fd-4de4-49c9-b76b-4454863fe2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:04.308645 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c70fd-4de4-49c9-b76b-4454863fe2d7 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:04.313552 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d390c6-9259-4479-8cbf-1d3a4da59a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:04.314201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d390c6-9259-4479-8cbf-1d3a4da59a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:04.314477 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d390c6-9259-4479-8cbf-1d3a4da59a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:04.314920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d390c6-9259-4479-8cbf-1d3a4da59a58 admin admin] PATH_INFO: `/v3/projects/ea4200236c9a4fa7be2ee5545d1e56e2` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:04.316352 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d390c6-9259-4479-8cbf-1d3a4da59a58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea4200236c9a4fa7be2ee5545d1e56e2)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:04.319185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d390c6-9259-4479-8cbf-1d3a4da59a58 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:04.367385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-97d390c6-9259-4479-8cbf-1d3a4da59a58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea4200236c9a4fa7be2ee5545d1e56e2', 'request_id': 'req-97d390c6-9259-4479-8cbf-1d3a4da59a58'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:04.372942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-97d390c6-9259-4479-8cbf-1d3a4da59a58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea4200236c9a4fa7be2ee5545d1e56e2', 'request_id': 'req-97d390c6-9259-4479-8cbf-1d3a4da59a58'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:04.379028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-97d390c6-9259-4479-8cbf-1d3a4da59a58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea4200236c9a4fa7be2ee5545d1e56e2', 'request_id': 'req-97d390c6-9259-4479-8cbf-1d3a4da59a58'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:04.394676 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-97d390c6-9259-4479-8cbf-1d3a4da59a58 admin admin] The token cache is being invalidate because project ea4200236c9a4fa7be2ee5545d1e56e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:31:04.394971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-97d390c6-9259-4479-8cbf-1d3a4da59a58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:04.395615 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-97d390c6-9259-4479-8cbf-1d3a4da59a58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:04.398213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1116/2214] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:31:04 2022] DELETE /identity/v3/projects/ea4200236c9a4fa7be2ee5545d1e56e2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:04.403362 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b062d77-8604-41e7-a76a-e2bc0d40de6b service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:04.413370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b062d77-8604-41e7-a76a-e2bc0d40de6b service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:04.470753 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ec08e-9339-4c8c-a0ef-0ebc83d5d230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:04.471393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ec08e-9339-4c8c-a0ef-0ebc83d5d230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:04.471667 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ec08e-9339-4c8c-a0ef-0ebc83d5d230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:04.471977 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ec08e-9339-4c8c-a0ef-0ebc83d5d230 admin admin] PATH_INFO: `/v3/users/90f4b22d73c64c62a42745d15ea47a77` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:04.473097 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ec08e-9339-4c8c-a0ef-0ebc83d5d230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90f4b22d73c64c62a42745d15ea47a77)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:04.475026 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ec08e-9339-4c8c-a0ef-0ebc83d5d230 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:04.528588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-663ec08e-9339-4c8c-a0ef-0ebc83d5d230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90f4b22d73c64c62a42745d15ea47a77'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:04.529274 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-663ec08e-9339-4c8c-a0ef-0ebc83d5d230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90f4b22d73c64c62a42745d15ea47a77'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:04.541791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-663ec08e-9339-4c8c-a0ef-0ebc83d5d230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90f4b22d73c64c62a42745d15ea47a77'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:04.549811 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-663ec08e-9339-4c8c-a0ef-0ebc83d5d230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90f4b22d73c64c62a42745d15ea47a77'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:04.557447 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-663ec08e-9339-4c8c-a0ef-0ebc83d5d230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90f4b22d73c64c62a42745d15ea47a77'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:04.563480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1099/2215] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:31:04 2022] DELETE /identity/v3/users/90f4b22d73c64c62a42745d15ea47a77 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:04.893647 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d390c6-9259-4479-8cbf-1d3a4da59a58 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:04.894570 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-97d390c6-9259-4479-8cbf-1d3a4da59a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:04.910967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d390c6-9259-4479-8cbf-1d3a4da59a58 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:04.958630 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:04.973337 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff6ec3-a0ea-4baf-889f-ca5c33a0d43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:04.973970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff6ec3-a0ea-4baf-889f-ca5c33a0d43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:04.974240 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff6ec3-a0ea-4baf-889f-ca5c33a0d43c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:04.974506 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff6ec3-a0ea-4baf-889f-ca5c33a0d43c admin admin] PATH_INFO: `/v3/projects/4783a1d24f174fed93b974e981e7d5d6` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:04.975840 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff6ec3-a0ea-4baf-889f-ca5c33a0d43c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4783a1d24f174fed93b974e981e7d5d6)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:04.977591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff6ec3-a0ea-4baf-889f-ca5c33a0d43c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:05.027548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-91ff6ec3-a0ea-4baf-889f-ca5c33a0d43c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4783a1d24f174fed93b974e981e7d5d6', 'request_id': 'req-91ff6ec3-a0ea-4baf-889f-ca5c33a0d43c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:05.034657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-91ff6ec3-a0ea-4baf-889f-ca5c33a0d43c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4783a1d24f174fed93b974e981e7d5d6', 'request_id': 'req-91ff6ec3-a0ea-4baf-889f-ca5c33a0d43c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:05.048221 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-91ff6ec3-a0ea-4baf-889f-ca5c33a0d43c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4783a1d24f174fed93b974e981e7d5d6', 'request_id': 'req-91ff6ec3-a0ea-4baf-889f-ca5c33a0d43c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:05.070052 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-91ff6ec3-a0ea-4baf-889f-ca5c33a0d43c admin admin] The token cache is being invalidate because project 4783a1d24f174fed93b974e981e7d5d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:31:05.070349 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-91ff6ec3-a0ea-4baf-889f-ca5c33a0d43c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:05.071034 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-91ff6ec3-a0ea-4baf-889f-ca5c33a0d43c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:05.073469 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1117/2216] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:31:04 2022] DELETE /identity/v3/projects/4783a1d24f174fed93b974e981e7d5d6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:05.077374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ec08e-9339-4c8c-a0ef-0ebc83d5d230 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:05.078912 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-663ec08e-9339-4c8c-a0ef-0ebc83d5d230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:05.094708 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ec08e-9339-4c8c-a0ef-0ebc83d5d230 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:05.173250 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:05.192034 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d3e18-dbd5-4378-9411-cace9ebb4e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:05.194093 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d3e18-dbd5-4378-9411-cace9ebb4e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:05.194502 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d3e18-dbd5-4378-9411-cace9ebb4e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:05.194893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d3e18-dbd5-4378-9411-cace9ebb4e01 admin admin] PATH_INFO: `/v3/users/f8e8986077964447b68e33530f89fac6` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:05.196198 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d3e18-dbd5-4378-9411-cace9ebb4e01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8e8986077964447b68e33530f89fac6)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:05.198292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d3e18-dbd5-4378-9411-cace9ebb4e01 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:05.253069 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-447d3e18-dbd5-4378-9411-cace9ebb4e01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8e8986077964447b68e33530f89fac6'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:05.253716 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-447d3e18-dbd5-4378-9411-cace9ebb4e01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8e8986077964447b68e33530f89fac6'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:05.266619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-447d3e18-dbd5-4378-9411-cace9ebb4e01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8e8986077964447b68e33530f89fac6'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:05.274915 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-447d3e18-dbd5-4378-9411-cace9ebb4e01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8e8986077964447b68e33530f89fac6'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:05.283230 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-447d3e18-dbd5-4378-9411-cace9ebb4e01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8e8986077964447b68e33530f89fac6'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:05.289410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1100/2217] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:31:05 2022] DELETE /identity/v3/users/f8e8986077964447b68e33530f89fac6 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:05.611644 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff6ec3-a0ea-4baf-889f-ca5c33a0d43c admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:05.613101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-91ff6ec3-a0ea-4baf-889f-ca5c33a0d43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:05.627321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff6ec3-a0ea-4baf-889f-ca5c33a0d43c admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:05.686806 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b9f69-7ef8-4d79-a19d-bd1061bcb144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:05.687359 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b9f69-7ef8-4d79-a19d-bd1061bcb144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:05.687634 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b9f69-7ef8-4d79-a19d-bd1061bcb144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:05.687932 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b9f69-7ef8-4d79-a19d-bd1061bcb144 admin admin] PATH_INFO: `/v3/projects/1906c0e50457418fb5d960d6cc879a63` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:05.689127 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b9f69-7ef8-4d79-a19d-bd1061bcb144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1906c0e50457418fb5d960d6cc879a63)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:05.691199 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b9f69-7ef8-4d79-a19d-bd1061bcb144 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:05.739310 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-eb8b9f69-7ef8-4d79-a19d-bd1061bcb144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1906c0e50457418fb5d960d6cc879a63', 'request_id': 'req-eb8b9f69-7ef8-4d79-a19d-bd1061bcb144'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:05.745671 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-eb8b9f69-7ef8-4d79-a19d-bd1061bcb144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1906c0e50457418fb5d960d6cc879a63', 'request_id': 'req-eb8b9f69-7ef8-4d79-a19d-bd1061bcb144'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:05.751883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-eb8b9f69-7ef8-4d79-a19d-bd1061bcb144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1906c0e50457418fb5d960d6cc879a63', 'request_id': 'req-eb8b9f69-7ef8-4d79-a19d-bd1061bcb144'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:05.765995 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-eb8b9f69-7ef8-4d79-a19d-bd1061bcb144 admin admin] The token cache is being invalidate because project 1906c0e50457418fb5d960d6cc879a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:31:05.766279 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-eb8b9f69-7ef8-4d79-a19d-bd1061bcb144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:05.766903 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-eb8b9f69-7ef8-4d79-a19d-bd1061bcb144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:05.768453 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1118/2218] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:31:05 2022] DELETE /identity/v3/projects/1906c0e50457418fb5d960d6cc879a63 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:05.773396 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7c951-91d5-481f-90a2-82475ee3295a None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:05.773685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7c951-91d5-481f-90a2-82475ee3295a None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:05.773962 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7c951-91d5-481f-90a2-82475ee3295a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:05.796877 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-8dd7c951-91d5-481f-90a2-82475ee3295a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:05.798093 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-8dd7c951-91d5-481f-90a2-82475ee3295a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:05.874259 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1101/2219] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:05.875776 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d2a2c-6727-4de3-9773-8aa5821fe9e7 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:05.876063 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d2a2c-6727-4de3-9773-8aa5821fe9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:05.877647 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d2a2c-6727-4de3-9773-8aa5821fe9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:05.902413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:05.911654 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-988d2a2c-6727-4de3-9773-8aa5821fe9e7 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:05.913550 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-988d2a2c-6727-4de3-9773-8aa5821fe9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:05.924402 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1119/2220] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:05.928782 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7c951-91d5-481f-90a2-82475ee3295a None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:05.951119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7c951-91d5-481f-90a2-82475ee3295a None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:05.956446 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc2e11-de7c-49d6-890b-7a6d9a1cd4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:05.957299 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc2e11-de7c-49d6-890b-7a6d9a1cd4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:05.957664 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc2e11-de7c-49d6-890b-7a6d9a1cd4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:05.957999 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc2e11-de7c-49d6-890b-7a6d9a1cd4d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:05.958919 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc2e11-de7c-49d6-890b-7a6d9a1cd4d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:31:05.959452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc2e11-de7c-49d6-890b-7a6d9a1cd4d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:05.961505 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc2e11-de7c-49d6-890b-7a6d9a1cd4d4 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:05.985571 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1102/2221] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:31:05.987614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d2a2c-6727-4de3-9773-8aa5821fe9e7 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:06.000424 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d2a2c-6727-4de3-9773-8aa5821fe9e7 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:06.006724 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c974e5-1a59-42c7-b482-2e18b5ac1de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:06.007512 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c974e5-1a59-42c7-b482-2e18b5ac1de3 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:06.007923 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c974e5-1a59-42c7-b482-2e18b5ac1de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:06.008434 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c974e5-1a59-42c7-b482-2e18b5ac1de3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:06.009832 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c974e5-1a59-42c7-b482-2e18b5ac1de3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:06.011424 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c974e5-1a59-42c7-b482-2e18b5ac1de3 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:06.047640 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1120/2222] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:31:05 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:31:06.048986 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc2e11-de7c-49d6-890b-7a6d9a1cd4d4 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:06.061127 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc2e11-de7c-49d6-890b-7a6d9a1cd4d4 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:06.140299 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba4b84-b711-4eaf-ba9a-05d622ebeee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:06.141475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba4b84-b711-4eaf-ba9a-05d622ebeee2 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:06.141475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba4b84-b711-4eaf-ba9a-05d622ebeee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:06.141770 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba4b84-b711-4eaf-ba9a-05d622ebeee2 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:06.148331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba4b84-b711-4eaf-ba9a-05d622ebeee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:06.152240 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba4b84-b711-4eaf-ba9a-05d622ebeee2 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:06.164035 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:06.195799 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1103/2223] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:31:06 2022] POST /identity/v3/users => generated 296 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:31:06.198584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c974e5-1a59-42c7-b482-2e18b5ac1de3 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:06.212258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c974e5-1a59-42c7-b482-2e18b5ac1de3 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:06.226631 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab65d5-b2bc-4d89-8a1d-085ae415a564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:06.227280 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab65d5-b2bc-4d89-8a1d-085ae415a564 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:06.227555 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab65d5-b2bc-4d89-8a1d-085ae415a564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:06.227849 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab65d5-b2bc-4d89-8a1d-085ae415a564 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:06.229080 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab65d5-b2bc-4d89-8a1d-085ae415a564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:06.233605 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab65d5-b2bc-4d89-8a1d-085ae415a564 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:06.256126 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1121/2224] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:31:06.260997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba4b84-b711-4eaf-ba9a-05d622ebeee2 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:06.272815 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba4b84-b711-4eaf-ba9a-05d622ebeee2 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:06.279413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb726ebd-6d06-4fdd-8140-57e9a6da782a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:06.280157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb726ebd-6d06-4fdd-8140-57e9a6da782a admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:06.280432 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb726ebd-6d06-4fdd-8140-57e9a6da782a admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:06.280705 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb726ebd-6d06-4fdd-8140-57e9a6da782a admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:06.281389 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb726ebd-6d06-4fdd-8140-57e9a6da782a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:06.283443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb726ebd-6d06-4fdd-8140-57e9a6da782a admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:06.300563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1104/2225] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:31:06.302513 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab65d5-b2bc-4d89-8a1d-085ae415a564 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:06.328708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab65d5-b2bc-4d89-8a1d-085ae415a564 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:06.336878 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f2b52-36bb-49fb-9975-215bd0a0d8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:06.338045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f2b52-36bb-49fb-9975-215bd0a0d8fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:06.338542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f2b52-36bb-49fb-9975-215bd0a0d8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:06.339030 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f2b52-36bb-49fb-9975-215bd0a0d8fd admin admin] PATH_INFO: `/v3/projects/ef9498674f1a4a7a832425b36d572fbc/users/4aecb3faa58348cbb8d6c56b25928086/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:06.365430 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f2b52-36bb-49fb-9975-215bd0a0d8fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef9498674f1a4a7a832425b36d572fbc, user_id=4aecb3faa58348cbb8d6c56b25928086, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:06.371553 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f2b52-36bb-49fb-9975-215bd0a0d8fd admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:06.399295 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1122/2226] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:31:06 2022] PUT /identity/v3/projects/ef9498674f1a4a7a832425b36d572fbc/users/4aecb3faa58348cbb8d6c56b25928086/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:31:06.418134 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2c09b-bb69-4ba1-a4ba-675aa869ad4d None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:06.418540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2c09b-bb69-4ba1-a4ba-675aa869ad4d None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:06.418914 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2c09b-bb69-4ba1-a4ba-675aa869ad4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:06.454717 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-a9f2c09b-bb69-4ba1-a4ba-675aa869ad4d None None] MFA Rules not processed for user `4aecb3faa58348cbb8d6c56b25928086`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:06.455954 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a9f2c09b-bb69-4ba1-a4ba-675aa869ad4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:06.599403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1105/2227] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:06.612033 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f2b52-36bb-49fb-9975-215bd0a0d8fd admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:06.613946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6e8f2b52-36bb-49fb-9975-215bd0a0d8fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:06.719364 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f2b52-36bb-49fb-9975-215bd0a0d8fd admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:06.724394 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacbe7a-2820-4e67-abb4-10c1651bd7fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:06.724394 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacbe7a-2820-4e67-abb4-10c1651bd7fc service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:06.724812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacbe7a-2820-4e67-abb4-10c1651bd7fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:06.725156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacbe7a-2820-4e67-abb4-10c1651bd7fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:06.735703 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbacbe7a-2820-4e67-abb4-10c1651bd7fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:06.737469 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbacbe7a-2820-4e67-abb4-10c1651bd7fc service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:06.751000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1123/2228] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:31:06 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:31:07.919410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2c09b-bb69-4ba1-a4ba-675aa869ad4d None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:07.924067 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a9f2c09b-bb69-4ba1-a4ba-675aa869ad4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:07.999790 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2c09b-bb69-4ba1-a4ba-675aa869ad4d None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:08.004918 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefbe50-5d4f-42ad-9d3c-91a8812f0715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:08.005792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefbe50-5d4f-42ad-9d3c-91a8812f0715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:08.006214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefbe50-5d4f-42ad-9d3c-91a8812f0715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:08.006658 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefbe50-5d4f-42ad-9d3c-91a8812f0715 admin admin] PATH_INFO: `/v3/users/663b625456394f10a3dcff14e5d23699` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:08.007999 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefbe50-5d4f-42ad-9d3c-91a8812f0715 admin admin] RBAC: Authorizing `identity:delete_user(user_id=663b625456394f10a3dcff14e5d23699)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:08.010923 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefbe50-5d4f-42ad-9d3c-91a8812f0715 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:08.073331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-0cefbe50-5d4f-42ad-9d3c-91a8812f0715 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '663b625456394f10a3dcff14e5d23699'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:08.074578 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-0cefbe50-5d4f-42ad-9d3c-91a8812f0715 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '663b625456394f10a3dcff14e5d23699'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:08.088673 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-0cefbe50-5d4f-42ad-9d3c-91a8812f0715 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '663b625456394f10a3dcff14e5d23699'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:08.092289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:08.097620 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-0cefbe50-5d4f-42ad-9d3c-91a8812f0715 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '663b625456394f10a3dcff14e5d23699'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:08.108056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-0cefbe50-5d4f-42ad-9d3c-91a8812f0715 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '663b625456394f10a3dcff14e5d23699'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:08.117134 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1106/2229] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:31:07 2022] DELETE /identity/v3/users/663b625456394f10a3dcff14e5d23699 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:08.119994 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2dd74-9610-4714-ab15-7d7de0f680c0 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:08.120567 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2dd74-9610-4714-ab15-7d7de0f680c0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:08.120567 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2dd74-9610-4714-ab15-7d7de0f680c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:08.139264 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-74a2dd74-9610-4714-ab15-7d7de0f680c0 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:08.140763 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-74a2dd74-9610-4714-ab15-7d7de0f680c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:08.203981 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1124/2230] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:08.214958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefbe50-5d4f-42ad-9d3c-91a8812f0715 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:08.216399 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-0cefbe50-5d4f-42ad-9d3c-91a8812f0715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:08.278822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefbe50-5d4f-42ad-9d3c-91a8812f0715 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:08.283232 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c4098-a3a1-44a2-95b9-aa18d5db2b2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:08.284086 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c4098-a3a1-44a2-95b9-aa18d5db2b2a service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:08.284375 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c4098-a3a1-44a2-95b9-aa18d5db2b2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:08.284649 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c4098-a3a1-44a2-95b9-aa18d5db2b2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:08.295680 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c4098-a3a1-44a2-95b9-aa18d5db2b2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:08.297263 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c4098-a3a1-44a2-95b9-aa18d5db2b2a service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:08.311293 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1107/2231] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:31:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:31:08.711575 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2dd74-9610-4714-ab15-7d7de0f680c0 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:08.714032 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-74a2dd74-9610-4714-ab15-7d7de0f680c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:08.726671 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2dd74-9610-4714-ab15-7d7de0f680c0 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:08.732790 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b92ba-1e33-46b6-a55b-c1f3ae0703e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:08.732790 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b92ba-1e33-46b6-a55b-c1f3ae0703e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:08.733022 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b92ba-1e33-46b6-a55b-c1f3ae0703e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:08.733160 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b92ba-1e33-46b6-a55b-c1f3ae0703e0 admin admin] PATH_INFO: `/v3/projects/196c8659ad454057b90315d40374f61d` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:08.734295 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b92ba-1e33-46b6-a55b-c1f3ae0703e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=196c8659ad454057b90315d40374f61d)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:08.736263 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b92ba-1e33-46b6-a55b-c1f3ae0703e0 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:08.794901 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:08.802771 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-3d9b92ba-1e33-46b6-a55b-c1f3ae0703e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '196c8659ad454057b90315d40374f61d', 'request_id': 'req-3d9b92ba-1e33-46b6-a55b-c1f3ae0703e0'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:08.821084 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-3d9b92ba-1e33-46b6-a55b-c1f3ae0703e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '196c8659ad454057b90315d40374f61d', 'request_id': 'req-3d9b92ba-1e33-46b6-a55b-c1f3ae0703e0'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:08.829092 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-3d9b92ba-1e33-46b6-a55b-c1f3ae0703e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '196c8659ad454057b90315d40374f61d', 'request_id': 'req-3d9b92ba-1e33-46b6-a55b-c1f3ae0703e0'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:08.844923 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-3d9b92ba-1e33-46b6-a55b-c1f3ae0703e0 admin admin] The token cache is being invalidate because project 196c8659ad454057b90315d40374f61d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:31:08.845110 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-3d9b92ba-1e33-46b6-a55b-c1f3ae0703e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:08.845604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-3d9b92ba-1e33-46b6-a55b-c1f3ae0703e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:08.847161 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1125/2232] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:31:08 2022] DELETE /identity/v3/projects/196c8659ad454057b90315d40374f61d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:08.852158 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc265c1f-4529-4593-a34a-7bf8ccb42b17 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:08.852446 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc265c1f-4529-4593-a34a-7bf8ccb42b17 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:08.852817 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc265c1f-4529-4593-a34a-7bf8ccb42b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:08.872958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-cc265c1f-4529-4593-a34a-7bf8ccb42b17 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:08.874149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-cc265c1f-4529-4593-a34a-7bf8ccb42b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:08.942138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1108/2233] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:08.951456 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d6523-8a95-48b9-aff6-04e1bd1f1362 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:08.951811 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d6523-8a95-48b9-aff6-04e1bd1f1362 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:08.952075 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d6523-8a95-48b9-aff6-04e1bd1f1362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:08.975882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-bb9d6523-8a95-48b9-aff6-04e1bd1f1362 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:08.977105 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bb9d6523-8a95-48b9-aff6-04e1bd1f1362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:08.996719 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1126/2234] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:09.000866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc265c1f-4529-4593-a34a-7bf8ccb42b17 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:09.011624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc265c1f-4529-4593-a34a-7bf8ccb42b17 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:09.016492 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64241a48-94e9-498f-82cc-1fde5be970c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:09.017109 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64241a48-94e9-498f-82cc-1fde5be970c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:09.017388 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64241a48-94e9-498f-82cc-1fde5be970c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:09.017659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64241a48-94e9-498f-82cc-1fde5be970c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:09.018342 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64241a48-94e9-498f-82cc-1fde5be970c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:31:09.018644 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64241a48-94e9-498f-82cc-1fde5be970c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:09.020279 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64241a48-94e9-498f-82cc-1fde5be970c1 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:09.032590 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1109/2235] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:31:09.037054 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d6523-8a95-48b9-aff6-04e1bd1f1362 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:09.047188 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d6523-8a95-48b9-aff6-04e1bd1f1362 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:09.051846 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bceec-f018-472a-b797-b6fa2c136d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:09.052455 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bceec-f018-472a-b797-b6fa2c136d9a admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:09.052733 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bceec-f018-472a-b797-b6fa2c136d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:09.053004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bceec-f018-472a-b797-b6fa2c136d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:09.053646 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bceec-f018-472a-b797-b6fa2c136d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:09.055537 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bceec-f018-472a-b797-b6fa2c136d9a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:09.087217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1127/2236] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:31:09 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:31:09.091686 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64241a48-94e9-498f-82cc-1fde5be970c1 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:09.101772 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64241a48-94e9-498f-82cc-1fde5be970c1 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:09.158475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02ebd3-906c-43c7-8574-475cb3ddcc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:09.159086 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02ebd3-906c-43c7-8574-475cb3ddcc2e admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:09.159367 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02ebd3-906c-43c7-8574-475cb3ddcc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:09.159644 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02ebd3-906c-43c7-8574-475cb3ddcc2e admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:09.160302 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02ebd3-906c-43c7-8574-475cb3ddcc2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:09.162242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02ebd3-906c-43c7-8574-475cb3ddcc2e admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:09.185040 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1110/2237] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:31:09 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:31:09.188951 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bceec-f018-472a-b797-b6fa2c136d9a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:09.199803 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bceec-f018-472a-b797-b6fa2c136d9a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:09.204790 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98eef96-8b6d-4e97-a309-820feb1b3165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:09.205408 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98eef96-8b6d-4e97-a309-820feb1b3165 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:09.205688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98eef96-8b6d-4e97-a309-820feb1b3165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:09.205958 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98eef96-8b6d-4e97-a309-820feb1b3165 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:09.206603 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98eef96-8b6d-4e97-a309-820feb1b3165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:09.208218 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98eef96-8b6d-4e97-a309-820feb1b3165 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:09.222499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1128/2238] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:31:09.223925 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02ebd3-906c-43c7-8574-475cb3ddcc2e admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:09.234841 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02ebd3-906c-43c7-8574-475cb3ddcc2e admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:09.239938 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcb13b-097c-477d-8b7f-07049fe47a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:09.240551 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcb13b-097c-477d-8b7f-07049fe47a58 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:09.240841 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcb13b-097c-477d-8b7f-07049fe47a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:09.241115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcb13b-097c-477d-8b7f-07049fe47a58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:09.241788 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bcb13b-097c-477d-8b7f-07049fe47a58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:09.243512 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bcb13b-097c-477d-8b7f-07049fe47a58 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:09.244959 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:09.256345 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1111/2239] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:31:09.260469 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98eef96-8b6d-4e97-a309-820feb1b3165 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:09.270640 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98eef96-8b6d-4e97-a309-820feb1b3165 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:09.275948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85ccf1-5301-43f3-a5ab-16ca0758ce88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:09.276633 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85ccf1-5301-43f3-a5ab-16ca0758ce88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:09.276899 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85ccf1-5301-43f3-a5ab-16ca0758ce88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:09.277174 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85ccf1-5301-43f3-a5ab-16ca0758ce88 admin admin] PATH_INFO: `/v3/projects/d5e5183ca99643e4859014868d008359/users/01d43a22f3a04416b9d4296c5645f193/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:09.294463 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85ccf1-5301-43f3-a5ab-16ca0758ce88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e5183ca99643e4859014868d008359, user_id=01d43a22f3a04416b9d4296c5645f193, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:09.297155 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85ccf1-5301-43f3-a5ab-16ca0758ce88 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:09.312771 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1129/2240] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:31:09 2022] PUT /identity/v3/projects/d5e5183ca99643e4859014868d008359/users/01d43a22f3a04416b9d4296c5645f193/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:09.324008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f952ae-7289-432b-bfce-4e136d87b2b5 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:09.324295 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f952ae-7289-432b-bfce-4e136d87b2b5 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:09.324568 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f952ae-7289-432b-bfce-4e136d87b2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:09.354398 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-27f952ae-7289-432b-bfce-4e136d87b2b5 None None] MFA Rules not processed for user `01d43a22f3a04416b9d4296c5645f193`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:09.355659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-27f952ae-7289-432b-bfce-4e136d87b2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:09.442241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1112/2241] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:09.443123 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85ccf1-5301-43f3-a5ab-16ca0758ce88 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:09.521557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85ccf1-5301-43f3-a5ab-16ca0758ce88 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:09.527125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433869f-332b-4357-9c4f-a3d1ea16899b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:09.527786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433869f-332b-4357-9c4f-a3d1ea16899b admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:09.528151 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433869f-332b-4357-9c4f-a3d1ea16899b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:09.528481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433869f-332b-4357-9c4f-a3d1ea16899b admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:09.529181 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433869f-332b-4357-9c4f-a3d1ea16899b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:09.531153 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433869f-332b-4357-9c4f-a3d1ea16899b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:09.563449 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1130/2242] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:31:09 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:31:09.568241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f952ae-7289-432b-bfce-4e136d87b2b5 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:09.588946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f952ae-7289-432b-bfce-4e136d87b2b5 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:09.657119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0e283-b27a-482b-b961-69e9dbd52ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:09.657853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0e283-b27a-482b-b961-69e9dbd52ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:09.658199 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0e283-b27a-482b-b961-69e9dbd52ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:09.658476 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0e283-b27a-482b-b961-69e9dbd52ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:09.659112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0e283-b27a-482b-b961-69e9dbd52ff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:09.661083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0e283-b27a-482b-b961-69e9dbd52ff3 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:09.690404 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1113/2243] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:31:09 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:31:09.696205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433869f-332b-4357-9c4f-a3d1ea16899b admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:09.711020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433869f-332b-4357-9c4f-a3d1ea16899b admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:09.719618 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1a9dc-05e4-4d62-8a7a-abb3e6947fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:09.720333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1a9dc-05e4-4d62-8a7a-abb3e6947fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:09.720567 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1a9dc-05e4-4d62-8a7a-abb3e6947fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:09.721599 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1a9dc-05e4-4d62-8a7a-abb3e6947fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:09.721599 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1a9dc-05e4-4d62-8a7a-abb3e6947fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:09.723349 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1a9dc-05e4-4d62-8a7a-abb3e6947fb8 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:09.741196 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1131/2244] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:31:09.747737 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0e283-b27a-482b-b961-69e9dbd52ff3 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:09.760016 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0e283-b27a-482b-b961-69e9dbd52ff3 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:09.765262 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067502a-6ee7-4de0-a27c-149d7d76d0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:09.765964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067502a-6ee7-4de0-a27c-149d7d76d0f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:09.766271 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067502a-6ee7-4de0-a27c-149d7d76d0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:09.766549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067502a-6ee7-4de0-a27c-149d7d76d0f4 admin admin] PATH_INFO: `/v3/projects/bc54bc866062466ab2e4ecf66050b278/users/69ec0cd6305943afbd73d43acbe56ad3/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:09.788973 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067502a-6ee7-4de0-a27c-149d7d76d0f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc54bc866062466ab2e4ecf66050b278, user_id=69ec0cd6305943afbd73d43acbe56ad3, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:09.792349 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067502a-6ee7-4de0-a27c-149d7d76d0f4 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:09.807335 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1114/2245] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:31:09 2022] PUT /identity/v3/projects/bc54bc866062466ab2e4ecf66050b278/users/69ec0cd6305943afbd73d43acbe56ad3/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:09.811279 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1a9dc-05e4-4d62-8a7a-abb3e6947fb8 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:09.822087 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1a9dc-05e4-4d62-8a7a-abb3e6947fb8 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:09.888824 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:09.920649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb7561-ebb6-4b09-9322-055e483318be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:09.921422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb7561-ebb6-4b09-9322-055e483318be admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:09.921707 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb7561-ebb6-4b09-9322-055e483318be admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:09.921975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb7561-ebb6-4b09-9322-055e483318be admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:09.922624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb7561-ebb6-4b09-9322-055e483318be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:09.924305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb7561-ebb6-4b09-9322-055e483318be admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:09.938882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1132/2246] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:31:09.944089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067502a-6ee7-4de0-a27c-149d7d76d0f4 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:09.956171 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067502a-6ee7-4de0-a27c-149d7d76d0f4 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:09.962685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80254f86-78b4-4952-929e-ecc8a3f68b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:09.963913 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80254f86-78b4-4952-929e-ecc8a3f68b0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:09.964355 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80254f86-78b4-4952-929e-ecc8a3f68b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:09.964819 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80254f86-78b4-4952-929e-ecc8a3f68b0f admin admin] PATH_INFO: `/v3/projects/bc54bc866062466ab2e4ecf66050b278/users/69ec0cd6305943afbd73d43acbe56ad3/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:09.967185 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80254f86-78b4-4952-929e-ecc8a3f68b0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc54bc866062466ab2e4ecf66050b278, user_id=69ec0cd6305943afbd73d43acbe56ad3, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:09.970044 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80254f86-78b4-4952-929e-ecc8a3f68b0f admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:09.982407 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1115/2247] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:31:09 2022] PUT /identity/v3/projects/bc54bc866062466ab2e4ecf66050b278/users/69ec0cd6305943afbd73d43acbe56ad3/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:09.994239 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586c480-783a-4afc-bc93-3c503f140a68 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:09.994603 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586c480-783a-4afc-bc93-3c503f140a68 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:09.995032 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586c480-783a-4afc-bc93-3c503f140a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:10.043016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-2586c480-783a-4afc-bc93-3c503f140a68 None None] MFA Rules not processed for user `69ec0cd6305943afbd73d43acbe56ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:10.045444 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2586c480-783a-4afc-bc93-3c503f140a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:10.151535 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1133/2248] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:10.163093 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80254f86-78b4-4952-929e-ecc8a3f68b0f admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:10.164930 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-80254f86-78b4-4952-929e-ecc8a3f68b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:10.213625 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:10.231832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80254f86-78b4-4952-929e-ecc8a3f68b0f admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:10.235600 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5ec9c-f318-419e-b0ef-3404c74a94fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:10.236248 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5ec9c-f318-419e-b0ef-3404c74a94fb service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:10.236520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5ec9c-f318-419e-b0ef-3404c74a94fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:10.236783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5ec9c-f318-419e-b0ef-3404c74a94fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:10.254388 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5ec9c-f318-419e-b0ef-3404c74a94fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:10.256172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5ec9c-f318-419e-b0ef-3404c74a94fb service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:10.270387 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1116/2249] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:31:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:31:10.389903 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586c480-783a-4afc-bc93-3c503f140a68 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:10.400325 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586c480-783a-4afc-bc93-3c503f140a68 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:10.404057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395c559-8ab1-4d61-8344-2e113cd87b39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:10.404646 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395c559-8ab1-4d61-8344-2e113cd87b39 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:10.404927 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395c559-8ab1-4d61-8344-2e113cd87b39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:10.405203 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395c559-8ab1-4d61-8344-2e113cd87b39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:10.470496 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395c559-8ab1-4d61-8344-2e113cd87b39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:10.472151 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395c559-8ab1-4d61-8344-2e113cd87b39 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:10.482306 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1134/2250] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:31:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:31:13.226243 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5ec9c-f318-419e-b0ef-3404c74a94fb service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:13.300020 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5ec9c-f318-419e-b0ef-3404c74a94fb service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:13.304568 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddcf5a-279f-463f-a92b-ce63f212aeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:13.305190 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddcf5a-279f-463f-a92b-ce63f212aeca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:13.305464 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddcf5a-279f-463f-a92b-ce63f212aeca admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:13.305734 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddcf5a-279f-463f-a92b-ce63f212aeca admin admin] PATH_INFO: `/v3/users/01d43a22f3a04416b9d4296c5645f193` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:13.307136 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddcf5a-279f-463f-a92b-ce63f212aeca admin admin] RBAC: Authorizing `identity:delete_user(user_id=01d43a22f3a04416b9d4296c5645f193)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:13.309016 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddcf5a-279f-463f-a92b-ce63f212aeca admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:13.358106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-afddcf5a-279f-463f-a92b-ce63f212aeca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01d43a22f3a04416b9d4296c5645f193'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:13.358911 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-afddcf5a-279f-463f-a92b-ce63f212aeca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01d43a22f3a04416b9d4296c5645f193'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:13.371238 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-afddcf5a-279f-463f-a92b-ce63f212aeca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01d43a22f3a04416b9d4296c5645f193'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:13.383312 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-afddcf5a-279f-463f-a92b-ce63f212aeca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01d43a22f3a04416b9d4296c5645f193'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:13.393251 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-afddcf5a-279f-463f-a92b-ce63f212aeca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01d43a22f3a04416b9d4296c5645f193'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:13.401620 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1117/2251] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:31:13 2022] DELETE /identity/v3/users/01d43a22f3a04416b9d4296c5645f193 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:13.406320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4e17d-b51b-4bcb-a333-1ff4d8d7c3d3 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:13.406901 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4e17d-b51b-4bcb-a333-1ff4d8d7c3d3 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:13.406901 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4e17d-b51b-4bcb-a333-1ff4d8d7c3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:13.427673 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-dda4e17d-b51b-4bcb-a333-1ff4d8d7c3d3 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:13.428989 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-dda4e17d-b51b-4bcb-a333-1ff4d8d7c3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:13.494874 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:13.511854 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1135/2252] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:13.526223 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddcf5a-279f-463f-a92b-ce63f212aeca admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:13.529408 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-afddcf5a-279f-463f-a92b-ce63f212aeca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:13.634531 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddcf5a-279f-463f-a92b-ce63f212aeca admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:13.640116 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aba2d6-8ede-4696-ae69-f8102ad325ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:13.641915 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aba2d6-8ede-4696-ae69-f8102ad325ad service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:13.641915 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aba2d6-8ede-4696-ae69-f8102ad325ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:13.641915 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aba2d6-8ede-4696-ae69-f8102ad325ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:13.655648 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aba2d6-8ede-4696-ae69-f8102ad325ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:13.657322 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aba2d6-8ede-4696-ae69-f8102ad325ad service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:13.674933 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1118/2253] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:31:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:31:14.233642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4e17d-b51b-4bcb-a333-1ff4d8d7c3d3 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:14.235072 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-dda4e17d-b51b-4bcb-a333-1ff4d8d7c3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:14.250092 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4e17d-b51b-4bcb-a333-1ff4d8d7c3d3 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:14.255647 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23c19b-5d34-4303-9adc-304b112e25b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:14.256534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23c19b-5d34-4303-9adc-304b112e25b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:14.256847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23c19b-5d34-4303-9adc-304b112e25b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:14.257080 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23c19b-5d34-4303-9adc-304b112e25b2 admin admin] PATH_INFO: `/v3/projects/d5e5183ca99643e4859014868d008359` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:14.258241 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23c19b-5d34-4303-9adc-304b112e25b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5e5183ca99643e4859014868d008359)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:14.260261 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23c19b-5d34-4303-9adc-304b112e25b2 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:14.309807 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ba23c19b-5d34-4303-9adc-304b112e25b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5e5183ca99643e4859014868d008359', 'request_id': 'req-ba23c19b-5d34-4303-9adc-304b112e25b2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:14.315429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ba23c19b-5d34-4303-9adc-304b112e25b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5e5183ca99643e4859014868d008359', 'request_id': 'req-ba23c19b-5d34-4303-9adc-304b112e25b2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:14.323598 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ba23c19b-5d34-4303-9adc-304b112e25b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5e5183ca99643e4859014868d008359', 'request_id': 'req-ba23c19b-5d34-4303-9adc-304b112e25b2'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:14.337416 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ba23c19b-5d34-4303-9adc-304b112e25b2 admin admin] The token cache is being invalidate because project d5e5183ca99643e4859014868d008359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:31:14.337797 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ba23c19b-5d34-4303-9adc-304b112e25b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:14.338432 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ba23c19b-5d34-4303-9adc-304b112e25b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:14.339964 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1136/2254] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:31:14 2022] DELETE /identity/v3/projects/d5e5183ca99643e4859014868d008359 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:14.344133 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aba2d6-8ede-4696-ae69-f8102ad325ad service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:14.349191 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:14.356728 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aba2d6-8ede-4696-ae69-f8102ad325ad service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:14.423839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30566ec-48a0-4df0-b64c-5821ed7e94e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:14.424484 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30566ec-48a0-4df0-b64c-5821ed7e94e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:14.424766 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30566ec-48a0-4df0-b64c-5821ed7e94e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:14.425041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30566ec-48a0-4df0-b64c-5821ed7e94e2 admin admin] PATH_INFO: `/v3/users/69ec0cd6305943afbd73d43acbe56ad3` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:14.426232 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30566ec-48a0-4df0-b64c-5821ed7e94e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69ec0cd6305943afbd73d43acbe56ad3)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:14.428248 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30566ec-48a0-4df0-b64c-5821ed7e94e2 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:14.480191 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-e30566ec-48a0-4df0-b64c-5821ed7e94e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69ec0cd6305943afbd73d43acbe56ad3'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:14.480863 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-e30566ec-48a0-4df0-b64c-5821ed7e94e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69ec0cd6305943afbd73d43acbe56ad3'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:14.496134 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-e30566ec-48a0-4df0-b64c-5821ed7e94e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69ec0cd6305943afbd73d43acbe56ad3'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:14.504418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-e30566ec-48a0-4df0-b64c-5821ed7e94e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69ec0cd6305943afbd73d43acbe56ad3'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:14.518811 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-e30566ec-48a0-4df0-b64c-5821ed7e94e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69ec0cd6305943afbd73d43acbe56ad3'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:14.533263 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1119/2255] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:31:14 2022] DELETE /identity/v3/users/69ec0cd6305943afbd73d43acbe56ad3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:14.903406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23c19b-5d34-4303-9adc-304b112e25b2 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:14.906346 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ba23c19b-5d34-4303-9adc-304b112e25b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:14.927793 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23c19b-5d34-4303-9adc-304b112e25b2 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:15.031837 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee70d5-6fd3-4d37-af35-f5ecfcfc3fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:15.033371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee70d5-6fd3-4d37-af35-f5ecfcfc3fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:15.033729 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee70d5-6fd3-4d37-af35-f5ecfcfc3fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:15.034072 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee70d5-6fd3-4d37-af35-f5ecfcfc3fbe admin admin] PATH_INFO: `/v3/projects/bc54bc866062466ab2e4ecf66050b278` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:15.036929 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee70d5-6fd3-4d37-af35-f5ecfcfc3fbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc54bc866062466ab2e4ecf66050b278)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:15.041459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee70d5-6fd3-4d37-af35-f5ecfcfc3fbe admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:15.135475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-dbee70d5-6fd3-4d37-af35-f5ecfcfc3fbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc54bc866062466ab2e4ecf66050b278', 'request_id': 'req-dbee70d5-6fd3-4d37-af35-f5ecfcfc3fbe'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:15.150618 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-dbee70d5-6fd3-4d37-af35-f5ecfcfc3fbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc54bc866062466ab2e4ecf66050b278', 'request_id': 'req-dbee70d5-6fd3-4d37-af35-f5ecfcfc3fbe'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:15.158602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-dbee70d5-6fd3-4d37-af35-f5ecfcfc3fbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc54bc866062466ab2e4ecf66050b278', 'request_id': 'req-dbee70d5-6fd3-4d37-af35-f5ecfcfc3fbe'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:15.175982 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-dbee70d5-6fd3-4d37-af35-f5ecfcfc3fbe admin admin] The token cache is being invalidate because project bc54bc866062466ab2e4ecf66050b278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:31:15.176258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-dbee70d5-6fd3-4d37-af35-f5ecfcfc3fbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:15.176967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-dbee70d5-6fd3-4d37-af35-f5ecfcfc3fbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:15.179852 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1137/2256] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:31:14 2022] DELETE /identity/v3/projects/bc54bc866062466ab2e4ecf66050b278 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:31:15.186138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af432c2-748b-4d48-b794-8bf71d8dee5f None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:15.186440 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af432c2-748b-4d48-b794-8bf71d8dee5f None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:15.186798 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af432c2-748b-4d48-b794-8bf71d8dee5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:15.211482 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-4af432c2-748b-4d48-b794-8bf71d8dee5f None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:15.213015 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-4af432c2-748b-4d48-b794-8bf71d8dee5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:15.296752 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1120/2257] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:15.306499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d83a72-0aa3-49ac-8021-f3ff988d5b8f None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:15.306909 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d83a72-0aa3-49ac-8021-f3ff988d5b8f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:15.308251 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d83a72-0aa3-49ac-8021-f3ff988d5b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:15.332919 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-d5d83a72-0aa3-49ac-8021-f3ff988d5b8f None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:15.334508 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d5d83a72-0aa3-49ac-8021-f3ff988d5b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:15.352141 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1138/2258] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:31:15.356037 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af432c2-748b-4d48-b794-8bf71d8dee5f None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:15.373555 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af432c2-748b-4d48-b794-8bf71d8dee5f None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:15.379494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a53bd-257c-42c5-a8ae-98f81de0a2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:15.381970 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a53bd-257c-42c5-a8ae-98f81de0a2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:15.381970 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a53bd-257c-42c5-a8ae-98f81de0a2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:15.381970 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a53bd-257c-42c5-a8ae-98f81de0a2c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:15.382677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a53bd-257c-42c5-a8ae-98f81de0a2c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:31:15.383956 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a53bd-257c-42c5-a8ae-98f81de0a2c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:15.385545 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a53bd-257c-42c5-a8ae-98f81de0a2c3 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:15.407361 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1121/2259] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:31:15.408410 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d83a72-0aa3-49ac-8021-f3ff988d5b8f None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:15.421750 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d83a72-0aa3-49ac-8021-f3ff988d5b8f None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:15.428952 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23a0fa-baaa-438e-84b6-adacd0c2d5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:15.429777 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23a0fa-baaa-438e-84b6-adacd0c2d5d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:15.430049 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23a0fa-baaa-438e-84b6-adacd0c2d5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:15.430321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23a0fa-baaa-438e-84b6-adacd0c2d5d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:15.431650 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23a0fa-baaa-438e-84b6-adacd0c2d5d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:15.433475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23a0fa-baaa-438e-84b6-adacd0c2d5d7 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:15.438769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:15.473205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1139/2260] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:31:15 2022] POST /identity/v3/projects => generated 367 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:31:15.477002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a53bd-257c-42c5-a8ae-98f81de0a2c3 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:15.511802 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a53bd-257c-42c5-a8ae-98f81de0a2c3 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:15.527671 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:15.626615 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7023d-103c-48b7-b982-a890a38cd802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:15.627236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7023d-103c-48b7-b982-a890a38cd802 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:15.627508 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7023d-103c-48b7-b982-a890a38cd802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:15.627817 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7023d-103c-48b7-b982-a890a38cd802 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:15.628495 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7023d-103c-48b7-b982-a890a38cd802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:15.630593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7023d-103c-48b7-b982-a890a38cd802 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:15.656193 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1122/2261] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:31:15 2022] POST /identity/v3/users => generated 284 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:31:15.661943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23a0fa-baaa-438e-84b6-adacd0c2d5d7 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:15.674620 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23a0fa-baaa-438e-84b6-adacd0c2d5d7 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:15.680412 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce057c9-d62c-40bd-a767-71f892b4c00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:15.681985 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce057c9-d62c-40bd-a767-71f892b4c00b admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:15.682267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce057c9-d62c-40bd-a767-71f892b4c00b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:15.682530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce057c9-d62c-40bd-a767-71f892b4c00b admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:15.683185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce057c9-d62c-40bd-a767-71f892b4c00b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:15.684836 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce057c9-d62c-40bd-a767-71f892b4c00b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:15.698510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1140/2262] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:31:15.703054 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7023d-103c-48b7-b982-a890a38cd802 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:15.713457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7023d-103c-48b7-b982-a890a38cd802 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:15.718862 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fa710-89e3-4cf5-ba2d-bf69cbb0a84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:15.719485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fa710-89e3-4cf5-ba2d-bf69cbb0a84c admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:15.719793 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fa710-89e3-4cf5-ba2d-bf69cbb0a84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:15.720064 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fa710-89e3-4cf5-ba2d-bf69cbb0a84c admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:15.720709 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fa710-89e3-4cf5-ba2d-bf69cbb0a84c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:15.722322 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fa710-89e3-4cf5-ba2d-bf69cbb0a84c admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:15.736249 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1123/2263] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:31:15.741091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce057c9-d62c-40bd-a767-71f892b4c00b admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:15.752341 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce057c9-d62c-40bd-a767-71f892b4c00b admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:15.757077 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6e046-0b04-4d7d-9d5e-d30b9796d87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:15.757934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6e046-0b04-4d7d-9d5e-d30b9796d87f admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:15.758273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6e046-0b04-4d7d-9d5e-d30b9796d87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:15.758576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6e046-0b04-4d7d-9d5e-d30b9796d87f admin admin] PATH_INFO: `/v3/projects/21ee791f43204d4f84f5f5818a4f7199/users/474af55044f54f81bedca1c51e9b4251/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:15.777125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6e046-0b04-4d7d-9d5e-d30b9796d87f admin admin] RBAC: Authorizing `identity:create_grant(project_id=21ee791f43204d4f84f5f5818a4f7199, user_id=474af55044f54f81bedca1c51e9b4251, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:15.779836 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6e046-0b04-4d7d-9d5e-d30b9796d87f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:15.794173 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1141/2264] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:31:15 2022] PUT /identity/v3/projects/21ee791f43204d4f84f5f5818a4f7199/users/474af55044f54f81bedca1c51e9b4251/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:15.805190 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bdbd3-36b5-4b07-adb2-3547c2081e00 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:15.805472 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bdbd3-36b5-4b07-adb2-3547c2081e00 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:15.805776 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bdbd3-36b5-4b07-adb2-3547c2081e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:15.835374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-258bdbd3-36b5-4b07-adb2-3547c2081e00 None None] MFA Rules not processed for user `474af55044f54f81bedca1c51e9b4251`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:15.836630 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-258bdbd3-36b5-4b07-adb2-3547c2081e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:15.918519 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1124/2265] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:15.925182 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6e046-0b04-4d7d-9d5e-d30b9796d87f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:16.002773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6e046-0b04-4d7d-9d5e-d30b9796d87f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:16.010019 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e70dd-d8db-44db-a465-f6395e2009a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:16.010783 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e70dd-d8db-44db-a465-f6395e2009a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:16.011180 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e70dd-d8db-44db-a465-f6395e2009a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:16.011548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e70dd-d8db-44db-a465-f6395e2009a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:16.012518 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e70dd-d8db-44db-a465-f6395e2009a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:16.015010 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e70dd-d8db-44db-a465-f6395e2009a3 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:16.050262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1142/2266] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:31:15 2022] POST /identity/v3/projects => generated 367 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:31:16.054504 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bdbd3-36b5-4b07-adb2-3547c2081e00 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:16.069960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bdbd3-36b5-4b07-adb2-3547c2081e00 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:16.144669 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933f2d2-6643-4f2d-8776-0a3f1ae14a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:16.145293 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933f2d2-6643-4f2d-8776-0a3f1ae14a88 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:16.145814 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933f2d2-6643-4f2d-8776-0a3f1ae14a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:16.146197 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933f2d2-6643-4f2d-8776-0a3f1ae14a88 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:16.146919 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933f2d2-6643-4f2d-8776-0a3f1ae14a88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:16.149613 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933f2d2-6643-4f2d-8776-0a3f1ae14a88 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:16.183449 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1125/2267] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:31:16 2022] POST /identity/v3/users => generated 290 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:31:16.189897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e70dd-d8db-44db-a465-f6395e2009a3 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:16.205526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e70dd-d8db-44db-a465-f6395e2009a3 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:16.215769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1fe10-135e-494d-a05e-6c42641dc08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:16.216906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1fe10-135e-494d-a05e-6c42641dc08a admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:16.217536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1fe10-135e-494d-a05e-6c42641dc08a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:16.218047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1fe10-135e-494d-a05e-6c42641dc08a admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:16.218959 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1fe10-135e-494d-a05e-6c42641dc08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:16.222963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1fe10-135e-494d-a05e-6c42641dc08a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:16.252133 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1143/2268] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:31:16.253331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933f2d2-6643-4f2d-8776-0a3f1ae14a88 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:16.265251 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933f2d2-6643-4f2d-8776-0a3f1ae14a88 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:16.271207 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7f3f3-6d77-48e1-8baa-2d3857e7ab28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:16.271931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7f3f3-6d77-48e1-8baa-2d3857e7ab28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:16.272214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7f3f3-6d77-48e1-8baa-2d3857e7ab28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:16.272488 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7f3f3-6d77-48e1-8baa-2d3857e7ab28 admin admin] PATH_INFO: `/v3/projects/db218858d047496eac223fd5005406d5/users/e2a9f6609e7a40a996b0baa071993ca4/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:16.275330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:16.296500 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7f3f3-6d77-48e1-8baa-2d3857e7ab28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db218858d047496eac223fd5005406d5, user_id=e2a9f6609e7a40a996b0baa071993ca4, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:16.300088 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7f3f3-6d77-48e1-8baa-2d3857e7ab28 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:16.323284 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1126/2269] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:31:16 2022] PUT /identity/v3/projects/db218858d047496eac223fd5005406d5/users/e2a9f6609e7a40a996b0baa071993ca4/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:31:16.326806 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1fe10-135e-494d-a05e-6c42641dc08a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:16.337484 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1fe10-135e-494d-a05e-6c42641dc08a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:16.452252 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500dabd-376d-4f2b-8e2f-d3c625eee051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:16.453013 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500dabd-376d-4f2b-8e2f-d3c625eee051 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:16.453444 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500dabd-376d-4f2b-8e2f-d3c625eee051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:16.453726 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500dabd-376d-4f2b-8e2f-d3c625eee051 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:16.454388 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500dabd-376d-4f2b-8e2f-d3c625eee051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:16.456186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500dabd-376d-4f2b-8e2f-d3c625eee051 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:16.470768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1144/2270] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:31:16.474573 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7f3f3-6d77-48e1-8baa-2d3857e7ab28 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:16.487653 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7f3f3-6d77-48e1-8baa-2d3857e7ab28 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:16.496520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc5559-196d-4702-b09f-883b44e745fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:16.496520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc5559-196d-4702-b09f-883b44e745fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:16.497179 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc5559-196d-4702-b09f-883b44e745fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:16.497488 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc5559-196d-4702-b09f-883b44e745fb admin admin] PATH_INFO: `/v3/projects/db218858d047496eac223fd5005406d5/users/e2a9f6609e7a40a996b0baa071993ca4/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:16.500318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc5559-196d-4702-b09f-883b44e745fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=db218858d047496eac223fd5005406d5, user_id=e2a9f6609e7a40a996b0baa071993ca4, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:16.503082 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc5559-196d-4702-b09f-883b44e745fb admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:16.518542 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1127/2271] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:31:16 2022] PUT /identity/v3/projects/db218858d047496eac223fd5005406d5/users/e2a9f6609e7a40a996b0baa071993ca4/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:16.530666 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf31b82-19cf-4e0d-936b-17739cba7bf7 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:16.530910 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf31b82-19cf-4e0d-936b-17739cba7bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:16.531159 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf31b82-19cf-4e0d-936b-17739cba7bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:16.561503 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ddf31b82-19cf-4e0d-936b-17739cba7bf7 None None] MFA Rules not processed for user `e2a9f6609e7a40a996b0baa071993ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:16.562750 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ddf31b82-19cf-4e0d-936b-17739cba7bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:16.573338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:16.680556 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1145/2272] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:16.700026 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc5559-196d-4702-b09f-883b44e745fb admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:16.700026 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-4ddc5559-196d-4702-b09f-883b44e745fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:16.765101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc5559-196d-4702-b09f-883b44e745fb admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:16.769666 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323a509-da24-497d-a112-2f11e62e0162 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:16.770278 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323a509-da24-497d-a112-2f11e62e0162 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:16.770601 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323a509-da24-497d-a112-2f11e62e0162 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:16.770876 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323a509-da24-497d-a112-2f11e62e0162 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:16.780811 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323a509-da24-497d-a112-2f11e62e0162 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:16.782255 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323a509-da24-497d-a112-2f11e62e0162 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:16.793122 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1128/2273] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:31:16 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:31:16.885129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf31b82-19cf-4e0d-936b-17739cba7bf7 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:16.895070 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf31b82-19cf-4e0d-936b-17739cba7bf7 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:16.899197 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53aa7d-d0e7-4206-8067-6482eadebd0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:16.900406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53aa7d-d0e7-4206-8067-6482eadebd0c service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:16.900691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53aa7d-d0e7-4206-8067-6482eadebd0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:16.900910 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53aa7d-d0e7-4206-8067-6482eadebd0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:16.964856 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53aa7d-d0e7-4206-8067-6482eadebd0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:16.966244 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53aa7d-d0e7-4206-8067-6482eadebd0c service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:16.975470 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1146/2274] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:31:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:31:17.353902 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323a509-da24-497d-a112-2f11e62e0162 service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:17.355374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d323a509-da24-497d-a112-2f11e62e0162 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:17.430239 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323a509-da24-497d-a112-2f11e62e0162 service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:17.435890 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a3b79-9f09-468e-86d1-12faf0c06db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:17.436551 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a3b79-9f09-468e-86d1-12faf0c06db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:17.436836 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a3b79-9f09-468e-86d1-12faf0c06db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:17.437106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a3b79-9f09-468e-86d1-12faf0c06db7 admin admin] PATH_INFO: `/v3/users/4aecb3faa58348cbb8d6c56b25928086` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:17.438285 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a3b79-9f09-468e-86d1-12faf0c06db7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aecb3faa58348cbb8d6c56b25928086)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:17.440265 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a3b79-9f09-468e-86d1-12faf0c06db7 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:17.501745 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b79a3b79-9f09-468e-86d1-12faf0c06db7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aecb3faa58348cbb8d6c56b25928086'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:17.502377 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b79a3b79-9f09-468e-86d1-12faf0c06db7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aecb3faa58348cbb8d6c56b25928086'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:17.519784 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b79a3b79-9f09-468e-86d1-12faf0c06db7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aecb3faa58348cbb8d6c56b25928086'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:17.530331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b79a3b79-9f09-468e-86d1-12faf0c06db7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aecb3faa58348cbb8d6c56b25928086'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:17.535175 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:17.545737 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b79a3b79-9f09-468e-86d1-12faf0c06db7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aecb3faa58348cbb8d6c56b25928086'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:17.554607 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1129/2275] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:31:17 2022] DELETE /identity/v3/users/4aecb3faa58348cbb8d6c56b25928086 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:17.562072 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561c331-a987-4a01-bf3d-54c2c651d4f0 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:17.562936 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561c331-a987-4a01-bf3d-54c2c651d4f0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:17.562936 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561c331-a987-4a01-bf3d-54c2c651d4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:17.585916 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-b561c331-a987-4a01-bf3d-54c2c651d4f0 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:17.587163 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b561c331-a987-4a01-bf3d-54c2c651d4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:17.651624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1147/2276] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:17.661650 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a3b79-9f09-468e-86d1-12faf0c06db7 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:17.663140 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b79a3b79-9f09-468e-86d1-12faf0c06db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:17.729967 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a3b79-9f09-468e-86d1-12faf0c06db7 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:17.735635 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f7887-4551-4af6-a60f-785c6d9221a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:17.736295 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f7887-4551-4af6-a60f-785c6d9221a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:17.736569 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f7887-4551-4af6-a60f-785c6d9221a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:17.736835 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f7887-4551-4af6-a60f-785c6d9221a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:17.749839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f7887-4551-4af6-a60f-785c6d9221a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:17.751969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f7887-4551-4af6-a60f-785c6d9221a8 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:17.763777 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1130/2277] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:31:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:31:18.707660 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561c331-a987-4a01-bf3d-54c2c651d4f0 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:18.709679 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b561c331-a987-4a01-bf3d-54c2c651d4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:18.734224 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561c331-a987-4a01-bf3d-54c2c651d4f0 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:18.740489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230d741-d21b-4e9b-8824-ec44eefec343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:18.746688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230d741-d21b-4e9b-8824-ec44eefec343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:18.747024 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230d741-d21b-4e9b-8824-ec44eefec343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:18.747337 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230d741-d21b-4e9b-8824-ec44eefec343 admin admin] PATH_INFO: `/v3/projects/ef9498674f1a4a7a832425b36d572fbc` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:18.752604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230d741-d21b-4e9b-8824-ec44eefec343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef9498674f1a4a7a832425b36d572fbc)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:18.754771 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230d741-d21b-4e9b-8824-ec44eefec343 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:18.821280 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:18.830662 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0230d741-d21b-4e9b-8824-ec44eefec343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef9498674f1a4a7a832425b36d572fbc', 'request_id': 'req-0230d741-d21b-4e9b-8824-ec44eefec343'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:18.836830 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0230d741-d21b-4e9b-8824-ec44eefec343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef9498674f1a4a7a832425b36d572fbc', 'request_id': 'req-0230d741-d21b-4e9b-8824-ec44eefec343'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:18.844927 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0230d741-d21b-4e9b-8824-ec44eefec343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef9498674f1a4a7a832425b36d572fbc', 'request_id': 'req-0230d741-d21b-4e9b-8824-ec44eefec343'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:18.861429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0230d741-d21b-4e9b-8824-ec44eefec343 admin admin] The token cache is being invalidate because project ef9498674f1a4a7a832425b36d572fbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:31:18.861722 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0230d741-d21b-4e9b-8824-ec44eefec343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:18.862445 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0230d741-d21b-4e9b-8824-ec44eefec343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:18.864122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1148/2278] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:31:18 2022] DELETE /identity/v3/projects/ef9498674f1a4a7a832425b36d572fbc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:31:18.870160 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da66a5-0147-49e8-ac82-4b1811df4754 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:18.870676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da66a5-0147-49e8-ac82-4b1811df4754 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:18.870676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da66a5-0147-49e8-ac82-4b1811df4754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:18.892011 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-86da66a5-0147-49e8-ac82-4b1811df4754 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:18.893229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-86da66a5-0147-49e8-ac82-4b1811df4754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:18.961276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1131/2279] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:31:18.971201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a598f-9fbb-4d54-8190-7c6d805b5f3a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:18.971483 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a598f-9fbb-4d54-8190-7c6d805b5f3a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:18.971785 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a598f-9fbb-4d54-8190-7c6d805b5f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:18.994344 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c04a598f-9fbb-4d54-8190-7c6d805b5f3a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:18.995593 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c04a598f-9fbb-4d54-8190-7c6d805b5f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:19.004439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1149/2280] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:19.008959 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da66a5-0147-49e8-ac82-4b1811df4754 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:19.019347 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da66a5-0147-49e8-ac82-4b1811df4754 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:19.024157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61d0d2-e348-4673-ba76-c7ddb39e086c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:19.025957 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61d0d2-e348-4673-ba76-c7ddb39e086c admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:19.026247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61d0d2-e348-4673-ba76-c7ddb39e086c admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:19.026552 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61d0d2-e348-4673-ba76-c7ddb39e086c admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:19.027189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61d0d2-e348-4673-ba76-c7ddb39e086c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:31:19.027497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61d0d2-e348-4673-ba76-c7ddb39e086c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:19.029179 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61d0d2-e348-4673-ba76-c7ddb39e086c admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:19.043225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1132/2281] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:31:19.047842 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a598f-9fbb-4d54-8190-7c6d805b5f3a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:19.057805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a598f-9fbb-4d54-8190-7c6d805b5f3a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:19.062780 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46cec9-2052-446c-87e2-c181b5a8604f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:19.063399 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46cec9-2052-446c-87e2-c181b5a8604f admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:19.063669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46cec9-2052-446c-87e2-c181b5a8604f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:19.063965 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46cec9-2052-446c-87e2-c181b5a8604f admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:19.064619 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46cec9-2052-446c-87e2-c181b5a8604f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:19.066860 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46cec9-2052-446c-87e2-c181b5a8604f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:19.098464 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1150/2282] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:31:19 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:31:19.103850 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61d0d2-e348-4673-ba76-c7ddb39e086c admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:19.114113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61d0d2-e348-4673-ba76-c7ddb39e086c admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:19.173497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02a8e1-1fda-4b10-b04a-ba91b9fe3de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:19.174015 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02a8e1-1fda-4b10-b04a-ba91b9fe3de1 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:19.174296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02a8e1-1fda-4b10-b04a-ba91b9fe3de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:19.174574 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02a8e1-1fda-4b10-b04a-ba91b9fe3de1 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:19.175205 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02a8e1-1fda-4b10-b04a-ba91b9fe3de1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:19.177175 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02a8e1-1fda-4b10-b04a-ba91b9fe3de1 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:19.201788 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1133/2283] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:31:19 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:31:19.205900 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46cec9-2052-446c-87e2-c181b5a8604f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:19.217232 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46cec9-2052-446c-87e2-c181b5a8604f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:19.223370 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa3fec-24cc-4ba3-80db-bcbb2d622ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:19.224138 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa3fec-24cc-4ba3-80db-bcbb2d622ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:19.224480 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa3fec-24cc-4ba3-80db-bcbb2d622ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:19.224754 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa3fec-24cc-4ba3-80db-bcbb2d622ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:19.225398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa3fec-24cc-4ba3-80db-bcbb2d622ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:19.227024 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa3fec-24cc-4ba3-80db-bcbb2d622ff4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:19.238954 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1151/2284] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:31:19.242999 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02a8e1-1fda-4b10-b04a-ba91b9fe3de1 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:19.254253 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02a8e1-1fda-4b10-b04a-ba91b9fe3de1 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:19.259467 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860dfe9e-78a5-473e-908d-c2228bd9c8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:19.260316 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dfe9e-78a5-473e-908d-c2228bd9c8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:19.260593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dfe9e-78a5-473e-908d-c2228bd9c8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:19.260859 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dfe9e-78a5-473e-908d-c2228bd9c8c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:19.261508 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860dfe9e-78a5-473e-908d-c2228bd9c8c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:19.263112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860dfe9e-78a5-473e-908d-c2228bd9c8c3 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:19.271965 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:19.277711 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1134/2285] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:31:19.281226 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa3fec-24cc-4ba3-80db-bcbb2d622ff4 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:19.292921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa3fec-24cc-4ba3-80db-bcbb2d622ff4 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:19.297884 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081899f-8729-4a41-90fe-026eee9a91f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:19.298624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081899f-8729-4a41-90fe-026eee9a91f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:19.298899 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081899f-8729-4a41-90fe-026eee9a91f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:19.299169 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081899f-8729-4a41-90fe-026eee9a91f1 admin admin] PATH_INFO: `/v3/projects/2ea35da7ec1d49fb97ed46a1605c5e9b/users/ae28125460924f15865118bc315552e7/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:19.328625 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081899f-8729-4a41-90fe-026eee9a91f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea35da7ec1d49fb97ed46a1605c5e9b, user_id=ae28125460924f15865118bc315552e7, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:19.331536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081899f-8729-4a41-90fe-026eee9a91f1 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:19.349316 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1152/2286] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:31:19 2022] PUT /identity/v3/projects/2ea35da7ec1d49fb97ed46a1605c5e9b/users/ae28125460924f15865118bc315552e7/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:19.354358 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dc4a2-25b1-4e07-bc0c-6caff668b459 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:19.354734 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dc4a2-25b1-4e07-bc0c-6caff668b459 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:19.355067 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dc4a2-25b1-4e07-bc0c-6caff668b459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:19.378280 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-b25dc4a2-25b1-4e07-bc0c-6caff668b459 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:19.379570 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b25dc4a2-25b1-4e07-bc0c-6caff668b459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:19.454495 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1135/2287] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:19.465433 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081899f-8729-4a41-90fe-026eee9a91f1 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:19.467295 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0081899f-8729-4a41-90fe-026eee9a91f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:19.528874 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081899f-8729-4a41-90fe-026eee9a91f1 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:19.532756 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b478e-5244-4bc9-b989-5373cdca6ea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:19.533375 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b478e-5244-4bc9-b989-5373cdca6ea6 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:19.533669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b478e-5244-4bc9-b989-5373cdca6ea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:19.533920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b478e-5244-4bc9-b989-5373cdca6ea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:19.545429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b478e-5244-4bc9-b989-5373cdca6ea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:19.547930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b478e-5244-4bc9-b989-5373cdca6ea6 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:19.559769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1153/2288] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:31:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:31:22.216210 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25dc4a2-25b1-4e07-bc0c-6caff668b459 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:22.217921 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b25dc4a2-25b1-4e07-bc0c-6caff668b459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:22.231533 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25dc4a2-25b1-4e07-bc0c-6caff668b459 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:22.238936 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841aece5-5fa6-4501-8575-7aaf321805b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:22.240475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841aece5-5fa6-4501-8575-7aaf321805b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:22.240761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841aece5-5fa6-4501-8575-7aaf321805b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:22.241033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841aece5-5fa6-4501-8575-7aaf321805b5 admin admin] PATH_INFO: `/v3/users/474af55044f54f81bedca1c51e9b4251` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:22.242303 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841aece5-5fa6-4501-8575-7aaf321805b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=474af55044f54f81bedca1c51e9b4251)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:22.244963 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841aece5-5fa6-4501-8575-7aaf321805b5 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:22.333208 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-841aece5-5fa6-4501-8575-7aaf321805b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '474af55044f54f81bedca1c51e9b4251'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:22.333893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-841aece5-5fa6-4501-8575-7aaf321805b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '474af55044f54f81bedca1c51e9b4251'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:22.352117 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-841aece5-5fa6-4501-8575-7aaf321805b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '474af55044f54f81bedca1c51e9b4251'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:22.377300 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-841aece5-5fa6-4501-8575-7aaf321805b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '474af55044f54f81bedca1c51e9b4251'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:22.387452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-841aece5-5fa6-4501-8575-7aaf321805b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '474af55044f54f81bedca1c51e9b4251'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:22.396240 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1136/2289] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:31:22 2022] DELETE /identity/v3/users/474af55044f54f81bedca1c51e9b4251 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:22.403062 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba57a8-e6f6-4a23-9975-597d114597a7 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:22.403596 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba57a8-e6f6-4a23-9975-597d114597a7 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:22.403596 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba57a8-e6f6-4a23-9975-597d114597a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:22.430199 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-b1ba57a8-e6f6-4a23-9975-597d114597a7 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:22.432630 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b1ba57a8-e6f6-4a23-9975-597d114597a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:22.568435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1154/2290] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:22.583962 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841aece5-5fa6-4501-8575-7aaf321805b5 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:22.585836 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-841aece5-5fa6-4501-8575-7aaf321805b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:22.758967 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841aece5-5fa6-4501-8575-7aaf321805b5 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:22.765508 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e611f3-a932-42e0-9ad0-3fa48a61a5e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:22.767055 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e611f3-a932-42e0-9ad0-3fa48a61a5e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:22.767534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e611f3-a932-42e0-9ad0-3fa48a61a5e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:22.768066 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e611f3-a932-42e0-9ad0-3fa48a61a5e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:22.782272 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e611f3-a932-42e0-9ad0-3fa48a61a5e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:22.784345 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e611f3-a932-42e0-9ad0-3fa48a61a5e8 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:22.824109 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1137/2291] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:31:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:31:22.979000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267ca12-b740-4a9a-96d2-47ad3a1a5427 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:22.979429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267ca12-b740-4a9a-96d2-47ad3a1a5427 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:22.980548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267ca12-b740-4a9a-96d2-47ad3a1a5427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:23.002069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:23.012669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-5267ca12-b740-4a9a-96d2-47ad3a1a5427 None None] MFA Rules not processed for user `0cc5cb5e634240159b537db9e27ec51c`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:23.014377 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5267ca12-b740-4a9a-96d2-47ad3a1a5427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:23.127643 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1155/2292] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:23.981368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e611f3-a932-42e0-9ad0-3fa48a61a5e8 service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:23.983980 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-92e611f3-a932-42e0-9ad0-3fa48a61a5e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:24.017168 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e611f3-a932-42e0-9ad0-3fa48a61a5e8 service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:24.024199 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478829fd-9db8-46aa-9ad0-3432f8ce1ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:24.026306 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478829fd-9db8-46aa-9ad0-3432f8ce1ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:24.026599 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478829fd-9db8-46aa-9ad0-3432f8ce1ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:24.026914 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478829fd-9db8-46aa-9ad0-3432f8ce1ff4 admin admin] PATH_INFO: `/v3/projects/21ee791f43204d4f84f5f5818a4f7199` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:24.028912 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478829fd-9db8-46aa-9ad0-3432f8ce1ff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21ee791f43204d4f84f5f5818a4f7199)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:24.031965 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478829fd-9db8-46aa-9ad0-3432f8ce1ff4 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:24.047011 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:24.128978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-478829fd-9db8-46aa-9ad0-3432f8ce1ff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21ee791f43204d4f84f5f5818a4f7199', 'request_id': 'req-478829fd-9db8-46aa-9ad0-3432f8ce1ff4'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:24.146561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-478829fd-9db8-46aa-9ad0-3432f8ce1ff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21ee791f43204d4f84f5f5818a4f7199', 'request_id': 'req-478829fd-9db8-46aa-9ad0-3432f8ce1ff4'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:24.161723 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-478829fd-9db8-46aa-9ad0-3432f8ce1ff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21ee791f43204d4f84f5f5818a4f7199', 'request_id': 'req-478829fd-9db8-46aa-9ad0-3432f8ce1ff4'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:24.184247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-478829fd-9db8-46aa-9ad0-3432f8ce1ff4 admin admin] The token cache is being invalidate because project 21ee791f43204d4f84f5f5818a4f7199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:31:24.184861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-478829fd-9db8-46aa-9ad0-3432f8ce1ff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:24.185927 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-478829fd-9db8-46aa-9ad0-3432f8ce1ff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:24.189459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1138/2293] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:31:23 2022] DELETE /identity/v3/projects/21ee791f43204d4f84f5f5818a4f7199 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:24.194904 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267ca12-b740-4a9a-96d2-47ad3a1a5427 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:24.217723 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267ca12-b740-4a9a-96d2-47ad3a1a5427 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:24.340620 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80b6c6-877c-4865-b9dd-dcfd9e3b49a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:24.340620 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80b6c6-877c-4865-b9dd-dcfd9e3b49a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:24.341366 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80b6c6-877c-4865-b9dd-dcfd9e3b49a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:24.342061 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80b6c6-877c-4865-b9dd-dcfd9e3b49a7 admin admin] PATH_INFO: `/v3/users/e2a9f6609e7a40a996b0baa071993ca4` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:24.347333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80b6c6-877c-4865-b9dd-dcfd9e3b49a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2a9f6609e7a40a996b0baa071993ca4)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:24.351445 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80b6c6-877c-4865-b9dd-dcfd9e3b49a7 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:24.467146 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-aa80b6c6-877c-4865-b9dd-dcfd9e3b49a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2a9f6609e7a40a996b0baa071993ca4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:24.468245 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-aa80b6c6-877c-4865-b9dd-dcfd9e3b49a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2a9f6609e7a40a996b0baa071993ca4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:24.487528 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-aa80b6c6-877c-4865-b9dd-dcfd9e3b49a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2a9f6609e7a40a996b0baa071993ca4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:24.532415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-aa80b6c6-877c-4865-b9dd-dcfd9e3b49a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2a9f6609e7a40a996b0baa071993ca4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:24.569386 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-aa80b6c6-877c-4865-b9dd-dcfd9e3b49a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2a9f6609e7a40a996b0baa071993ca4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:24.590505 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1156/2294] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:31:24 2022] DELETE /identity/v3/users/e2a9f6609e7a40a996b0baa071993ca4 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:25.200320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478829fd-9db8-46aa-9ad0-3432f8ce1ff4 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:25.201936 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-478829fd-9db8-46aa-9ad0-3432f8ce1ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:25.228281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478829fd-9db8-46aa-9ad0-3432f8ce1ff4 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:25.305998 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431ac4f-3908-4c09-9047-033f847c575d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:25.306926 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431ac4f-3908-4c09-9047-033f847c575d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:25.307415 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431ac4f-3908-4c09-9047-033f847c575d admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:25.307690 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431ac4f-3908-4c09-9047-033f847c575d admin admin] PATH_INFO: `/v3/projects/db218858d047496eac223fd5005406d5` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:25.309083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431ac4f-3908-4c09-9047-033f847c575d admin admin] RBAC: Authorizing `identity:delete_project(project_id=db218858d047496eac223fd5005406d5)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:25.311865 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431ac4f-3908-4c09-9047-033f847c575d admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:25.395453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-8431ac4f-3908-4c09-9047-033f847c575d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db218858d047496eac223fd5005406d5', 'request_id': 'req-8431ac4f-3908-4c09-9047-033f847c575d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:25.414772 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-8431ac4f-3908-4c09-9047-033f847c575d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db218858d047496eac223fd5005406d5', 'request_id': 'req-8431ac4f-3908-4c09-9047-033f847c575d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:25.436554 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-8431ac4f-3908-4c09-9047-033f847c575d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db218858d047496eac223fd5005406d5', 'request_id': 'req-8431ac4f-3908-4c09-9047-033f847c575d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:25.484130 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-8431ac4f-3908-4c09-9047-033f847c575d admin admin] The token cache is being invalidate because project db218858d047496eac223fd5005406d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:31:25.484532 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-8431ac4f-3908-4c09-9047-033f847c575d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:25.488558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-8431ac4f-3908-4c09-9047-033f847c575d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:25.504086 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1139/2295] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:31:25 2022] DELETE /identity/v3/projects/db218858d047496eac223fd5005406d5 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:25.510711 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f128ba-0105-402b-b63f-154c929e8375 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:25.511221 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f128ba-0105-402b-b63f-154c929e8375 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:25.511363 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f128ba-0105-402b-b63f-154c929e8375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:25.541980 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f3f128ba-0105-402b-b63f-154c929e8375 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:25.543896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f3f128ba-0105-402b-b63f-154c929e8375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:25.591407 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:25.649717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1157/2296] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:25.657859 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518c050-0f82-47b3-9379-9e5d26561a6f None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:25.658153 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518c050-0f82-47b3-9379-9e5d26561a6f None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:25.658420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518c050-0f82-47b3-9379-9e5d26561a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:25.691412 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-3518c050-0f82-47b3-9379-9e5d26561a6f None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:25.692835 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-3518c050-0f82-47b3-9379-9e5d26561a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:25.709532 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1140/2297] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:25.714420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f128ba-0105-402b-b63f-154c929e8375 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:25.729645 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f128ba-0105-402b-b63f-154c929e8375 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:25.736936 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe238dc-5c11-499a-843e-6fa950a00079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:25.737698 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe238dc-5c11-499a-843e-6fa950a00079 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:25.737860 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe238dc-5c11-499a-843e-6fa950a00079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:25.738117 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe238dc-5c11-499a-843e-6fa950a00079 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:25.739072 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe238dc-5c11-499a-843e-6fa950a00079 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:31:25.739209 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe238dc-5c11-499a-843e-6fa950a00079 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:25.740997 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe238dc-5c11-499a-843e-6fa950a00079 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:25.763934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1158/2298] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:31:25.768029 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518c050-0f82-47b3-9379-9e5d26561a6f None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:25.783339 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518c050-0f82-47b3-9379-9e5d26561a6f None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:25.789796 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93a6e9-188f-464b-9635-33970ce1724d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:25.791150 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93a6e9-188f-464b-9635-33970ce1724d admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:25.791437 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93a6e9-188f-464b-9635-33970ce1724d admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:25.791908 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93a6e9-188f-464b-9635-33970ce1724d admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:25.792639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93a6e9-188f-464b-9635-33970ce1724d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:25.806756 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93a6e9-188f-464b-9635-33970ce1724d admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:25.834400 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:25.877053 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1141/2299] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:31:25 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:31:25.878993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe238dc-5c11-499a-843e-6fa950a00079 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:25.898784 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe238dc-5c11-499a-843e-6fa950a00079 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:26.052072 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ad277-3710-4ede-ae3a-20f7c4e33b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:26.054234 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ad277-3710-4ede-ae3a-20f7c4e33b8f admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:26.054357 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ad277-3710-4ede-ae3a-20f7c4e33b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:26.054587 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ad277-3710-4ede-ae3a-20f7c4e33b8f admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:26.055415 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ad277-3710-4ede-ae3a-20f7c4e33b8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:26.057504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ad277-3710-4ede-ae3a-20f7c4e33b8f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:26.088403 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1159/2300] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:31:25 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:31:26.092893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93a6e9-188f-464b-9635-33970ce1724d admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:26.119767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93a6e9-188f-464b-9635-33970ce1724d admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:26.125590 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f672300-014f-43ae-a462-d0a192f244b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:26.126232 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f672300-014f-43ae-a462-d0a192f244b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:26.126506 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f672300-014f-43ae-a462-d0a192f244b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:26.126775 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f672300-014f-43ae-a462-d0a192f244b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:26.127440 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f672300-014f-43ae-a462-d0a192f244b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:26.129542 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f672300-014f-43ae-a462-d0a192f244b8 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:26.147964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1142/2301] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:31:26.152483 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ad277-3710-4ede-ae3a-20f7c4e33b8f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:26.170704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ad277-3710-4ede-ae3a-20f7c4e33b8f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:26.179112 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dce5f5-a1ce-4427-8d1a-de7abbebe24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:26.179828 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dce5f5-a1ce-4427-8d1a-de7abbebe24d admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:26.180111 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dce5f5-a1ce-4427-8d1a-de7abbebe24d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:26.180919 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dce5f5-a1ce-4427-8d1a-de7abbebe24d admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:26.181868 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dce5f5-a1ce-4427-8d1a-de7abbebe24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:26.183538 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dce5f5-a1ce-4427-8d1a-de7abbebe24d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:26.215057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1160/2302] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:31:26.216747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f672300-014f-43ae-a462-d0a192f244b8 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:26.231417 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f672300-014f-43ae-a462-d0a192f244b8 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:26.238378 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7914b95-f8eb-4006-aedd-7a45e816c330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:26.239206 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7914b95-f8eb-4006-aedd-7a45e816c330 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:26.239549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7914b95-f8eb-4006-aedd-7a45e816c330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:26.240042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7914b95-f8eb-4006-aedd-7a45e816c330 admin admin] PATH_INFO: `/v3/projects/b9b73545f9b64812aa961a17fe0bc16f/users/e14a7b98b4b5487db00d06a409e2c104/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:26.265217 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7914b95-f8eb-4006-aedd-7a45e816c330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b73545f9b64812aa961a17fe0bc16f, user_id=e14a7b98b4b5487db00d06a409e2c104, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:26.268479 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7914b95-f8eb-4006-aedd-7a45e816c330 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:26.298773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1143/2303] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:31:26 2022] PUT /identity/v3/projects/b9b73545f9b64812aa961a17fe0bc16f/users/e14a7b98b4b5487db00d06a409e2c104/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:31:26.301097 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943baa45-8da9-49e4-961b-6ac069ee6f49 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:26.301381 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943baa45-8da9-49e4-961b-6ac069ee6f49 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:26.301654 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943baa45-8da9-49e4-961b-6ac069ee6f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:26.346866 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-943baa45-8da9-49e4-961b-6ac069ee6f49 None None] MFA Rules not processed for user `e14a7b98b4b5487db00d06a409e2c104`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:26.348732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-943baa45-8da9-49e4-961b-6ac069ee6f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:26.501990 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1161/2304] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:26.518014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7914b95-f8eb-4006-aedd-7a45e816c330 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:26.520246 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e7914b95-f8eb-4006-aedd-7a45e816c330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:26.704496 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7914b95-f8eb-4006-aedd-7a45e816c330 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:26.708610 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a90fe-f6a1-4c77-b987-54a87bdafa22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:26.709397 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a90fe-f6a1-4c77-b987-54a87bdafa22 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:26.709825 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a90fe-f6a1-4c77-b987-54a87bdafa22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:26.710243 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a90fe-f6a1-4c77-b987-54a87bdafa22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:26.723229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a90fe-f6a1-4c77-b987-54a87bdafa22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:26.725295 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a90fe-f6a1-4c77-b987-54a87bdafa22 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:26.737287 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1144/2305] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:31:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:31:26.773144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943baa45-8da9-49e4-961b-6ac069ee6f49 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:26.831114 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:26.905417 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943baa45-8da9-49e4-961b-6ac069ee6f49 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:26.910739 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a6719-9e4e-4804-bb37-199689d17730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:26.911462 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a6719-9e4e-4804-bb37-199689d17730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:26.912292 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a6719-9e4e-4804-bb37-199689d17730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:26.912472 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a6719-9e4e-4804-bb37-199689d17730 admin admin] PATH_INFO: `/v3/users/e14a7b98b4b5487db00d06a409e2c104` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:26.914040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a6719-9e4e-4804-bb37-199689d17730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e14a7b98b4b5487db00d06a409e2c104)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:26.917329 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a6719-9e4e-4804-bb37-199689d17730 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:27.017891 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-655a6719-9e4e-4804-bb37-199689d17730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e14a7b98b4b5487db00d06a409e2c104'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:27.019925 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-655a6719-9e4e-4804-bb37-199689d17730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e14a7b98b4b5487db00d06a409e2c104'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:27.031384 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-655a6719-9e4e-4804-bb37-199689d17730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e14a7b98b4b5487db00d06a409e2c104'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:27.061585 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-655a6719-9e4e-4804-bb37-199689d17730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e14a7b98b4b5487db00d06a409e2c104'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:27.071150 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-655a6719-9e4e-4804-bb37-199689d17730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e14a7b98b4b5487db00d06a409e2c104'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:27.090640 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1162/2306] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:31:26 2022] DELETE /identity/v3/users/e14a7b98b4b5487db00d06a409e2c104 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:27.095043 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802b13a-e4cd-4a6d-8f86-0c753b9a5178 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:27.095306 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802b13a-e4cd-4a6d-8f86-0c753b9a5178 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:27.095579 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802b13a-e4cd-4a6d-8f86-0c753b9a5178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:27.125121 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-5802b13a-e4cd-4a6d-8f86-0c753b9a5178 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:27.126328 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-5802b13a-e4cd-4a6d-8f86-0c753b9a5178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:27.248139 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1145/2307] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:27.255064 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a6719-9e4e-4804-bb37-199689d17730 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:27.257268 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-655a6719-9e4e-4804-bb37-199689d17730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:27.336158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a6719-9e4e-4804-bb37-199689d17730 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:27.341614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d0e00-b39a-43cd-9341-76fa4bcf8cad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:27.342877 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d0e00-b39a-43cd-9341-76fa4bcf8cad service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:27.343157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d0e00-b39a-43cd-9341-76fa4bcf8cad service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:27.343429 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d0e00-b39a-43cd-9341-76fa4bcf8cad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:27.354488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d0e00-b39a-43cd-9341-76fa4bcf8cad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:27.356143 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d0e00-b39a-43cd-9341-76fa4bcf8cad service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:27.369025 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1163/2308] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:31:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:31:27.826885 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802b13a-e4cd-4a6d-8f86-0c753b9a5178 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:27.834818 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-5802b13a-e4cd-4a6d-8f86-0c753b9a5178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:27.874088 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802b13a-e4cd-4a6d-8f86-0c753b9a5178 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:27.886967 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1052677-61bb-431c-b4cc-d326cd147622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:27.888533 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1052677-61bb-431c-b4cc-d326cd147622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:27.889032 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1052677-61bb-431c-b4cc-d326cd147622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:27.889786 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1052677-61bb-431c-b4cc-d326cd147622 admin admin] PATH_INFO: `/v3/projects/b9b73545f9b64812aa961a17fe0bc16f` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:27.892544 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1052677-61bb-431c-b4cc-d326cd147622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b73545f9b64812aa961a17fe0bc16f)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:27.896957 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1052677-61bb-431c-b4cc-d326cd147622 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:27.984965 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c1052677-61bb-431c-b4cc-d326cd147622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b73545f9b64812aa961a17fe0bc16f', 'request_id': 'req-c1052677-61bb-431c-b4cc-d326cd147622'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:27.995360 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c1052677-61bb-431c-b4cc-d326cd147622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b73545f9b64812aa961a17fe0bc16f', 'request_id': 'req-c1052677-61bb-431c-b4cc-d326cd147622'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:28.006102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c1052677-61bb-431c-b4cc-d326cd147622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b73545f9b64812aa961a17fe0bc16f', 'request_id': 'req-c1052677-61bb-431c-b4cc-d326cd147622'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:28.010675 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:28.032656 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c1052677-61bb-431c-b4cc-d326cd147622 admin admin] The token cache is being invalidate because project b9b73545f9b64812aa961a17fe0bc16f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:31:28.033449 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c1052677-61bb-431c-b4cc-d326cd147622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:28.034761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c1052677-61bb-431c-b4cc-d326cd147622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:28.037045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1146/2309] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:31:27 2022] DELETE /identity/v3/projects/b9b73545f9b64812aa961a17fe0bc16f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:28.044138 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8295df-2d04-4b6a-807e-8ac57f54cf72 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:28.044689 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8295df-2d04-4b6a-807e-8ac57f54cf72 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:28.044781 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8295df-2d04-4b6a-807e-8ac57f54cf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:28.072578 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-1f8295df-2d04-4b6a-807e-8ac57f54cf72 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:28.073956 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1f8295df-2d04-4b6a-807e-8ac57f54cf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:28.127995 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:28.147256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1164/2310] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:31:28.163967 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99468822-f12d-4733-93b6-d94d47d92336 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:28.164243 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99468822-f12d-4733-93b6-d94d47d92336 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:28.164518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99468822-f12d-4733-93b6-d94d47d92336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:28.187946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-99468822-f12d-4733-93b6-d94d47d92336 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:28.188825 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-99468822-f12d-4733-93b6-d94d47d92336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:28.205870 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1147/2311] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:28.208228 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8295df-2d04-4b6a-807e-8ac57f54cf72 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:28.220436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8295df-2d04-4b6a-807e-8ac57f54cf72 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:28.258306 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ab98a-40de-40a6-9972-2dd02f207764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:28.261032 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ab98a-40de-40a6-9972-2dd02f207764 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:28.261318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ab98a-40de-40a6-9972-2dd02f207764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:28.261600 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ab98a-40de-40a6-9972-2dd02f207764 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:28.262325 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ab98a-40de-40a6-9972-2dd02f207764 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:31:28.262651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ab98a-40de-40a6-9972-2dd02f207764 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:28.265307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ab98a-40de-40a6-9972-2dd02f207764 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:28.292887 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1165/2312] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:31:28.297301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99468822-f12d-4733-93b6-d94d47d92336 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:28.310014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99468822-f12d-4733-93b6-d94d47d92336 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:28.316243 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321ad8b-c422-46e0-b9ab-e8e23515d382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:28.316896 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321ad8b-c422-46e0-b9ab-e8e23515d382 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:28.317236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321ad8b-c422-46e0-b9ab-e8e23515d382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:28.317507 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321ad8b-c422-46e0-b9ab-e8e23515d382 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:28.318348 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321ad8b-c422-46e0-b9ab-e8e23515d382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:28.321469 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321ad8b-c422-46e0-b9ab-e8e23515d382 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:28.352880 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1148/2313] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:31:28 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:31:28.366301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ab98a-40de-40a6-9972-2dd02f207764 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:28.404789 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ab98a-40de-40a6-9972-2dd02f207764 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:28.543188 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01425b3f-471c-4942-986d-9f58c5d32d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:28.544113 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01425b3f-471c-4942-986d-9f58c5d32d95 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:28.544499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01425b3f-471c-4942-986d-9f58c5d32d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:28.544956 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01425b3f-471c-4942-986d-9f58c5d32d95 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:28.545739 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01425b3f-471c-4942-986d-9f58c5d32d95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:28.548272 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01425b3f-471c-4942-986d-9f58c5d32d95 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:28.599826 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1166/2314] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:31:28 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:31:28.603446 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321ad8b-c422-46e0-b9ab-e8e23515d382 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:28.622064 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321ad8b-c422-46e0-b9ab-e8e23515d382 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:28.636419 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3cc68-20ce-49c6-9153-a22664f6ec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:28.637335 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3cc68-20ce-49c6-9153-a22664f6ec6e admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:28.637822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3cc68-20ce-49c6-9153-a22664f6ec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:28.638300 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3cc68-20ce-49c6-9153-a22664f6ec6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:28.639339 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3cc68-20ce-49c6-9153-a22664f6ec6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:28.641285 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3cc68-20ce-49c6-9153-a22664f6ec6e admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:28.668013 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1149/2315] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:31:28.673235 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01425b3f-471c-4942-986d-9f58c5d32d95 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:28.690343 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01425b3f-471c-4942-986d-9f58c5d32d95 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:28.698596 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618efa8-df47-4416-9833-22b3741d8694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:28.700364 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618efa8-df47-4416-9833-22b3741d8694 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:28.700650 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618efa8-df47-4416-9833-22b3741d8694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:28.702212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618efa8-df47-4416-9833-22b3741d8694 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:28.702212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618efa8-df47-4416-9833-22b3741d8694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:28.704359 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618efa8-df47-4416-9833-22b3741d8694 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:28.723808 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1167/2316] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:31:28.727310 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3cc68-20ce-49c6-9153-a22664f6ec6e admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:28.765014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3cc68-20ce-49c6-9153-a22664f6ec6e admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:28.795345 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ebc65-4d0a-4dfd-b0cb-bb02d800bae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:28.799240 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ebc65-4d0a-4dfd-b0cb-bb02d800bae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:28.800141 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ebc65-4d0a-4dfd-b0cb-bb02d800bae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:28.801954 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ebc65-4d0a-4dfd-b0cb-bb02d800bae3 admin admin] PATH_INFO: `/v3/projects/846669bb3afe4acd962f6d1e3428c887/users/f9a7abc93f614a76ab2660fdecf35062/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:28.902448 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ebc65-4d0a-4dfd-b0cb-bb02d800bae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=846669bb3afe4acd962f6d1e3428c887, user_id=f9a7abc93f614a76ab2660fdecf35062, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:28.911229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ebc65-4d0a-4dfd-b0cb-bb02d800bae3 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:28.949217 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1150/2317] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:31:28 2022] PUT /identity/v3/projects/846669bb3afe4acd962f6d1e3428c887/users/f9a7abc93f614a76ab2660fdecf35062/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:28.967592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701f5f6-87d7-415a-95b8-d03f0aa382c1 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:28.968081 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701f5f6-87d7-415a-95b8-d03f0aa382c1 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:28.968401 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701f5f6-87d7-415a-95b8-d03f0aa382c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:29.041329 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-4701f5f6-87d7-415a-95b8-d03f0aa382c1 None None] MFA Rules not processed for user `f9a7abc93f614a76ab2660fdecf35062`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:29.042945 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4701f5f6-87d7-415a-95b8-d03f0aa382c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:29.164035 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b326c9f-9be7-4b92-ae6f-5e593b0973b0 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:29.172302 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b326c9f-9be7-4b92-ae6f-5e593b0973b0 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:29.173203 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b326c9f-9be7-4b92-ae6f-5e593b0973b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:29.202438 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1168/2318] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:29.235755 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701f5f6-87d7-415a-95b8-d03f0aa382c1 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:29.238032 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4701f5f6-87d7-415a-95b8-d03f0aa382c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:29.324692 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-6b326c9f-9be7-4b92-ae6f-5e593b0973b0 None None] MFA Rules not processed for user `ae28125460924f15865118bc315552e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:29.325948 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-6b326c9f-9be7-4b92-ae6f-5e593b0973b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:29.416508 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:29.489941 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701f5f6-87d7-415a-95b8-d03f0aa382c1 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:29.500508 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937e7af-ff53-4e6f-8a84-0429a3a2e82a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '289b020c9cd242dca9b512803199daae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:29.501152 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937e7af-ff53-4e6f-8a84-0429a3a2e82a service glance] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:29.501431 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937e7af-ff53-4e6f-8a84-0429a3a2e82a service glance] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:29.501734 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937e7af-ff53-4e6f-8a84-0429a3a2e82a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:29.512907 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937e7af-ff53-4e6f-8a84-0429a3a2e82a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:29.514440 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937e7af-ff53-4e6f-8a84-0429a3a2e82a service glance] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:29.526426 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1169/2319] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:31:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:31:29.534440 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1151/2320] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:29.539189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937e7af-ff53-4e6f-8a84-0429a3a2e82a service glance] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:29.541960 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3937e7af-ff53-4e6f-8a84-0429a3a2e82a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:29.667686 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937e7af-ff53-4e6f-8a84-0429a3a2e82a service glance] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:29.675428 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b7a87-3c0a-4fa4-b24c-a7393195414c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:29.676083 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b7a87-3c0a-4fa4-b24c-a7393195414c admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:29.676364 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b7a87-3c0a-4fa4-b24c-a7393195414c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:29.676634 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b7a87-3c0a-4fa4-b24c-a7393195414c admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:29.677305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b7a87-3c0a-4fa4-b24c-a7393195414c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:29.681032 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b7a87-3c0a-4fa4-b24c-a7393195414c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:29.755642 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1170/2321] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:31:29 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:31:29.759843 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b326c9f-9be7-4b92-ae6f-5e593b0973b0 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:29.781840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b326c9f-9be7-4b92-ae6f-5e593b0973b0 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:29.904891 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb611e-5f72-427a-9993-f28b93aec983 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:29.906078 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb611e-5f72-427a-9993-f28b93aec983 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:29.906742 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb611e-5f72-427a-9993-f28b93aec983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:29.948141 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e2cb611e-5f72-427a-9993-f28b93aec983 None None] MFA Rules not processed for user `c5dc12a8bc2b406b8a148bf609d5d2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:29.951365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e2cb611e-5f72-427a-9993-f28b93aec983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:29.951820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ac431-e031-4f4e-aead-28a4f8dc6934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:29.952434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ac431-e031-4f4e-aead-28a4f8dc6934 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:29.952720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ac431-e031-4f4e-aead-28a4f8dc6934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:29.952994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ac431-e031-4f4e-aead-28a4f8dc6934 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:29.953993 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ac431-e031-4f4e-aead-28a4f8dc6934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:29.962214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ac431-e031-4f4e-aead-28a4f8dc6934 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:30.016499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1152/2322] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:31:29 2022] POST /identity/v3/users => generated 299 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:31:30.017503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ac431-e031-4f4e-aead-28a4f8dc6934 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:30.036108 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ac431-e031-4f4e-aead-28a4f8dc6934 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:30.047833 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8dd8d-6746-4cd7-ae28-13ffc37b9e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:30.049109 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8dd8d-6746-4cd7-ae28-13ffc37b9e53 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:30.049579 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8dd8d-6746-4cd7-ae28-13ffc37b9e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:30.050186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8dd8d-6746-4cd7-ae28-13ffc37b9e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:30.051288 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8dd8d-6746-4cd7-ae28-13ffc37b9e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:30.055970 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8dd8d-6746-4cd7-ae28-13ffc37b9e53 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:30.059485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:30.096889 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1153/2323] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:31:30.101140 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8dd8d-6746-4cd7-ae28-13ffc37b9e53 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:30.113796 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8dd8d-6746-4cd7-ae28-13ffc37b9e53 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:30.115409 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1171/2324] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Oct 4 14:31:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:31:30.127143 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dacacf-17e8-42d6-96c1-35e3cee846bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:30.127952 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dacacf-17e8-42d6-96c1-35e3cee846bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:30.128309 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dacacf-17e8-42d6-96c1-35e3cee846bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:30.128660 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dacacf-17e8-42d6-96c1-35e3cee846bf admin admin] PATH_INFO: `/v3/projects/8182836bb15b4db8b19052fe741477eb/users/8d210a60575144b5adbd552dd792f89a/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:30.159757 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dacacf-17e8-42d6-96c1-35e3cee846bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8182836bb15b4db8b19052fe741477eb, user_id=8d210a60575144b5adbd552dd792f89a, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:30.165441 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dacacf-17e8-42d6-96c1-35e3cee846bf admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:30.185940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb611e-5f72-427a-9993-f28b93aec983 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:30.188626 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e2cb611e-5f72-427a-9993-f28b93aec983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:30.199181 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1154/2325] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:31:30 2022] PUT /identity/v3/projects/8182836bb15b4db8b19052fe741477eb/users/8d210a60575144b5adbd552dd792f89a/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:31:30.208189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dacacf-17e8-42d6-96c1-35e3cee846bf admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:30.330947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:30.356850 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dacacf-17e8-42d6-96c1-35e3cee846bf admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:30.366564 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb611e-5f72-427a-9993-f28b93aec983 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:30.371219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82641318-c109-4d8e-a0d4-d28cfe75e73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:30.371895 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82641318-c109-4d8e-a0d4-d28cfe75e73d admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:30.372178 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82641318-c109-4d8e-a0d4-d28cfe75e73d admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:30.374730 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82641318-c109-4d8e-a0d4-d28cfe75e73d admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:30.375523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82641318-c109-4d8e-a0d4-d28cfe75e73d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:30.377335 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82641318-c109-4d8e-a0d4-d28cfe75e73d admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:30.416065 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1155/2326] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:31:30.420841 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82641318-c109-4d8e-a0d4-d28cfe75e73d admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:30.444717 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82641318-c109-4d8e-a0d4-d28cfe75e73d admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:30.455748 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1b2e6-58a2-49ad-85af-989b7bd2655a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:30.457157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1b2e6-58a2-49ad-85af-989b7bd2655a admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:30.457723 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1b2e6-58a2-49ad-85af-989b7bd2655a admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:30.458524 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1b2e6-58a2-49ad-85af-989b7bd2655a admin admin] PATH_INFO: `/v3/projects/8182836bb15b4db8b19052fe741477eb/users/8d210a60575144b5adbd552dd792f89a/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:30.464099 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1b2e6-58a2-49ad-85af-989b7bd2655a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8182836bb15b4db8b19052fe741477eb, user_id=8d210a60575144b5adbd552dd792f89a, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:30.468671 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1b2e6-58a2-49ad-85af-989b7bd2655a admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:30.483927 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1156/2327] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:31:30 2022] PUT /identity/v3/projects/8182836bb15b4db8b19052fe741477eb/users/8d210a60575144b5adbd552dd792f89a/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:30.607213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e6841-2a11-437e-a0c8-9b90dda097b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4860d5958e724e568576a9067290a27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:30.624308 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e6841-2a11-437e-a0c8-9b90dda097b7 service swift] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:30.624617 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e6841-2a11-437e-a0c8-9b90dda097b7 service swift] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:30.624893 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e6841-2a11-437e-a0c8-9b90dda097b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:30.803374 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e6841-2a11-437e-a0c8-9b90dda097b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:30.805531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e6841-2a11-437e-a0c8-9b90dda097b7 service swift] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:30.818921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1172/2328] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Oct 4 14:31:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 14:31:31.979204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2312d-4529-4a2f-a2cc-1fb0af7d9aec None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:31.980339 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2312d-4529-4a2f-a2cc-1fb0af7d9aec None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:31.980829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2312d-4529-4a2f-a2cc-1fb0af7d9aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:32.020913 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-90d2312d-4529-4a2f-a2cc-1fb0af7d9aec None None] MFA Rules not processed for user `c5dc12a8bc2b406b8a148bf609d5d2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:32.023247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-90d2312d-4529-4a2f-a2cc-1fb0af7d9aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:32.210034 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1157/2329] 10.222.0.62 () {58 vars in 967 bytes} [Tue Oct 4 14:31:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:31:32.231826 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e6841-2a11-437e-a0c8-9b90dda097b7 service swift] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:32.259351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e6841-2a11-437e-a0c8-9b90dda097b7 service swift] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:32.410226 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0619ab7-9131-4619-a5c3-65ba75b76ad6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4860d5958e724e568576a9067290a27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:32.411155 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0619ab7-9131-4619-a5c3-65ba75b76ad6 service swift] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:32.415832 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0619ab7-9131-4619-a5c3-65ba75b76ad6 service swift] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:32.416468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0619ab7-9131-4619-a5c3-65ba75b76ad6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:32.437941 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0619ab7-9131-4619-a5c3-65ba75b76ad6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:32.440459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0619ab7-9131-4619-a5c3-65ba75b76ad6 service swift] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:32.458923 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1173/2330] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Oct 4 14:31:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 14:31:33.107207 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f3c00-8826-426a-a69c-22312aedbc04 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:33.108200 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f3c00-8826-426a-a69c-22312aedbc04 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:33.109619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f3c00-8826-426a-a69c-22312aedbc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:33.157527 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-830f3c00-8826-426a-a69c-22312aedbc04 None None] MFA Rules not processed for user `c5dc12a8bc2b406b8a148bf609d5d2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:33.159873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-830f3c00-8826-426a-a69c-22312aedbc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:33.172819 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1158/2331] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Oct 4 14:31:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:33.191108 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0619ab7-9131-4619-a5c3-65ba75b76ad6 service swift] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:33.206439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0619ab7-9131-4619-a5c3-65ba75b76ad6 service swift] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:33.216754 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1b6b4-9af9-4d0a-899c-9de4fe49e7c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4860d5958e724e568576a9067290a27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:33.217477 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1b6b4-9af9-4d0a-899c-9de4fe49e7c1 service swift] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:33.218287 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1b6b4-9af9-4d0a-899c-9de4fe49e7c1 service swift] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:33.218763 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1b6b4-9af9-4d0a-899c-9de4fe49e7c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:33.238229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1b6b4-9af9-4d0a-899c-9de4fe49e7c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:33.240972 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1b6b4-9af9-4d0a-899c-9de4fe49e7c1 service swift] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:33.254970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1174/2332] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Oct 4 14:31:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 14:31:34.020076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313a68d-c797-4a3b-9a78-ce381517c26b None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:34.020290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313a68d-c797-4a3b-9a78-ce381517c26b None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:34.020513 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313a68d-c797-4a3b-9a78-ce381517c26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:34.074414 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-4313a68d-c797-4a3b-9a78-ce381517c26b None None] MFA Rules not processed for user `c5dc12a8bc2b406b8a148bf609d5d2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:34.075657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-4313a68d-c797-4a3b-9a78-ce381517c26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:34.084378 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1159/2333] 10.222.0.62 () {58 vars in 967 bytes} [Tue Oct 4 14:31:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:34.106533 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1b6b4-9af9-4d0a-899c-9de4fe49e7c1 service swift] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:34.121177 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1b6b4-9af9-4d0a-899c-9de4fe49e7c1 service swift] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:34.128977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98120e2c-5d92-4ea2-90cc-6f5140c948a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4860d5958e724e568576a9067290a27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:34.129758 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98120e2c-5d92-4ea2-90cc-6f5140c948a9 service swift] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:34.130104 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98120e2c-5d92-4ea2-90cc-6f5140c948a9 service swift] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:34.130451 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98120e2c-5d92-4ea2-90cc-6f5140c948a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:34.150369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98120e2c-5d92-4ea2-90cc-6f5140c948a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:34.152435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98120e2c-5d92-4ea2-90cc-6f5140c948a9 service swift] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:34.183063 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1175/2334] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Oct 4 14:31:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 14:31:37.254370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313a68d-c797-4a3b-9a78-ce381517c26b None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:37.256725 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-4313a68d-c797-4a3b-9a78-ce381517c26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:37.332110 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:37.363103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313a68d-c797-4a3b-9a78-ce381517c26b None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:37.369294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f738a-363f-4d2b-ad29-4f3bc9f1a64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:37.370369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f738a-363f-4d2b-ad29-4f3bc9f1a64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:37.371651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f738a-363f-4d2b-ad29-4f3bc9f1a64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:37.372264 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f738a-363f-4d2b-ad29-4f3bc9f1a64c admin admin] PATH_INFO: `/v3/users/cc43e930a6ca4e969c1d3bce095dcac6` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:37.374042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f738a-363f-4d2b-ad29-4f3bc9f1a64c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc43e930a6ca4e969c1d3bce095dcac6)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:37.376558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f738a-363f-4d2b-ad29-4f3bc9f1a64c admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:37.494402 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-886f738a-363f-4d2b-ad29-4f3bc9f1a64c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc43e930a6ca4e969c1d3bce095dcac6'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:37.496588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-886f738a-363f-4d2b-ad29-4f3bc9f1a64c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc43e930a6ca4e969c1d3bce095dcac6'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:37.563866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-886f738a-363f-4d2b-ad29-4f3bc9f1a64c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc43e930a6ca4e969c1d3bce095dcac6'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:37.594996 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-886f738a-363f-4d2b-ad29-4f3bc9f1a64c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc43e930a6ca4e969c1d3bce095dcac6'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:37.627057 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-886f738a-363f-4d2b-ad29-4f3bc9f1a64c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc43e930a6ca4e969c1d3bce095dcac6'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:37.641443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1160/2335] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:31:37 2022] DELETE /identity/v3/users/cc43e930a6ca4e969c1d3bce095dcac6 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:37.647355 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83f14d-adbf-453e-aece-13ecf8efb6ce None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:37.649385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83f14d-adbf-453e-aece-13ecf8efb6ce None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:37.650143 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83f14d-adbf-453e-aece-13ecf8efb6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:37.679630 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:37.707944 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-3f83f14d-adbf-453e-aece-13ecf8efb6ce None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:37.710121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3f83f14d-adbf-453e-aece-13ecf8efb6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:37.833818 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1176/2336] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:37.847173 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f738a-363f-4d2b-ad29-4f3bc9f1a64c admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:37.848588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-886f738a-363f-4d2b-ad29-4f3bc9f1a64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:37.943593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f738a-363f-4d2b-ad29-4f3bc9f1a64c admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:37.947656 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f374a63-b772-4fdc-b44b-11f8b8032abc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:37.949234 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f374a63-b772-4fdc-b44b-11f8b8032abc service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:37.949234 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f374a63-b772-4fdc-b44b-11f8b8032abc service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:37.949538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f374a63-b772-4fdc-b44b-11f8b8032abc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:37.960007 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f374a63-b772-4fdc-b44b-11f8b8032abc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:37.962122 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f374a63-b772-4fdc-b44b-11f8b8032abc service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:37.973586 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d909386-f4b5-4583-a9e7-47982246f8a7 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:37.974209 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d909386-f4b5-4583-a9e7-47982246f8a7 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:37.974848 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d909386-f4b5-4583-a9e7-47982246f8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:37.975542 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1161/2337] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:31:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:31:38.011623 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-2d909386-f4b5-4583-a9e7-47982246f8a7 None None] MFA Rules not processed for user `8d210a60575144b5adbd552dd792f89a`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:38.013944 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2d909386-f4b5-4583-a9e7-47982246f8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:38.131793 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1177/2338] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:31:38.145700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f374a63-b772-4fdc-b44b-11f8b8032abc service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:38.147122 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-4f374a63-b772-4fdc-b44b-11f8b8032abc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:38.224979 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f374a63-b772-4fdc-b44b-11f8b8032abc service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:38.229902 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466e40b-f8f7-48b0-bc5f-e0736174f714 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '289b020c9cd242dca9b512803199daae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:38.230637 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466e40b-f8f7-48b0-bc5f-e0736174f714 service glance] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:38.230954 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466e40b-f8f7-48b0-bc5f-e0736174f714 service glance] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:38.231278 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466e40b-f8f7-48b0-bc5f-e0736174f714 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:38.233492 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-0466e40b-f8f7-48b0-bc5f-e0736174f714 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:38.241478 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d909386-f4b5-4583-a9e7-47982246f8a7 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:38.243813 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2d909386-f4b5-4583-a9e7-47982246f8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:38.264258 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:38.266048 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d909386-f4b5-4583-a9e7-47982246f8a7 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:38.273331 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11233e69-b89c-446e-8977-d8f2753cb1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:38.273981 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11233e69-b89c-446e-8977-d8f2753cb1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:38.274371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11233e69-b89c-446e-8977-d8f2753cb1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:38.274688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11233e69-b89c-446e-8977-d8f2753cb1bf admin admin] PATH_INFO: `/v3/projects/ef1edfba4e6a459a8892a5457b6b5c13` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:38.276025 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11233e69-b89c-446e-8977-d8f2753cb1bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef1edfba4e6a459a8892a5457b6b5c13)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:38.278360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11233e69-b89c-446e-8977-d8f2753cb1bf admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:38.323602 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466e40b-f8f7-48b0-bc5f-e0736174f714 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:38.324848 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466e40b-f8f7-48b0-bc5f-e0736174f714 service glance] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:38.339690 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1162/2339] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:31:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:31:38.343680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-11233e69-b89c-446e-8977-d8f2753cb1bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef1edfba4e6a459a8892a5457b6b5c13', 'request_id': 'req-11233e69-b89c-446e-8977-d8f2753cb1bf'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:38.349744 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-11233e69-b89c-446e-8977-d8f2753cb1bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef1edfba4e6a459a8892a5457b6b5c13', 'request_id': 'req-11233e69-b89c-446e-8977-d8f2753cb1bf'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:38.358029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-11233e69-b89c-446e-8977-d8f2753cb1bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef1edfba4e6a459a8892a5457b6b5c13', 'request_id': 'req-11233e69-b89c-446e-8977-d8f2753cb1bf'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:38.377173 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-11233e69-b89c-446e-8977-d8f2753cb1bf admin admin] The token cache is being invalidate because project ef1edfba4e6a459a8892a5457b6b5c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:31:38.377597 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-11233e69-b89c-446e-8977-d8f2753cb1bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:38.378411 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-11233e69-b89c-446e-8977-d8f2753cb1bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:38.380300 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1178/2340] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:31:38 2022] DELETE /identity/v3/projects/ef1edfba4e6a459a8892a5457b6b5c13 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:31:38.522520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a920ae-d5d1-4cb3-bd53-b11614898381 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:38.522807 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a920ae-d5d1-4cb3-bd53-b11614898381 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:38.523096 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a920ae-d5d1-4cb3-bd53-b11614898381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:38.557320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-94a920ae-d5d1-4cb3-bd53-b11614898381 None None] MFA Rules not processed for user `c5dc12a8bc2b406b8a148bf609d5d2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:38.559460 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-94a920ae-d5d1-4cb3-bd53-b11614898381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:38.662037 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1163/2341] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Oct 4 14:31:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:38.680916 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11233e69-b89c-446e-8977-d8f2753cb1bf admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:38.683485 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-11233e69-b89c-446e-8977-d8f2753cb1bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:38.710554 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:38.797317 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11233e69-b89c-446e-8977-d8f2753cb1bf admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:38.806478 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab154d08-77c0-49f9-8e53-1c9daea4cb11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4860d5958e724e568576a9067290a27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:38.807193 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab154d08-77c0-49f9-8e53-1c9daea4cb11 service swift] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:38.807676 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab154d08-77c0-49f9-8e53-1c9daea4cb11 service swift] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:38.808299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab154d08-77c0-49f9-8e53-1c9daea4cb11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:38.822196 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab154d08-77c0-49f9-8e53-1c9daea4cb11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:38.824040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab154d08-77c0-49f9-8e53-1c9daea4cb11 service swift] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:38.853040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1179/2342] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Oct 4 14:31:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 14:31:48.655249 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=42 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:48.832301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=26 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:49.589658 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c0b83-acb9-4621-b7e6-b4e1647b7cdc None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:49.589971 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c0b83-acb9-4621-b7e6-b4e1647b7cdc None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:49.590268 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c0b83-acb9-4621-b7e6-b4e1647b7cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:49.611912 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-7d3c0b83-acb9-4621-b7e6-b4e1647b7cdc None None] MFA Rules not processed for user `ae28125460924f15865118bc315552e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:49.613144 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-7d3c0b83-acb9-4621-b7e6-b4e1647b7cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:49.676892 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1164/2343] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:52.125785 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41452f-9eb4-4bf7-b773-94bbeb19dda0 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:52.126311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41452f-9eb4-4bf7-b773-94bbeb19dda0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:52.126532 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41452f-9eb4-4bf7-b773-94bbeb19dda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:52.150713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-4a41452f-9eb4-4bf7-b773-94bbeb19dda0 None None] MFA Rules not processed for user `c5dc12a8bc2b406b8a148bf609d5d2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:52.152189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4a41452f-9eb4-4bf7-b773-94bbeb19dda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:52.173619 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1180/2344] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Oct 4 14:31:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:52.180280 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c0b83-acb9-4621-b7e6-b4e1647b7cdc None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:52.194005 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c0b83-acb9-4621-b7e6-b4e1647b7cdc None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:52.199995 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1c0d6-90a6-4b63-84cb-dee58cfc2b81 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4860d5958e724e568576a9067290a27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:52.200659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1c0d6-90a6-4b63-84cb-dee58cfc2b81 service swift] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:52.200939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1c0d6-90a6-4b63-84cb-dee58cfc2b81 service swift] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:52.201214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1c0d6-90a6-4b63-84cb-dee58cfc2b81 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:52.209808 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1c0d6-90a6-4b63-84cb-dee58cfc2b81 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:52.211749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1c0d6-90a6-4b63-84cb-dee58cfc2b81 service swift] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:52.220366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1165/2345] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Oct 4 14:31:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 14:31:52.764979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41452f-9eb4-4bf7-b773-94bbeb19dda0 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:52.766465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4a41452f-9eb4-4bf7-b773-94bbeb19dda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:52.837995 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41452f-9eb4-4bf7-b773-94bbeb19dda0 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:52.842717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248a9c6-d20e-4f17-b829-9ca0041e318b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:52.843461 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248a9c6-d20e-4f17-b829-9ca0041e318b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:52.843845 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248a9c6-d20e-4f17-b829-9ca0041e318b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:52.844182 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248a9c6-d20e-4f17-b829-9ca0041e318b admin admin] PATH_INFO: `/v3/users/f9a7abc93f614a76ab2660fdecf35062` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:52.845396 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248a9c6-d20e-4f17-b829-9ca0041e318b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9a7abc93f614a76ab2660fdecf35062)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:52.847340 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248a9c6-d20e-4f17-b829-9ca0041e318b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:52.896904 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6248a9c6-d20e-4f17-b829-9ca0041e318b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9a7abc93f614a76ab2660fdecf35062'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:52.897602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6248a9c6-d20e-4f17-b829-9ca0041e318b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9a7abc93f614a76ab2660fdecf35062'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:52.905874 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6248a9c6-d20e-4f17-b829-9ca0041e318b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9a7abc93f614a76ab2660fdecf35062'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:52.919120 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6248a9c6-d20e-4f17-b829-9ca0041e318b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9a7abc93f614a76ab2660fdecf35062'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:52.925975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-6248a9c6-d20e-4f17-b829-9ca0041e318b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9a7abc93f614a76ab2660fdecf35062'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:52.931774 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1181/2346] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:31:52 2022] DELETE /identity/v3/users/f9a7abc93f614a76ab2660fdecf35062 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:52.936198 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272324d-ffa7-4962-a6ec-de76835e46ca None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:52.936481 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272324d-ffa7-4962-a6ec-de76835e46ca None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:52.936749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272324d-ffa7-4962-a6ec-de76835e46ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:52.955264 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-2272324d-ffa7-4962-a6ec-de76835e46ca None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:52.956598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-2272324d-ffa7-4962-a6ec-de76835e46ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:53.014991 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1166/2347] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:53.026033 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248a9c6-d20e-4f17-b829-9ca0041e318b admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:53.027499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6248a9c6-d20e-4f17-b829-9ca0041e318b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:53.096387 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248a9c6-d20e-4f17-b829-9ca0041e318b admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:53.101899 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051a2e9-a5ba-404f-a962-c6f1b0943690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:53.102646 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051a2e9-a5ba-404f-a962-c6f1b0943690 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:53.103055 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051a2e9-a5ba-404f-a962-c6f1b0943690 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:53.103449 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051a2e9-a5ba-404f-a962-c6f1b0943690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:53.115627 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051a2e9-a5ba-404f-a962-c6f1b0943690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:53.117385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051a2e9-a5ba-404f-a962-c6f1b0943690 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:53.128445 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1182/2348] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:31:53.144402 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5fa9f-c066-497c-8c4f-4d6fa509fa6c None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:53.144758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5fa9f-c066-497c-8c4f-4d6fa509fa6c None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:53.145140 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5fa9f-c066-497c-8c4f-4d6fa509fa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:53.166823 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-a6b5fa9f-c066-497c-8c4f-4d6fa509fa6c None None] MFA Rules not processed for user `c5dc12a8bc2b406b8a148bf609d5d2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:53.168192 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a6b5fa9f-c066-497c-8c4f-4d6fa509fa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:53.230175 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1167/2349] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Oct 4 14:31:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:53.243201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051a2e9-a5ba-404f-a962-c6f1b0943690 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:53.244646 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8051a2e9-a5ba-404f-a962-c6f1b0943690 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:53.263903 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:53.339104 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051a2e9-a5ba-404f-a962-c6f1b0943690 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:53.345651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471b016-b306-49af-a9a6-8699f23d3913 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4860d5958e724e568576a9067290a27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:53.346611 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471b016-b306-49af-a9a6-8699f23d3913 service swift] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:53.347034 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471b016-b306-49af-a9a6-8699f23d3913 service swift] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:53.347431 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471b016-b306-49af-a9a6-8699f23d3913 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:53.358522 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471b016-b306-49af-a9a6-8699f23d3913 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:53.360400 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471b016-b306-49af-a9a6-8699f23d3913 service swift] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:53.370709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1183/2350] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Oct 4 14:31:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 14:31:53.514402 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5fa9f-c066-497c-8c4f-4d6fa509fa6c None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:53.515615 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a6b5fa9f-c066-497c-8c4f-4d6fa509fa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:53.541818 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5fa9f-c066-497c-8c4f-4d6fa509fa6c None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:53.568763 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6d491-d8c9-4a9b-a6b0-3f7a64a02df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:53.571270 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6d491-d8c9-4a9b-a6b0-3f7a64a02df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:53.574692 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6d491-d8c9-4a9b-a6b0-3f7a64a02df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:53.576984 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6d491-d8c9-4a9b-a6b0-3f7a64a02df0 admin admin] PATH_INFO: `/v3/projects/846669bb3afe4acd962f6d1e3428c887` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:53.581505 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6d491-d8c9-4a9b-a6b0-3f7a64a02df0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=846669bb3afe4acd962f6d1e3428c887)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:53.584783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6d491-d8c9-4a9b-a6b0-3f7a64a02df0 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:53.635386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:53.652638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a5b6d491-d8c9-4a9b-a6b0-3f7a64a02df0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '846669bb3afe4acd962f6d1e3428c887', 'request_id': 'req-a5b6d491-d8c9-4a9b-a6b0-3f7a64a02df0'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:53.659636 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a5b6d491-d8c9-4a9b-a6b0-3f7a64a02df0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '846669bb3afe4acd962f6d1e3428c887', 'request_id': 'req-a5b6d491-d8c9-4a9b-a6b0-3f7a64a02df0'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:53.671388 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a5b6d491-d8c9-4a9b-a6b0-3f7a64a02df0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '846669bb3afe4acd962f6d1e3428c887', 'request_id': 'req-a5b6d491-d8c9-4a9b-a6b0-3f7a64a02df0'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:53.690198 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a5b6d491-d8c9-4a9b-a6b0-3f7a64a02df0 admin admin] The token cache is being invalidate because project 846669bb3afe4acd962f6d1e3428c887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:31:53.691077 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a5b6d491-d8c9-4a9b-a6b0-3f7a64a02df0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:53.691997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a5b6d491-d8c9-4a9b-a6b0-3f7a64a02df0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:53.693853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1168/2351] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:31:53 2022] DELETE /identity/v3/projects/846669bb3afe4acd962f6d1e3428c887 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:31:53.699648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e081e-b457-4a05-9a12-225f65861208 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:53.700247 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e081e-b457-4a05-9a12-225f65861208 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:53.700645 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e081e-b457-4a05-9a12-225f65861208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:53.723608 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f41e081e-b457-4a05-9a12-225f65861208 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:53.725086 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f41e081e-b457-4a05-9a12-225f65861208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:53.816250 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1184/2352] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:31:53.825290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e127598-aad3-4e04-bb82-986cab68951d None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:53.825930 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e127598-aad3-4e04-bb82-986cab68951d None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:53.826374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e127598-aad3-4e04-bb82-986cab68951d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:53.856021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-7e127598-aad3-4e04-bb82-986cab68951d None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:53.859856 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-7e127598-aad3-4e04-bb82-986cab68951d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:53.870355 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1169/2353] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:31:53.874236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e081e-b457-4a05-9a12-225f65861208 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:53.890109 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e081e-b457-4a05-9a12-225f65861208 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:53.899032 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193ecd9-d5ba-4fd4-aeef-3ec749e93718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:53.900028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193ecd9-d5ba-4fd4-aeef-3ec749e93718 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:53.900373 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193ecd9-d5ba-4fd4-aeef-3ec749e93718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:53.900728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193ecd9-d5ba-4fd4-aeef-3ec749e93718 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:53.902291 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193ecd9-d5ba-4fd4-aeef-3ec749e93718 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:31:53.902291 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193ecd9-d5ba-4fd4-aeef-3ec749e93718 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:53.903950 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193ecd9-d5ba-4fd4-aeef-3ec749e93718 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:53.924355 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1185/2354] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:31:53.930694 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e127598-aad3-4e04-bb82-986cab68951d None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:53.947497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e127598-aad3-4e04-bb82-986cab68951d None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:53.968243 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37c298-0cca-4208-980a-dafd6a6b9021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:53.968884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37c298-0cca-4208-980a-dafd6a6b9021 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:53.969201 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37c298-0cca-4208-980a-dafd6a6b9021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:53.969517 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37c298-0cca-4208-980a-dafd6a6b9021 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:53.970146 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37c298-0cca-4208-980a-dafd6a6b9021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:53.972142 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37c298-0cca-4208-980a-dafd6a6b9021 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:54.015988 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1170/2355] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:31:53 2022] POST /identity/v3/projects => generated 357 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:31:54.020191 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193ecd9-d5ba-4fd4-aeef-3ec749e93718 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:54.034556 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193ecd9-d5ba-4fd4-aeef-3ec749e93718 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:54.108983 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87ac3d-11cc-4372-8283-73181a1c7f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:54.109799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87ac3d-11cc-4372-8283-73181a1c7f67 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:54.110283 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87ac3d-11cc-4372-8283-73181a1c7f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:54.110677 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87ac3d-11cc-4372-8283-73181a1c7f67 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:54.111483 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87ac3d-11cc-4372-8283-73181a1c7f67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:54.114227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87ac3d-11cc-4372-8283-73181a1c7f67 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:54.147235 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1186/2356] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:31:54 2022] POST /identity/v3/users => generated 279 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:31:54.150053 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37c298-0cca-4208-980a-dafd6a6b9021 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:54.161607 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37c298-0cca-4208-980a-dafd6a6b9021 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:54.168053 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b2b5b-5bc6-47b6-8a85-ce1534836ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:54.168854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b2b5b-5bc6-47b6-8a85-ce1534836ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:54.169225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b2b5b-5bc6-47b6-8a85-ce1534836ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:54.169619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b2b5b-5bc6-47b6-8a85-ce1534836ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:54.170358 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b2b5b-5bc6-47b6-8a85-ce1534836ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:54.172221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b2b5b-5bc6-47b6-8a85-ce1534836ed9 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:54.192825 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1171/2357] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:31:54.197936 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87ac3d-11cc-4372-8283-73181a1c7f67 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:54.218079 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87ac3d-11cc-4372-8283-73181a1c7f67 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:54.230164 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93cd1c-dbe5-47b5-9645-5cc74b6b6d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:54.231185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93cd1c-dbe5-47b5-9645-5cc74b6b6d5d admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:54.231740 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93cd1c-dbe5-47b5-9645-5cc74b6b6d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:54.232389 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93cd1c-dbe5-47b5-9645-5cc74b6b6d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:54.233240 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93cd1c-dbe5-47b5-9645-5cc74b6b6d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:54.235894 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93cd1c-dbe5-47b5-9645-5cc74b6b6d5d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:54.249636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1187/2358] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:31:54.254742 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b2b5b-5bc6-47b6-8a85-ce1534836ed9 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:54.268362 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b2b5b-5bc6-47b6-8a85-ce1534836ed9 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:54.281546 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8a8f9-2369-4db5-8b05-e9549c47c6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:54.282733 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8a8f9-2369-4db5-8b05-e9549c47c6f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:54.283227 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8a8f9-2369-4db5-8b05-e9549c47c6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:54.283647 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8a8f9-2369-4db5-8b05-e9549c47c6f0 admin admin] PATH_INFO: `/v3/projects/91d710a3123f40f8834f9b54da46eee0/users/19e939e414354973915d18edef82c9eb/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:54.312929 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8a8f9-2369-4db5-8b05-e9549c47c6f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d710a3123f40f8834f9b54da46eee0, user_id=19e939e414354973915d18edef82c9eb, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:54.316663 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8a8f9-2369-4db5-8b05-e9549c47c6f0 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:54.340425 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1172/2359] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:31:54 2022] PUT /identity/v3/projects/91d710a3123f40f8834f9b54da46eee0/users/19e939e414354973915d18edef82c9eb/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:54.351882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debe5f2-d519-4997-a369-7f8c4fcf5685 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:54.352526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debe5f2-d519-4997-a369-7f8c4fcf5685 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:54.352979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debe5f2-d519-4997-a369-7f8c4fcf5685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:54.409127 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:54.433345 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-9debe5f2-d519-4997-a369-7f8c4fcf5685 None None] MFA Rules not processed for user `19e939e414354973915d18edef82c9eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:54.437126 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9debe5f2-d519-4997-a369-7f8c4fcf5685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:54.596911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1188/2360] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:54.649186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8a8f9-2369-4db5-8b05-e9549c47c6f0 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:54.651165 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-04f8a8f9-2369-4db5-8b05-e9549c47c6f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:54.782670 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8a8f9-2369-4db5-8b05-e9549c47c6f0 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:54.794267 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525fffe-c9d0-46c0-85ba-ce9f1793f840 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:54.794916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525fffe-c9d0-46c0-85ba-ce9f1793f840 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:54.795246 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525fffe-c9d0-46c0-85ba-ce9f1793f840 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:54.795519 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525fffe-c9d0-46c0-85ba-ce9f1793f840 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:54.817528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525fffe-c9d0-46c0-85ba-ce9f1793f840 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:54.819287 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525fffe-c9d0-46c0-85ba-ce9f1793f840 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:54.831980 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1173/2361] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:31:54 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:31:54.852649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debe5f2-d519-4997-a369-7f8c4fcf5685 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:55.130458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debe5f2-d519-4997-a369-7f8c4fcf5685 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:55.145846 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2342c99-b24c-40aa-b88e-a3827a1aedfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:55.146883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2342c99-b24c-40aa-b88e-a3827a1aedfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:55.147535 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2342c99-b24c-40aa-b88e-a3827a1aedfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:55.149090 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2342c99-b24c-40aa-b88e-a3827a1aedfc admin admin] PATH_INFO: `/v3/users/19e939e414354973915d18edef82c9eb` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:55.150627 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2342c99-b24c-40aa-b88e-a3827a1aedfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=19e939e414354973915d18edef82c9eb)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:55.153568 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2342c99-b24c-40aa-b88e-a3827a1aedfc admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:55.262397 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b2342c99-b24c-40aa-b88e-a3827a1aedfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19e939e414354973915d18edef82c9eb'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:55.265319 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b2342c99-b24c-40aa-b88e-a3827a1aedfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19e939e414354973915d18edef82c9eb'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:55.305359 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b2342c99-b24c-40aa-b88e-a3827a1aedfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19e939e414354973915d18edef82c9eb'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:55.350287 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b2342c99-b24c-40aa-b88e-a3827a1aedfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19e939e414354973915d18edef82c9eb'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:55.365310 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b2342c99-b24c-40aa-b88e-a3827a1aedfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19e939e414354973915d18edef82c9eb'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:55.388609 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1189/2362] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:31:54 2022] DELETE /identity/v3/users/19e939e414354973915d18edef82c9eb => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:31:55.390626 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c433c4-8cea-47e7-a1d9-adae765047ad None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:55.391141 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c433c4-8cea-47e7-a1d9-adae765047ad None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:55.391337 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c433c4-8cea-47e7-a1d9-adae765047ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:55.453148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-26c433c4-8cea-47e7-a1d9-adae765047ad None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:31:55.454915 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-26c433c4-8cea-47e7-a1d9-adae765047ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:55.582267 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:55.601659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1174/2363] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:31:55.609609 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2342c99-b24c-40aa-b88e-a3827a1aedfc admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:55.611321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b2342c99-b24c-40aa-b88e-a3827a1aedfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:55.649407 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:55.709623 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2342c99-b24c-40aa-b88e-a3827a1aedfc admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:55.715518 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e502258-e227-4994-8a88-7b72184505ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:55.716237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e502258-e227-4994-8a88-7b72184505ed service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:55.716628 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e502258-e227-4994-8a88-7b72184505ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:55.716921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e502258-e227-4994-8a88-7b72184505ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:55.735301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e502258-e227-4994-8a88-7b72184505ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:55.737014 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e502258-e227-4994-8a88-7b72184505ed service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:55.754668 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1190/2364] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:31:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:31:56.315308 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c433c4-8cea-47e7-a1d9-adae765047ad None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:31:56.317030 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-26c433c4-8cea-47e7-a1d9-adae765047ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:31:56.338033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c433c4-8cea-47e7-a1d9-adae765047ad None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:31:56.351567 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419f144-24c2-4efd-acaa-4f7a3e9eafaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:31:56.352257 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419f144-24c2-4efd-acaa-4f7a3e9eafaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:31:56.352543 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419f144-24c2-4efd-acaa-4f7a3e9eafaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:31:56.352824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419f144-24c2-4efd-acaa-4f7a3e9eafaf admin admin] PATH_INFO: `/v3/projects/91d710a3123f40f8834f9b54da46eee0` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:31:56.356294 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419f144-24c2-4efd-acaa-4f7a3e9eafaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=91d710a3123f40f8834f9b54da46eee0)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:31:56.361960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419f144-24c2-4efd-acaa-4f7a3e9eafaf admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:31:56.475100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-8419f144-24c2-4efd-acaa-4f7a3e9eafaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91d710a3123f40f8834f9b54da46eee0', 'request_id': 'req-8419f144-24c2-4efd-acaa-4f7a3e9eafaf'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:56.488110 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-8419f144-24c2-4efd-acaa-4f7a3e9eafaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91d710a3123f40f8834f9b54da46eee0', 'request_id': 'req-8419f144-24c2-4efd-acaa-4f7a3e9eafaf'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:56.502721 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-8419f144-24c2-4efd-acaa-4f7a3e9eafaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91d710a3123f40f8834f9b54da46eee0', 'request_id': 'req-8419f144-24c2-4efd-acaa-4f7a3e9eafaf'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:56.516786 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-8419f144-24c2-4efd-acaa-4f7a3e9eafaf admin admin] The token cache is being invalidate because project 91d710a3123f40f8834f9b54da46eee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:31:56.517342 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-8419f144-24c2-4efd-acaa-4f7a3e9eafaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:56.518174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-8419f144-24c2-4efd-acaa-4f7a3e9eafaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:31:56.521267 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1175/2365] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:31:56 2022] DELETE /identity/v3/projects/91d710a3123f40f8834f9b54da46eee0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:32:00.879752 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80c697-3c07-40cf-a79d-b34d541f221e None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:32:00.888091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80c697-3c07-40cf-a79d-b34d541f221e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:32:00.888641 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80c697-3c07-40cf-a79d-b34d541f221e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:32:00.944091 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-9f80c697-3c07-40cf-a79d-b34d541f221e None None] MFA Rules not processed for user `62d720a284ad493bb8393289e9e38140`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:32:00.946519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9f80c697-3c07-40cf-a79d-b34d541f221e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:32:01.032387 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1191/2366] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:32:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:32:06.513621 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=27,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:10.589846 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79038887-3e20-4433-bd25-3f05a1d5d1de None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:32:10.590469 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79038887-3e20-4433-bd25-3f05a1d5d1de None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:32:10.590469 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79038887-3e20-4433-bd25-3f05a1d5d1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:32:10.612867 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-79038887-3e20-4433-bd25-3f05a1d5d1de None None] MFA Rules not processed for user `c5dc12a8bc2b406b8a148bf609d5d2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:32:10.614095 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-79038887-3e20-4433-bd25-3f05a1d5d1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:32:10.678179 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1176/2367] 10.222.0.62 () {58 vars in 967 bytes} [Tue Oct 4 14:32:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:32:10.691083 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80c697-3c07-40cf-a79d-b34d541f221e None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:32:10.692574 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9f80c697-3c07-40cf-a79d-b34d541f221e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:32:10.766139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80c697-3c07-40cf-a79d-b34d541f221e None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:32:10.771573 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adb42d-ba07-44de-956a-23ee99e2cf89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4860d5958e724e568576a9067290a27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:32:10.773427 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adb42d-ba07-44de-956a-23ee99e2cf89 service swift] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:32:10.773427 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adb42d-ba07-44de-956a-23ee99e2cf89 service swift] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:32:10.773661 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adb42d-ba07-44de-956a-23ee99e2cf89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:32:10.783403 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adb42d-ba07-44de-956a-23ee99e2cf89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:32:10.785014 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adb42d-ba07-44de-956a-23ee99e2cf89 service swift] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:32:10.795987 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1192/2368] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Oct 4 14:32:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 14:32:13.285532 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79038887-3e20-4433-bd25-3f05a1d5d1de None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:32:13.287569 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-79038887-3e20-4433-bd25-3f05a1d5d1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:32:13.487796 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79038887-3e20-4433-bd25-3f05a1d5d1de None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:32:13.493338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11856e9f-7832-4c1d-ae4b-bbf48851e534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:32:13.494221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11856e9f-7832-4c1d-ae4b-bbf48851e534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:32:13.494654 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11856e9f-7832-4c1d-ae4b-bbf48851e534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:32:13.494924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11856e9f-7832-4c1d-ae4b-bbf48851e534 admin admin] PATH_INFO: `/v3/users/0cc5cb5e634240159b537db9e27ec51c` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:32:13.496129 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11856e9f-7832-4c1d-ae4b-bbf48851e534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc5cb5e634240159b537db9e27ec51c)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:32:13.498067 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11856e9f-7832-4c1d-ae4b-bbf48851e534 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:32:13.550573 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-11856e9f-7832-4c1d-ae4b-bbf48851e534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc5cb5e634240159b537db9e27ec51c'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:32:13.551255 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-11856e9f-7832-4c1d-ae4b-bbf48851e534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc5cb5e634240159b537db9e27ec51c'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:32:13.570249 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-11856e9f-7832-4c1d-ae4b-bbf48851e534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc5cb5e634240159b537db9e27ec51c'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:32:13.579827 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-11856e9f-7832-4c1d-ae4b-bbf48851e534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc5cb5e634240159b537db9e27ec51c'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:32:13.590476 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-11856e9f-7832-4c1d-ae4b-bbf48851e534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc5cb5e634240159b537db9e27ec51c'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:32:13.597062 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1177/2369] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:32:13 2022] DELETE /identity/v3/users/0cc5cb5e634240159b537db9e27ec51c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:32:13.790658 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adb42d-ba07-44de-956a-23ee99e2cf89 service swift] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:32:13.801431 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adb42d-ba07-44de-956a-23ee99e2cf89 service swift] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:32:13.866539 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:13.873539 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c1101-5a24-476c-b6a4-8646f3b9e429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:32:13.874187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c1101-5a24-476c-b6a4-8646f3b9e429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:32:13.874464 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c1101-5a24-476c-b6a4-8646f3b9e429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:32:13.874736 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c1101-5a24-476c-b6a4-8646f3b9e429 admin admin] PATH_INFO: `/v3/projects/4906855743624a2a8aa6debd5f1fac02` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:32:13.875959 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c1101-5a24-476c-b6a4-8646f3b9e429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4906855743624a2a8aa6debd5f1fac02)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:32:13.877871 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c1101-5a24-476c-b6a4-8646f3b9e429 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:32:13.927465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-467c1101-5a24-476c-b6a4-8646f3b9e429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4906855743624a2a8aa6debd5f1fac02', 'request_id': 'req-467c1101-5a24-476c-b6a4-8646f3b9e429'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:32:13.933768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-467c1101-5a24-476c-b6a4-8646f3b9e429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4906855743624a2a8aa6debd5f1fac02', 'request_id': 'req-467c1101-5a24-476c-b6a4-8646f3b9e429'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:32:13.940119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-467c1101-5a24-476c-b6a4-8646f3b9e429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4906855743624a2a8aa6debd5f1fac02', 'request_id': 'req-467c1101-5a24-476c-b6a4-8646f3b9e429'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:32:13.953665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-467c1101-5a24-476c-b6a4-8646f3b9e429 admin admin] The token cache is being invalidate because project 4906855743624a2a8aa6debd5f1fac02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:32:13.953947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-467c1101-5a24-476c-b6a4-8646f3b9e429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:32:13.954547 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-467c1101-5a24-476c-b6a4-8646f3b9e429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:32:13.956073 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1193/2370] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:32:13 2022] DELETE /identity/v3/projects/4906855743624a2a8aa6debd5f1fac02 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:32:23.593441 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=78,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:23.950676 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:26.662785 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d52fac-49ef-4c71-a4db-5e8c31307a40 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:32:26.662785 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d52fac-49ef-4c71-a4db-5e8c31307a40 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:32:26.662785 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d52fac-49ef-4c71-a4db-5e8c31307a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:32:26.686743 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-e0d52fac-49ef-4c71-a4db-5e8c31307a40 None None] MFA Rules not processed for user `f16d427fee2b4acd8832bee31d6603e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:32:26.688912 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e0d52fac-49ef-4c71-a4db-5e8c31307a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:32:26.757778 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1178/2371] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:32:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:32:29.572734 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c1101-5a24-476c-b6a4-8646f3b9e429 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:32:29.574418 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-467c1101-5a24-476c-b6a4-8646f3b9e429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:32:29.641975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c1101-5a24-476c-b6a4-8646f3b9e429 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:32:29.647507 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450698c5-cf4f-4903-939a-16fce4f06fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:32:29.648180 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450698c5-cf4f-4903-939a-16fce4f06fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:32:29.648462 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450698c5-cf4f-4903-939a-16fce4f06fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:32:29.648802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450698c5-cf4f-4903-939a-16fce4f06fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:32:29.650792 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-450698c5-cf4f-4903-939a-16fce4f06fb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:32:29.733628 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450698c5-cf4f-4903-939a-16fce4f06fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:32:29.735082 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450698c5-cf4f-4903-939a-16fce4f06fb5 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:32:29.746129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1194/2372] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:32:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:32:36.748823 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=25 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:39.741672 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=50 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:33:30.553139 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d52fac-49ef-4c71-a4db-5e8c31307a40 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:33:30.554832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e0d52fac-49ef-4c71-a4db-5e8c31307a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:33:30.624615 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d52fac-49ef-4c71-a4db-5e8c31307a40 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:33:30.629934 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4afce0-10fb-48e3-8769-98b7ef339257 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f98c07455a241398784d221df273aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:33:30.630680 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4afce0-10fb-48e3-8769-98b7ef339257 service placement] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:33:30.630996 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4afce0-10fb-48e3-8769-98b7ef339257 service placement] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:33:30.631279 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4afce0-10fb-48e3-8769-98b7ef339257 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:33:30.634223 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-dd4afce0-10fb-48e3-8769-98b7ef339257 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:33:30.647853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4afce0-10fb-48e3-8769-98b7ef339257 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:33:30.649281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4afce0-10fb-48e3-8769-98b7ef339257 service placement] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:33:30.659812 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1179/2373] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:33:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:33:40.655377 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=32 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:29.939052 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450698c5-cf4f-4903-939a-16fce4f06fb5 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:34:29.948595 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450698c5-cf4f-4903-939a-16fce4f06fb5 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:34:29.952268 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cee731-9d28-4677-b693-35ea0c1d575d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:34:29.952872 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cee731-9d28-4677-b693-35ea0c1d575d service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:34:29.953149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cee731-9d28-4677-b693-35ea0c1d575d service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:34:29.953434 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cee731-9d28-4677-b693-35ea0c1d575d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:34:29.955393 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-68cee731-9d28-4677-b693-35ea0c1d575d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:34:30.028329 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cee731-9d28-4677-b693-35ea0c1d575d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:34:30.029778 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cee731-9d28-4677-b693-35ea0c1d575d service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:34:30.041173 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1195/2374] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:34:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:34:31.285193 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4afce0-10fb-48e3-8769-98b7ef339257 service placement] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:34:31.304349 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4afce0-10fb-48e3-8769-98b7ef339257 service placement] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:34:31.309828 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b094c-4d7b-4c28-a268-8b377d2cac65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:34:31.310440 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b094c-4d7b-4c28-a268-8b377d2cac65 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:34:31.310719 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b094c-4d7b-4c28-a268-8b377d2cac65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:34:31.310993 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b094c-4d7b-4c28-a268-8b377d2cac65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:34:31.312772 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-963b094c-4d7b-4c28-a268-8b377d2cac65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:34:31.329940 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b094c-4d7b-4c28-a268-8b377d2cac65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:34:31.331923 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b094c-4d7b-4c28-a268-8b377d2cac65 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:34:31.344774 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1180/2375] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:34:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:34:35.605272 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cee731-9d28-4677-b693-35ea0c1d575d service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:34:35.606789 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-68cee731-9d28-4677-b693-35ea0c1d575d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:34:35.620991 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cee731-9d28-4677-b693-35ea0c1d575d service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:34:35.626523 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26807e72-a47d-487d-843c-6c403e0ffb14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:34:35.627125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26807e72-a47d-487d-843c-6c403e0ffb14 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:34:35.627405 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26807e72-a47d-487d-843c-6c403e0ffb14 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:34:35.627680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26807e72-a47d-487d-843c-6c403e0ffb14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:34:35.629466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-26807e72-a47d-487d-843c-6c403e0ffb14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:34:35.641274 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26807e72-a47d-487d-843c-6c403e0ffb14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:34:35.643021 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26807e72-a47d-487d-843c-6c403e0ffb14 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:34:35.652775 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1196/2376] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:34:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:34:38.151869 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5ed8b-b0d4-4d91-978d-301b7e9d7240 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:34:38.152420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5ed8b-b0d4-4d91-978d-301b7e9d7240 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:34:38.152420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5ed8b-b0d4-4d91-978d-301b7e9d7240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:34:38.171699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-c9b5ed8b-b0d4-4d91-978d-301b7e9d7240 None None] MFA Rules not processed for user `62d720a284ad493bb8393289e9e38140`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:34:38.172910 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-c9b5ed8b-b0d4-4d91-978d-301b7e9d7240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:34:38.225811 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1181/2377] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:34:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:34:45.648067 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=40 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:48.219389 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=31 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:50.356864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e19865-b971-427c-bbc7-3266376bdff6 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:34:50.357428 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e19865-b971-427c-bbc7-3266376bdff6 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:34:50.357428 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e19865-b971-427c-bbc7-3266376bdff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:34:50.377007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-a6e19865-b971-427c-bbc7-3266376bdff6 None None] MFA Rules not processed for user `f16d427fee2b4acd8832bee31d6603e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:34:50.378201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a6e19865-b971-427c-bbc7-3266376bdff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:34:50.385246 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1197/2378] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:34:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:34:51.035140 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d0893-7f7a-4f08-9774-ef64e92b6e98 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:34:51.035550 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d0893-7f7a-4f08-9774-ef64e92b6e98 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:34:51.035913 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d0893-7f7a-4f08-9774-ef64e92b6e98 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:34:51.037140 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1182/2379] 10.222.0.62 () {54 vars in 961 bytes} [Tue Oct 4 14:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:34:51.042294 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90bd2d-8f1f-47f5-8bed-cc3e6517ca12 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:34:51.042649 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90bd2d-8f1f-47f5-8bed-cc3e6517ca12 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:34:51.043012 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90bd2d-8f1f-47f5-8bed-cc3e6517ca12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:34:51.063273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-5a90bd2d-8f1f-47f5-8bed-cc3e6517ca12 None None] MFA Rules not processed for user `6f98c07455a241398784d221df273aba`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:34:51.064522 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5a90bd2d-8f1f-47f5-8bed-cc3e6517ca12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:34:51.078848 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1198/2380] 10.222.0.62 () {58 vars in 1058 bytes} [Tue Oct 4 14:34:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:34:51.091648 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d0893-7f7a-4f08-9774-ef64e92b6e98 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:34:51.105628 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d0893-7f7a-4f08-9774-ef64e92b6e98 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:34:51.110490 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bab48d-5c86-4d6d-9e90-b9e82f59e948 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f98c07455a241398784d221df273aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:34:51.111089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bab48d-5c86-4d6d-9e90-b9e82f59e948 service placement] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:34:51.111374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bab48d-5c86-4d6d-9e90-b9e82f59e948 service placement] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:34:51.111657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bab48d-5c86-4d6d-9e90-b9e82f59e948 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:34:51.113398 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-03bab48d-5c86-4d6d-9e90-b9e82f59e948 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:34:51.126310 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bab48d-5c86-4d6d-9e90-b9e82f59e948 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:34:51.128016 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bab48d-5c86-4d6d-9e90-b9e82f59e948 service placement] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:34:51.138749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1183/2381] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:34:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:34:57.061375 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90bd2d-8f1f-47f5-8bed-cc3e6517ca12 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:34:57.071933 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90bd2d-8f1f-47f5-8bed-cc3e6517ca12 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:34:57.076069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7142b-3dc9-4aa7-a152-b2ef8dfe43ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:34:57.076722 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7142b-3dc9-4aa7-a152-b2ef8dfe43ea service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:34:57.076997 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7142b-3dc9-4aa7-a152-b2ef8dfe43ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:34:57.077290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7142b-3dc9-4aa7-a152-b2ef8dfe43ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:34:57.079129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0ad7142b-3dc9-4aa7-a152-b2ef8dfe43ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:34:57.089501 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad7142b-3dc9-4aa7-a152-b2ef8dfe43ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:34:57.091031 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad7142b-3dc9-4aa7-a152-b2ef8dfe43ea service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:34:57.099963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1199/2382] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:34:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:35:01.133815 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=6 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:07.095915 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=12 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:34.773299 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bab48d-5c86-4d6d-9e90-b9e82f59e948 service placement] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:35:34.778111 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-03bab48d-5c86-4d6d-9e90-b9e82f59e948 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:35:34.816107 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bab48d-5c86-4d6d-9e90-b9e82f59e948 service placement] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:35:34.824142 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212092d3-e55b-4acb-860f-6d0964d47446 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:35:34.826625 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212092d3-e55b-4acb-860f-6d0964d47446 service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:35:34.827076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212092d3-e55b-4acb-860f-6d0964d47446 service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:35:34.827513 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212092d3-e55b-4acb-860f-6d0964d47446 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:35:34.829960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-212092d3-e55b-4acb-860f-6d0964d47446 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:35:34.851974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212092d3-e55b-4acb-860f-6d0964d47446 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:35:34.855417 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212092d3-e55b-4acb-860f-6d0964d47446 service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:35:34.880482 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1184/2383] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:35:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:35:44.123017 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154016c-63b1-496c-8927-a738f97fc3c4 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:35:44.123542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154016c-63b1-496c-8927-a738f97fc3c4 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:35:44.123648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154016c-63b1-496c-8927-a738f97fc3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:35:44.142704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-4154016c-63b1-496c-8927-a738f97fc3c4 None None] MFA Rules not processed for user `c5dc12a8bc2b406b8a148bf609d5d2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:35:44.143922 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4154016c-63b1-496c-8927-a738f97fc3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:35:44.198334 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1200/2384] 10.222.0.62 () {58 vars in 967 bytes} [Tue Oct 4 14:35:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:35:44.245767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212092d3-e55b-4acb-860f-6d0964d47446 service nova] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:35:44.248371 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-212092d3-e55b-4acb-860f-6d0964d47446 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:35:44.316468 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212092d3-e55b-4acb-860f-6d0964d47446 service nova] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:35:44.321230 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a01e7b-7bc3-438b-b445-061debae364e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4860d5958e724e568576a9067290a27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:35:44.321836 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a01e7b-7bc3-438b-b445-061debae364e service swift] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:35:44.322116 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a01e7b-7bc3-438b-b445-061debae364e service swift] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:35:44.322385 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a01e7b-7bc3-438b-b445-061debae364e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:35:44.330931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a01e7b-7bc3-438b-b445-061debae364e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:35:44.332559 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a01e7b-7bc3-438b-b445-061debae364e service swift] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:35:44.340860 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1185/2385] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Oct 4 14:35:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 14:35:51.541311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154016c-63b1-496c-8927-a738f97fc3c4 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:35:51.543868 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4154016c-63b1-496c-8927-a738f97fc3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:35:51.619823 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154016c-63b1-496c-8927-a738f97fc3c4 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:35:51.626575 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cc23f-395c-4df6-9271-f6b7c15ba262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:35:51.627236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cc23f-395c-4df6-9271-f6b7c15ba262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:35:51.627517 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cc23f-395c-4df6-9271-f6b7c15ba262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:35:51.627823 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cc23f-395c-4df6-9271-f6b7c15ba262 admin admin] PATH_INFO: `/v3/users/ae28125460924f15865118bc315552e7` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:35:51.628991 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cc23f-395c-4df6-9271-f6b7c15ba262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae28125460924f15865118bc315552e7)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:35:51.630930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cc23f-395c-4df6-9271-f6b7c15ba262 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:35:51.688662 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2b4cc23f-395c-4df6-9271-f6b7c15ba262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae28125460924f15865118bc315552e7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:35:51.689253 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2b4cc23f-395c-4df6-9271-f6b7c15ba262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae28125460924f15865118bc315552e7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:35:51.696845 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2b4cc23f-395c-4df6-9271-f6b7c15ba262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae28125460924f15865118bc315552e7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:35:51.709581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2b4cc23f-395c-4df6-9271-f6b7c15ba262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae28125460924f15865118bc315552e7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:35:51.717881 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2b4cc23f-395c-4df6-9271-f6b7c15ba262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae28125460924f15865118bc315552e7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:35:51.724555 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1201/2386] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:35:51 2022] DELETE /identity/v3/users/ae28125460924f15865118bc315552e7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:35:51.912690 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a01e7b-7bc3-438b-b445-061debae364e service swift] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:35:51.924604 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a01e7b-7bc3-438b-b445-061debae364e service swift] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:35:51.970690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cc23f-395c-4df6-9271-f6b7c15ba262 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:35:51.972122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2b4cc23f-395c-4df6-9271-f6b7c15ba262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:35:51.984912 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe4ae6-3fe9-4868-8c97-dcf10aa51d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:35:51.985552 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe4ae6-3fe9-4868-8c97-dcf10aa51d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:35:51.985845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe4ae6-3fe9-4868-8c97-dcf10aa51d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:35:51.986099 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe4ae6-3fe9-4868-8c97-dcf10aa51d01 admin admin] PATH_INFO: `/v3/projects/2ea35da7ec1d49fb97ed46a1605c5e9b` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:35:51.987247 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe4ae6-3fe9-4868-8c97-dcf10aa51d01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ea35da7ec1d49fb97ed46a1605c5e9b)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:35:51.989233 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe4ae6-3fe9-4868-8c97-dcf10aa51d01 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:35:52.004599 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:52.042221 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cc23f-395c-4df6-9271-f6b7c15ba262 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:35:52.044916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-effe4ae6-3fe9-4868-8c97-dcf10aa51d01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ea35da7ec1d49fb97ed46a1605c5e9b', 'request_id': 'req-effe4ae6-3fe9-4868-8c97-dcf10aa51d01'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:35:52.051633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-effe4ae6-3fe9-4868-8c97-dcf10aa51d01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ea35da7ec1d49fb97ed46a1605c5e9b', 'request_id': 'req-effe4ae6-3fe9-4868-8c97-dcf10aa51d01'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:35:52.060656 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-effe4ae6-3fe9-4868-8c97-dcf10aa51d01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ea35da7ec1d49fb97ed46a1605c5e9b', 'request_id': 'req-effe4ae6-3fe9-4868-8c97-dcf10aa51d01'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:35:52.073099 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-effe4ae6-3fe9-4868-8c97-dcf10aa51d01 admin admin] The token cache is being invalidate because project 2ea35da7ec1d49fb97ed46a1605c5e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:35:52.073481 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-effe4ae6-3fe9-4868-8c97-dcf10aa51d01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:35:52.074092 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-effe4ae6-3fe9-4868-8c97-dcf10aa51d01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:35:52.076337 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1186/2387] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:35:51 2022] DELETE /identity/v3/projects/2ea35da7ec1d49fb97ed46a1605c5e9b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:35:52.080266 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe4ae6-3fe9-4868-8c97-dcf10aa51d01 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:35:52.081675 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-effe4ae6-3fe9-4868-8c97-dcf10aa51d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:35:52.099745 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:52.107191 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6008b9c-420e-4dad-adb4-c934bc679f26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:35:52.107937 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6008b9c-420e-4dad-adb4-c934bc679f26 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:35:52.108220 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6008b9c-420e-4dad-adb4-c934bc679f26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:35:52.108506 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6008b9c-420e-4dad-adb4-c934bc679f26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:35:52.110495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a6008b9c-420e-4dad-adb4-c934bc679f26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:35:52.164594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe4ae6-3fe9-4868-8c97-dcf10aa51d01 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:35:52.171119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821688e-e0cc-4db2-95d3-59620cd501ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:35:52.171801 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821688e-e0cc-4db2-95d3-59620cd501ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:35:52.172222 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821688e-e0cc-4db2-95d3-59620cd501ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:35:52.172647 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821688e-e0cc-4db2-95d3-59620cd501ed admin admin] PATH_INFO: `/v3/users/8d210a60575144b5adbd552dd792f89a` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:35:52.174167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821688e-e0cc-4db2-95d3-59620cd501ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d210a60575144b5adbd552dd792f89a)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:35:52.174431 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6008b9c-420e-4dad-adb4-c934bc679f26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:35:52.175926 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6008b9c-420e-4dad-adb4-c934bc679f26 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:35:52.176391 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821688e-e0cc-4db2-95d3-59620cd501ed admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:35:52.186687 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1202/2388] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:35:51 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:35:52.232676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9821688e-e0cc-4db2-95d3-59620cd501ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d210a60575144b5adbd552dd792f89a'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:35:52.233720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9821688e-e0cc-4db2-95d3-59620cd501ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d210a60575144b5adbd552dd792f89a'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:35:52.251925 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9821688e-e0cc-4db2-95d3-59620cd501ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d210a60575144b5adbd552dd792f89a'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:35:52.260861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9821688e-e0cc-4db2-95d3-59620cd501ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d210a60575144b5adbd552dd792f89a'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:35:52.269623 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-9821688e-e0cc-4db2-95d3-59620cd501ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d210a60575144b5adbd552dd792f89a'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:35:52.275989 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1187/2389] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:35:52 2022] DELETE /identity/v3/users/8d210a60575144b5adbd552dd792f89a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:35:52.479841 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6008b9c-420e-4dad-adb4-c934bc679f26 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:35:52.505374 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6008b9c-420e-4dad-adb4-c934bc679f26 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:35:52.598280 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c666a-8371-4bed-af13-1bc0c18c1d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:35:52.599225 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c666a-8371-4bed-af13-1bc0c18c1d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:35:52.599526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c666a-8371-4bed-af13-1bc0c18c1d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:35:52.600031 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c666a-8371-4bed-af13-1bc0c18c1d9a admin admin] PATH_INFO: `/v3/projects/8182836bb15b4db8b19052fe741477eb` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:35:52.601336 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c666a-8371-4bed-af13-1bc0c18c1d9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8182836bb15b4db8b19052fe741477eb)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:35:52.603346 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c666a-8371-4bed-af13-1bc0c18c1d9a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:35:52.649355 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:52.661704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4f2c666a-8371-4bed-af13-1bc0c18c1d9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8182836bb15b4db8b19052fe741477eb', 'request_id': 'req-4f2c666a-8371-4bed-af13-1bc0c18c1d9a'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:35:52.668214 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4f2c666a-8371-4bed-af13-1bc0c18c1d9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8182836bb15b4db8b19052fe741477eb', 'request_id': 'req-4f2c666a-8371-4bed-af13-1bc0c18c1d9a'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:35:52.674701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4f2c666a-8371-4bed-af13-1bc0c18c1d9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8182836bb15b4db8b19052fe741477eb', 'request_id': 'req-4f2c666a-8371-4bed-af13-1bc0c18c1d9a'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:35:52.690521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4f2c666a-8371-4bed-af13-1bc0c18c1d9a admin admin] The token cache is being invalidate because project 8182836bb15b4db8b19052fe741477eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:35:52.690838 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4f2c666a-8371-4bed-af13-1bc0c18c1d9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:35:52.691511 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4f2c666a-8371-4bed-af13-1bc0c18c1d9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:35:52.693101 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1203/2390] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:35:52 2022] DELETE /identity/v3/projects/8182836bb15b4db8b19052fe741477eb => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:35:52.698216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7938cf9-5633-4524-b11e-5b3fa3ee2ae0 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:35:52.698500 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7938cf9-5633-4524-b11e-5b3fa3ee2ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:35:52.698820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7938cf9-5633-4524-b11e-5b3fa3ee2ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:35:52.720997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-e7938cf9-5633-4524-b11e-5b3fa3ee2ae0 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:35:52.722117 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e7938cf9-5633-4524-b11e-5b3fa3ee2ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:35:52.790135 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1188/2391] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:35:52.798686 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f0621-a2ce-4302-b715-e681613b1400 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:35:52.798968 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f0621-a2ce-4302-b715-e681613b1400 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:35:52.799239 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f0621-a2ce-4302-b715-e681613b1400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:35:52.820479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-df7f0621-a2ce-4302-b715-e681613b1400 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:35:52.821778 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-df7f0621-a2ce-4302-b715-e681613b1400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:35:52.830549 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1204/2392] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:35:52.835125 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7938cf9-5633-4524-b11e-5b3fa3ee2ae0 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:35:52.845647 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7938cf9-5633-4524-b11e-5b3fa3ee2ae0 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:35:52.850335 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20e405-2794-469a-b60f-af878a87e2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:35:52.850952 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20e405-2794-469a-b60f-af878a87e2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:35:52.851229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20e405-2794-469a-b60f-af878a87e2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:35:52.851491 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20e405-2794-469a-b60f-af878a87e2c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:35:52.852173 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20e405-2794-469a-b60f-af878a87e2c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:35:52.852473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20e405-2794-469a-b60f-af878a87e2c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:35:52.854058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20e405-2794-469a-b60f-af878a87e2c3 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:35:52.866914 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1189/2393] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:35:52.872089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f0621-a2ce-4302-b715-e681613b1400 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:35:52.881872 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f0621-a2ce-4302-b715-e681613b1400 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:35:52.886693 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d7801-86ae-48b9-a27e-79b0a644b82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:35:52.888133 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d7801-86ae-48b9-a27e-79b0a644b82d admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:35:52.888416 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d7801-86ae-48b9-a27e-79b0a644b82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:35:52.888709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d7801-86ae-48b9-a27e-79b0a644b82d admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:35:52.889352 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d7801-86ae-48b9-a27e-79b0a644b82d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:35:52.891262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d7801-86ae-48b9-a27e-79b0a644b82d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:35:52.927791 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1205/2394] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:35:52 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:35:52.929783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20e405-2794-469a-b60f-af878a87e2c3 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:35:52.942054 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20e405-2794-469a-b60f-af878a87e2c3 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:35:52.951948 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:53.009399 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272973a-f752-4341-9d5b-043cbf4e3460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:35:53.010190 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272973a-f752-4341-9d5b-043cbf4e3460 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:35:53.010602 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272973a-f752-4341-9d5b-043cbf4e3460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:35:53.011035 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272973a-f752-4341-9d5b-043cbf4e3460 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:35:53.012596 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272973a-f752-4341-9d5b-043cbf4e3460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:35:53.015629 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272973a-f752-4341-9d5b-043cbf4e3460 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:35:53.039679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1190/2395] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:35:52 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:35:53.045456 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d7801-86ae-48b9-a27e-79b0a644b82d admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:35:53.057720 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d7801-86ae-48b9-a27e-79b0a644b82d admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:35:53.063280 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf15b9a-87b0-4634-9eb8-b2aa6bae594c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:35:53.063963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf15b9a-87b0-4634-9eb8-b2aa6bae594c admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:35:53.064364 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf15b9a-87b0-4634-9eb8-b2aa6bae594c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:35:53.064640 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf15b9a-87b0-4634-9eb8-b2aa6bae594c admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:35:53.065546 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf15b9a-87b0-4634-9eb8-b2aa6bae594c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:35:53.067172 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf15b9a-87b0-4634-9eb8-b2aa6bae594c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:35:53.084735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1206/2396] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:35:53.086220 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272973a-f752-4341-9d5b-043cbf4e3460 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:35:53.098170 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272973a-f752-4341-9d5b-043cbf4e3460 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:35:53.103287 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7add8de-930c-4247-b27d-a0417a0d8c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:35:53.103933 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7add8de-930c-4247-b27d-a0417a0d8c01 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:35:53.104212 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7add8de-930c-4247-b27d-a0417a0d8c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:35:53.104481 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7add8de-930c-4247-b27d-a0417a0d8c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:35:53.105164 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7add8de-930c-4247-b27d-a0417a0d8c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:35:53.106808 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7add8de-930c-4247-b27d-a0417a0d8c01 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:35:53.119099 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1191/2397] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:35:53.124180 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf15b9a-87b0-4634-9eb8-b2aa6bae594c admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:35:53.135401 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf15b9a-87b0-4634-9eb8-b2aa6bae594c admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:35:53.140986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130955fa-46bd-4db6-ae5a-638f42f1cb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:35:53.141675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130955fa-46bd-4db6-ae5a-638f42f1cb73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:35:53.141950 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130955fa-46bd-4db6-ae5a-638f42f1cb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:35:53.142888 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130955fa-46bd-4db6-ae5a-638f42f1cb73 admin admin] PATH_INFO: `/v3/projects/f787012cb64d49f8b646f052ca8d6ab4/users/c83e6cc7f5b34c799123989e086527f4/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:35:53.160138 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130955fa-46bd-4db6-ae5a-638f42f1cb73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f787012cb64d49f8b646f052ca8d6ab4, user_id=c83e6cc7f5b34c799123989e086527f4, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:35:53.162829 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130955fa-46bd-4db6-ae5a-638f42f1cb73 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:35:53.179676 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1207/2398] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:35:53 2022] PUT /identity/v3/projects/f787012cb64d49f8b646f052ca8d6ab4/users/c83e6cc7f5b34c799123989e086527f4/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:35:53.185015 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947507a-a634-4164-8878-9b81d6a84358 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:35:53.185288 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947507a-a634-4164-8878-9b81d6a84358 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:35:53.185565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947507a-a634-4164-8878-9b81d6a84358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:35:53.209243 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-4947507a-a634-4164-8878-9b81d6a84358 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:35:53.211526 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-4947507a-a634-4164-8878-9b81d6a84358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:35:53.299997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1192/2399] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:35:53.311341 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130955fa-46bd-4db6-ae5a-638f42f1cb73 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:35:53.313203 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-130955fa-46bd-4db6-ae5a-638f42f1cb73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:35:53.393751 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130955fa-46bd-4db6-ae5a-638f42f1cb73 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:35:53.397930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858baf8-c9b2-4601-829b-6052f95efbcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:35:53.398557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858baf8-c9b2-4601-829b-6052f95efbcc service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:35:53.398843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858baf8-c9b2-4601-829b-6052f95efbcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:35:53.399119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858baf8-c9b2-4601-829b-6052f95efbcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:35:53.410633 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858baf8-c9b2-4601-829b-6052f95efbcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:35:53.412128 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858baf8-c9b2-4601-829b-6052f95efbcc service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:35:53.423940 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1208/2400] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:35:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:35:53.582855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947507a-a634-4164-8878-9b81d6a84358 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:35:53.585132 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-4947507a-a634-4164-8878-9b81d6a84358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:35:53.695693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947507a-a634-4164-8878-9b81d6a84358 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:35:53.700417 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47649860-9bde-4fb5-a23c-93e8d6819a0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:35:53.701044 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47649860-9bde-4fb5-a23c-93e8d6819a0a service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:35:53.701323 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47649860-9bde-4fb5-a23c-93e8d6819a0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:35:53.701594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47649860-9bde-4fb5-a23c-93e8d6819a0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:35:53.704193 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-47649860-9bde-4fb5-a23c-93e8d6819a0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:35:53.770628 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:53.795051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47649860-9bde-4fb5-a23c-93e8d6819a0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:35:53.796913 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47649860-9bde-4fb5-a23c-93e8d6819a0a service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:35:53.807755 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1193/2401] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:35:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:35:59.722051 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb722067-56dc-44a0-93d1-25722023a22d None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:35:59.722668 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb722067-56dc-44a0-93d1-25722023a22d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:35:59.723278 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb722067-56dc-44a0-93d1-25722023a22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:35:59.785237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-fb722067-56dc-44a0-93d1-25722023a22d None None] MFA Rules not processed for user `c83e6cc7f5b34c799123989e086527f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:35:59.786552 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-fb722067-56dc-44a0-93d1-25722023a22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:35:59.872250 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:59.889413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1209/2402] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:35:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:35:59.891957 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47649860-9bde-4fb5-a23c-93e8d6819a0a service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:35:59.908883 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47649860-9bde-4fb5-a23c-93e8d6819a0a service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:35:59.915276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d31d4e-4d93-4d17-84fa-c8296590a491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:35:59.916023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d31d4e-4d93-4d17-84fa-c8296590a491 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:35:59.916365 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d31d4e-4d93-4d17-84fa-c8296590a491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:35:59.916691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d31d4e-4d93-4d17-84fa-c8296590a491 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:35:59.917363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d31d4e-4d93-4d17-84fa-c8296590a491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:35:59.920045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d31d4e-4d93-4d17-84fa-c8296590a491 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:35:59.953659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1194/2403] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:35:59 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:35:59.957979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb722067-56dc-44a0-93d1-25722023a22d None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:35:59.972235 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb722067-56dc-44a0-93d1-25722023a22d None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:36:00.086020 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290dfa7-97c8-4aeb-aea5-492c64ffa5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:36:00.086921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290dfa7-97c8-4aeb-aea5-492c64ffa5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:00.087342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290dfa7-97c8-4aeb-aea5-492c64ffa5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:00.087803 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290dfa7-97c8-4aeb-aea5-492c64ffa5a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:00.088709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290dfa7-97c8-4aeb-aea5-492c64ffa5a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:36:00.093178 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290dfa7-97c8-4aeb-aea5-492c64ffa5a9 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:36:00.139816 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1210/2404] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:35:59 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:36:00.149304 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d31d4e-4d93-4d17-84fa-c8296590a491 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:36:00.174180 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d31d4e-4d93-4d17-84fa-c8296590a491 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:36:00.189179 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b75f82-001b-4cff-80da-908f74373642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:36:00.190987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b75f82-001b-4cff-80da-908f74373642 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:00.190987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b75f82-001b-4cff-80da-908f74373642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:00.191301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b75f82-001b-4cff-80da-908f74373642 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:00.192336 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b75f82-001b-4cff-80da-908f74373642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:36:00.195257 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b75f82-001b-4cff-80da-908f74373642 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:36:00.215762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1195/2405] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:36:00.221071 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290dfa7-97c8-4aeb-aea5-492c64ffa5a9 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:36:00.235609 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290dfa7-97c8-4aeb-aea5-492c64ffa5a9 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:36:00.242726 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d948d4-8c10-495a-8ef8-b980a7dbbf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:36:00.243695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d948d4-8c10-495a-8ef8-b980a7dbbf5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:00.244127 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d948d4-8c10-495a-8ef8-b980a7dbbf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:00.244492 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d948d4-8c10-495a-8ef8-b980a7dbbf5b admin admin] PATH_INFO: `/v3/projects/aa970411ccef4af68d33f9842b34b838/users/40935ba1e898453298465966ff9460b5/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:00.267276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d948d4-8c10-495a-8ef8-b980a7dbbf5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa970411ccef4af68d33f9842b34b838, user_id=40935ba1e898453298465966ff9460b5, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:36:00.270465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d948d4-8c10-495a-8ef8-b980a7dbbf5b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:36:00.293869 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1211/2406] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:36:00 2022] PUT /identity/v3/projects/aa970411ccef4af68d33f9842b34b838/users/40935ba1e898453298465966ff9460b5/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:36:00.307164 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b75f82-001b-4cff-80da-908f74373642 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:36:00.320350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b75f82-001b-4cff-80da-908f74373642 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:36:00.405362 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c46bb-e51c-407f-b28a-98457ca48ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:36:00.406157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c46bb-e51c-407f-b28a-98457ca48ccd admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:00.406655 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c46bb-e51c-407f-b28a-98457ca48ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:00.406963 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c46bb-e51c-407f-b28a-98457ca48ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:00.407833 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c46bb-e51c-407f-b28a-98457ca48ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:36:00.409702 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c46bb-e51c-407f-b28a-98457ca48ccd admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:36:00.428334 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1196/2407] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:36:00.431036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d948d4-8c10-495a-8ef8-b980a7dbbf5b admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:36:00.444615 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d948d4-8c10-495a-8ef8-b980a7dbbf5b admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:36:00.450184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b572c-0093-490f-a3c7-8ffcb109ffdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:36:00.451176 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b572c-0093-490f-a3c7-8ffcb109ffdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:00.451176 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b572c-0093-490f-a3c7-8ffcb109ffdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:00.451428 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b572c-0093-490f-a3c7-8ffcb109ffdd admin admin] PATH_INFO: `/v3/projects/aa970411ccef4af68d33f9842b34b838/users/40935ba1e898453298465966ff9460b5/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:00.453640 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b572c-0093-490f-a3c7-8ffcb109ffdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa970411ccef4af68d33f9842b34b838, user_id=40935ba1e898453298465966ff9460b5, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:36:00.456376 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b572c-0093-490f-a3c7-8ffcb109ffdd admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:36:00.471776 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1212/2408] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:36:00 2022] PUT /identity/v3/projects/aa970411ccef4af68d33f9842b34b838/users/40935ba1e898453298465966ff9460b5/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:36:07.528110 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b7842-9384-4916-93cc-d9562d1a8bd8 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:07.538582 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b7842-9384-4916-93cc-d9562d1a8bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:07.539347 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b7842-9384-4916-93cc-d9562d1a8bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:07.590705 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-cb1b7842-9384-4916-93cc-d9562d1a8bd8 None None] MFA Rules not processed for user `7eaef5f6ca21428a9c87bb7dffc2017d`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:36:07.593948 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-cb1b7842-9384-4916-93cc-d9562d1a8bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:36:07.713725 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1197/2409] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:36:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:36:07.891212 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a595f33-7491-4af5-872a-eb8013cfc6fd None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:07.892042 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a595f33-7491-4af5-872a-eb8013cfc6fd None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:07.892042 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a595f33-7491-4af5-872a-eb8013cfc6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:07.949498 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-1a595f33-7491-4af5-872a-eb8013cfc6fd None None] MFA Rules not processed for user `40935ba1e898453298465966ff9460b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:36:07.950776 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1a595f33-7491-4af5-872a-eb8013cfc6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:36:08.082755 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1213/2410] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:36:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:36:08.097396 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b7842-9384-4916-93cc-d9562d1a8bd8 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:36:08.099276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-cb1b7842-9384-4916-93cc-d9562d1a8bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:36:08.188885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a595f33-7491-4af5-872a-eb8013cfc6fd None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:36:08.190846 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1a595f33-7491-4af5-872a-eb8013cfc6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:36:08.203870 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:36:08.233549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b7842-9384-4916-93cc-d9562d1a8bd8 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:36:08.242347 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c470e-7095-4af1-b8e9-11ada7816f27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:36:08.243186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c470e-7095-4af1-b8e9-11ada7816f27 service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:08.243186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c470e-7095-4af1-b8e9-11ada7816f27 service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:08.243403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c470e-7095-4af1-b8e9-11ada7816f27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:08.249913 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:36:08.287172 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a595f33-7491-4af5-872a-eb8013cfc6fd None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:36:08.293566 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065474c-0380-4b2f-aa2b-4d3432537d3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:36:08.294303 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065474c-0380-4b2f-aa2b-4d3432537d3a service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:08.294679 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065474c-0380-4b2f-aa2b-4d3432537d3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:08.295209 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065474c-0380-4b2f-aa2b-4d3432537d3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:08.298401 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8065474c-0380-4b2f-aa2b-4d3432537d3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:36:08.312613 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065474c-0380-4b2f-aa2b-4d3432537d3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:36:08.313280 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c470e-7095-4af1-b8e9-11ada7816f27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:36:08.314384 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065474c-0380-4b2f-aa2b-4d3432537d3a service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:36:08.315039 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c470e-7095-4af1-b8e9-11ada7816f27 service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:36:08.330851 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1214/2411] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:36:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:36:08.335918 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1198/2412] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:36:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:36:10.078992 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e18f9-5a30-4d69-a5c9-62708bfec153 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:10.079977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e18f9-5a30-4d69-a5c9-62708bfec153 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:10.080382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e18f9-5a30-4d69-a5c9-62708bfec153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:10.112866 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-849e18f9-5a30-4d69-a5c9-62708bfec153 None None] MFA Rules not processed for user `c83e6cc7f5b34c799123989e086527f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:36:10.114152 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-849e18f9-5a30-4d69-a5c9-62708bfec153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:36:10.124963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1215/2413] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:36:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:36:18.321578 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=31 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:36:19.088769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c470e-7095-4af1-b8e9-11ada7816f27 service nova] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:36:19.098666 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c470e-7095-4af1-b8e9-11ada7816f27 service nova] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:36:19.102805 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bf6d2-5643-4375-8be6-56d4a40590a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:36:19.103399 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bf6d2-5643-4375-8be6-56d4a40590a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:19.103680 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bf6d2-5643-4375-8be6-56d4a40590a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:19.103992 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bf6d2-5643-4375-8be6-56d4a40590a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:19.105783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-2b3bf6d2-5643-4375-8be6-56d4a40590a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:36:19.175488 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3bf6d2-5643-4375-8be6-56d4a40590a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:36:19.176960 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3bf6d2-5643-4375-8be6-56d4a40590a4 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:36:19.187016 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1199/2414] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:36:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:36:20.105632 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=15 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:36:20.757864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e18f9-5a30-4d69-a5c9-62708bfec153 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:36:20.780393 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e18f9-5a30-4d69-a5c9-62708bfec153 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:36:20.787073 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5a056-70fa-4718-8002-4794d28018b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:36:20.788048 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5a056-70fa-4718-8002-4794d28018b7 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:20.788521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5a056-70fa-4718-8002-4794d28018b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:20.788948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5a056-70fa-4718-8002-4794d28018b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:20.791265 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-32a5a056-70fa-4718-8002-4794d28018b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:36:20.805664 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5a056-70fa-4718-8002-4794d28018b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:36:20.808207 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5a056-70fa-4718-8002-4794d28018b7 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:36:20.820319 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1216/2415] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:36:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:36:22.732088 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bf6d2-5643-4375-8be6-56d4a40590a4 service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:36:22.733730 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-2b3bf6d2-5643-4375-8be6-56d4a40590a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:36:22.785500 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5a056-70fa-4718-8002-4794d28018b7 service nova] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:36:22.787984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-32a5a056-70fa-4718-8002-4794d28018b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:36:22.817735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5a056-70fa-4718-8002-4794d28018b7 service nova] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:36:22.822558 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a3bf0-d83a-4f96-b99a-f3afb84a2fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:36:22.823449 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a3bf0-d83a-4f96-b99a-f3afb84a2fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:22.823964 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a3bf0-d83a-4f96-b99a-f3afb84a2fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:22.824309 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a3bf0-d83a-4f96-b99a-f3afb84a2fa0 admin admin] PATH_INFO: `/v3/users/62d720a284ad493bb8393289e9e38140` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:22.825521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a3bf0-d83a-4f96-b99a-f3afb84a2fa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62d720a284ad493bb8393289e9e38140)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:36:22.827558 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a3bf0-d83a-4f96-b99a-f3afb84a2fa0 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:36:22.844122 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bf6d2-5643-4375-8be6-56d4a40590a4 service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:36:22.849825 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a13e3-ccbc-48a9-ae00-21b4e099cd56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f98c07455a241398784d221df273aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:36:22.850449 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a13e3-ccbc-48a9-ae00-21b4e099cd56 service placement] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:22.850714 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a13e3-ccbc-48a9-ae00-21b4e099cd56 service placement] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:22.850985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a13e3-ccbc-48a9-ae00-21b4e099cd56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:22.853103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-0b9a13e3-ccbc-48a9-ae00-21b4e099cd56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:36:22.866218 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a13e3-ccbc-48a9-ae00-21b4e099cd56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:36:22.868328 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a13e3-ccbc-48a9-ae00-21b4e099cd56 service placement] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:36:22.880480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1200/2416] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:36:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:36:22.881869 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-269a3bf0-d83a-4f96-b99a-f3afb84a2fa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62d720a284ad493bb8393289e9e38140'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:36:22.882539 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-269a3bf0-d83a-4f96-b99a-f3afb84a2fa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62d720a284ad493bb8393289e9e38140'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:36:22.891745 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-269a3bf0-d83a-4f96-b99a-f3afb84a2fa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62d720a284ad493bb8393289e9e38140'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:36:22.905009 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-269a3bf0-d83a-4f96-b99a-f3afb84a2fa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62d720a284ad493bb8393289e9e38140'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:36:22.912235 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-269a3bf0-d83a-4f96-b99a-f3afb84a2fa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62d720a284ad493bb8393289e9e38140'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:36:22.919673 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1217/2417] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:36:22 2022] DELETE /identity/v3/users/62d720a284ad493bb8393289e9e38140 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:36:23.177281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a13e3-ccbc-48a9-ae00-21b4e099cd56 service placement] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:36:23.188848 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a13e3-ccbc-48a9-ae00-21b4e099cd56 service placement] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:36:23.265192 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce095f-1631-4c17-bff8-9dc084a83cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:36:23.265850 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce095f-1631-4c17-bff8-9dc084a83cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:23.266132 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce095f-1631-4c17-bff8-9dc084a83cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:23.266405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce095f-1631-4c17-bff8-9dc084a83cce admin admin] PATH_INFO: `/v3/projects/f836e0afa05b487eb066e7ce02d57154` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:23.267528 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce095f-1631-4c17-bff8-9dc084a83cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=f836e0afa05b487eb066e7ce02d57154)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:36:23.269451 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce095f-1631-4c17-bff8-9dc084a83cce admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:36:23.302345 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:36:23.321994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-47ce095f-1631-4c17-bff8-9dc084a83cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f836e0afa05b487eb066e7ce02d57154', 'request_id': 'req-47ce095f-1631-4c17-bff8-9dc084a83cce'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:36:23.331335 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-47ce095f-1631-4c17-bff8-9dc084a83cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f836e0afa05b487eb066e7ce02d57154', 'request_id': 'req-47ce095f-1631-4c17-bff8-9dc084a83cce'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:36:23.340982 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-47ce095f-1631-4c17-bff8-9dc084a83cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f836e0afa05b487eb066e7ce02d57154', 'request_id': 'req-47ce095f-1631-4c17-bff8-9dc084a83cce'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:36:23.351876 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-47ce095f-1631-4c17-bff8-9dc084a83cce admin admin] The token cache is being invalidate because project f836e0afa05b487eb066e7ce02d57154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:36:23.352231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-47ce095f-1631-4c17-bff8-9dc084a83cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:36:23.352810 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-47ce095f-1631-4c17-bff8-9dc084a83cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:36:23.355228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1201/2418] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:36:23 2022] DELETE /identity/v3/projects/f836e0afa05b487eb066e7ce02d57154 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:36:23.361146 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1c290-04c2-43bb-a0c1-3d51d0c3b02d None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:23.361434 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1c290-04c2-43bb-a0c1-3d51d0c3b02d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:23.361703 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1c290-04c2-43bb-a0c1-3d51d0c3b02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:23.382173 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c7e1c290-04c2-43bb-a0c1-3d51d0c3b02d None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:36:23.383363 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c7e1c290-04c2-43bb-a0c1-3d51d0c3b02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:36:23.445853 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1218/2419] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:36:23.453915 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4a026-5dfb-42c0-8729-b5c3b0d24d84 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:23.454205 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4a026-5dfb-42c0-8729-b5c3b0d24d84 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:23.454483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4a026-5dfb-42c0-8729-b5c3b0d24d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:23.475163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-f2b4a026-5dfb-42c0-8729-b5c3b0d24d84 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:36:23.476384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f2b4a026-5dfb-42c0-8729-b5c3b0d24d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:36:23.484860 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1202/2420] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:36:23.489047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1c290-04c2-43bb-a0c1-3d51d0c3b02d None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:36:23.499381 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1c290-04c2-43bb-a0c1-3d51d0c3b02d None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:36:23.503968 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a71bec-c86a-475a-b7f9-5eb1dec370ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:36:23.504560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a71bec-c86a-475a-b7f9-5eb1dec370ca admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:23.504853 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a71bec-c86a-475a-b7f9-5eb1dec370ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:23.505098 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a71bec-c86a-475a-b7f9-5eb1dec370ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:23.505733 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a71bec-c86a-475a-b7f9-5eb1dec370ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:36:23.506028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a71bec-c86a-475a-b7f9-5eb1dec370ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:36:23.507594 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a71bec-c86a-475a-b7f9-5eb1dec370ca admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:36:23.521220 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1219/2421] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:36:23.529293 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4a026-5dfb-42c0-8729-b5c3b0d24d84 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:36:23.538696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4a026-5dfb-42c0-8729-b5c3b0d24d84 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:36:23.543585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d6c80-2053-4882-8d0b-b15ec0862f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:36:23.544221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d6c80-2053-4882-8d0b-b15ec0862f9f admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:23.544502 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d6c80-2053-4882-8d0b-b15ec0862f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:23.544774 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d6c80-2053-4882-8d0b-b15ec0862f9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:23.545432 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d6c80-2053-4882-8d0b-b15ec0862f9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:36:23.547317 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d6c80-2053-4882-8d0b-b15ec0862f9f admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:36:23.576411 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1203/2422] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:36:23 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:36:23.580493 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a71bec-c86a-475a-b7f9-5eb1dec370ca admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:36:23.590555 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a71bec-c86a-475a-b7f9-5eb1dec370ca admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:36:23.633346 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:36:23.648616 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5729f02-b9e9-4470-a881-5afb03e13619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:36:23.649227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5729f02-b9e9-4470-a881-5afb03e13619 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:23.649505 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5729f02-b9e9-4470-a881-5afb03e13619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:23.649771 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5729f02-b9e9-4470-a881-5afb03e13619 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:23.650403 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5729f02-b9e9-4470-a881-5afb03e13619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:36:23.653069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5729f02-b9e9-4470-a881-5afb03e13619 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:36:23.678866 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1220/2423] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:36:23 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:36:23.681006 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d6c80-2053-4882-8d0b-b15ec0862f9f admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:36:23.694127 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d6c80-2053-4882-8d0b-b15ec0862f9f admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:36:23.700282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cd4ec-1e3f-4d05-9db9-35b18cc1663f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:36:23.701169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cd4ec-1e3f-4d05-9db9-35b18cc1663f admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:23.701452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cd4ec-1e3f-4d05-9db9-35b18cc1663f admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:23.701767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cd4ec-1e3f-4d05-9db9-35b18cc1663f admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:23.702412 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cd4ec-1e3f-4d05-9db9-35b18cc1663f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:36:23.704410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cd4ec-1e3f-4d05-9db9-35b18cc1663f admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:36:23.717519 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1204/2424] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:36:23.721528 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5729f02-b9e9-4470-a881-5afb03e13619 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:36:23.732293 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5729f02-b9e9-4470-a881-5afb03e13619 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:36:23.736926 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132ed77-5e2b-4f49-a531-f8b1ea07bfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:36:23.737524 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132ed77-5e2b-4f49-a531-f8b1ea07bfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:23.737799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132ed77-5e2b-4f49-a531-f8b1ea07bfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:23.738081 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132ed77-5e2b-4f49-a531-f8b1ea07bfa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:23.738727 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132ed77-5e2b-4f49-a531-f8b1ea07bfa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:36:23.740358 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132ed77-5e2b-4f49-a531-f8b1ea07bfa9 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:36:23.754835 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1221/2425] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:36:23.756314 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cd4ec-1e3f-4d05-9db9-35b18cc1663f admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:36:23.766267 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cd4ec-1e3f-4d05-9db9-35b18cc1663f admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:36:23.771203 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033ff40-490c-446b-85e2-d03018e06f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:36:23.771892 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033ff40-490c-446b-85e2-d03018e06f87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:23.772173 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033ff40-490c-446b-85e2-d03018e06f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:23.772468 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033ff40-490c-446b-85e2-d03018e06f87 admin admin] PATH_INFO: `/v3/projects/a05e3803e64141afb06ecc7cab9478b5/users/3f869ad16f0943ed97bfe91472f929e7/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:23.788383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033ff40-490c-446b-85e2-d03018e06f87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a05e3803e64141afb06ecc7cab9478b5, user_id=3f869ad16f0943ed97bfe91472f929e7, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:36:23.791291 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033ff40-490c-446b-85e2-d03018e06f87 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:36:23.806693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1205/2426] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:36:23 2022] PUT /identity/v3/projects/a05e3803e64141afb06ecc7cab9478b5/users/3f869ad16f0943ed97bfe91472f929e7/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:36:23.812035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd734cdd-bc66-4019-bea5-032d7a36dfcd None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:23.812487 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd734cdd-bc66-4019-bea5-032d7a36dfcd None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:23.812608 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd734cdd-bc66-4019-bea5-032d7a36dfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:23.833278 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-fd734cdd-bc66-4019-bea5-032d7a36dfcd None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:36:23.834408 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-fd734cdd-bc66-4019-bea5-032d7a36dfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:36:23.896154 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1222/2427] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:36:23.906813 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033ff40-490c-446b-85e2-d03018e06f87 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:36:23.908589 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d033ff40-490c-446b-85e2-d03018e06f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:36:23.966898 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033ff40-490c-446b-85e2-d03018e06f87 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:36:23.971087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aeea20-2b74-4e98-a68e-3c03f945d769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:36:23.971805 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aeea20-2b74-4e98-a68e-3c03f945d769 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:23.972087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aeea20-2b74-4e98-a68e-3c03f945d769 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:23.972353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aeea20-2b74-4e98-a68e-3c03f945d769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:23.981938 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aeea20-2b74-4e98-a68e-3c03f945d769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:36:23.983340 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aeea20-2b74-4e98-a68e-3c03f945d769 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:36:23.992579 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1206/2428] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:36:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:36:28.620730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2346cf6-04e2-4d03-a049-3e5223b102a7 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:28.621273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2346cf6-04e2-4d03-a049-3e5223b102a7 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:28.621273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2346cf6-04e2-4d03-a049-3e5223b102a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:28.651050 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e2346cf6-04e2-4d03-a049-3e5223b102a7 None None] MFA Rules not processed for user `3f869ad16f0943ed97bfe91472f929e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:36:28.652399 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e2346cf6-04e2-4d03-a049-3e5223b102a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:36:28.723625 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1223/2429] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:36:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:36:28.740335 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aeea20-2b74-4e98-a68e-3c03f945d769 service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:36:28.741867 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-31aeea20-2b74-4e98-a68e-3c03f945d769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:36:28.798729 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:36:28.841685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aeea20-2b74-4e98-a68e-3c03f945d769 service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:36:28.852542 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ef252-1bf9-471c-8f32-0b0bc998f969 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:36:28.853068 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ef252-1bf9-471c-8f32-0b0bc998f969 service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:28.853346 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ef252-1bf9-471c-8f32-0b0bc998f969 service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:28.853612 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ef252-1bf9-471c-8f32-0b0bc998f969 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:28.862827 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ef252-1bf9-471c-8f32-0b0bc998f969 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:36:28.864482 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ef252-1bf9-471c-8f32-0b0bc998f969 service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:36:28.874511 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1207/2430] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:36:28 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:36:30.396451 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b374987-153c-44f3-8ecc-545a33ca17db None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:30.397482 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b374987-153c-44f3-8ecc-545a33ca17db None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:30.397802 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b374987-153c-44f3-8ecc-545a33ca17db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:30.421203 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-4b374987-153c-44f3-8ecc-545a33ca17db None None] MFA Rules not processed for user `3f869ad16f0943ed97bfe91472f929e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:36:30.422961 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4b374987-153c-44f3-8ecc-545a33ca17db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:36:30.433498 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1224/2431] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:36:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:36:38.869503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=10 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:36:40.414311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=75,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:36:45.426815 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ef252-1bf9-471c-8f32-0b0bc998f969 service nova] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:36:45.436842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ef252-1bf9-471c-8f32-0b0bc998f969 service nova] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:36:45.440794 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958697c-f897-45fc-a5ca-eba7101bddd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:36:45.441487 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958697c-f897-45fc-a5ca-eba7101bddd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:45.441824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958697c-f897-45fc-a5ca-eba7101bddd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:45.442162 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958697c-f897-45fc-a5ca-eba7101bddd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:45.443943 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-8958697c-f897-45fc-a5ca-eba7101bddd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:36:45.508001 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958697c-f897-45fc-a5ca-eba7101bddd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:36:45.509374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958697c-f897-45fc-a5ca-eba7101bddd6 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:36:45.520157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1208/2432] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:36:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:36:47.401263 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b374987-153c-44f3-8ecc-545a33ca17db None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:36:47.403517 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4b374987-153c-44f3-8ecc-545a33ca17db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:36:47.424593 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b374987-153c-44f3-8ecc-545a33ca17db None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:36:47.432789 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d511fcd-4739-430c-9c61-0c3eef2f9763 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:36:47.433497 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d511fcd-4739-430c-9c61-0c3eef2f9763 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:47.433834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d511fcd-4739-430c-9c61-0c3eef2f9763 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:47.434168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d511fcd-4739-430c-9c61-0c3eef2f9763 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:47.436081 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5d511fcd-4739-430c-9c61-0c3eef2f9763 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:36:47.451522 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d511fcd-4739-430c-9c61-0c3eef2f9763 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:36:47.453240 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d511fcd-4739-430c-9c61-0c3eef2f9763 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:36:47.477751 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1225/2433] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:36:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:36:52.584300 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3631608-0139-4b14-9107-54380da12b11 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:36:52.584914 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3631608-0139-4b14-9107-54380da12b11 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:36:52.585376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3631608-0139-4b14-9107-54380da12b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:36:52.617193 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-d3631608-0139-4b14-9107-54380da12b11 None None] MFA Rules not processed for user `f16d427fee2b4acd8832bee31d6603e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:36:52.618468 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d3631608-0139-4b14-9107-54380da12b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:36:52.683618 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1209/2434] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:36:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:36:57.460333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=6 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:37:02.674959 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=55 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:14.161334 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d511fcd-4739-430c-9c61-0c3eef2f9763 service nova] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:14.204562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d511fcd-4739-430c-9c61-0c3eef2f9763 service nova] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:14.208846 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784286d-ca87-41a9-bd98-6dce85fc2b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:14.209468 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784286d-ca87-41a9-bd98-6dce85fc2b1f service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:14.209761 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784286d-ca87-41a9-bd98-6dce85fc2b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:14.210029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784286d-ca87-41a9-bd98-6dce85fc2b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:14.212579 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2784286d-ca87-41a9-bd98-6dce85fc2b1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:14.280390 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2784286d-ca87-41a9-bd98-6dce85fc2b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:14.281814 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2784286d-ca87-41a9-bd98-6dce85fc2b1f service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:14.302124 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1226/2435] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:38:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:38:17.596545 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3631608-0139-4b14-9107-54380da12b11 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:17.598440 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d3631608-0139-4b14-9107-54380da12b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:17.650795 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3631608-0139-4b14-9107-54380da12b11 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:17.655657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95133bf1-4337-4943-81d7-62cf5017eb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:17.656325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95133bf1-4337-4943-81d7-62cf5017eb8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:17.656608 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95133bf1-4337-4943-81d7-62cf5017eb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:17.656875 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95133bf1-4337-4943-81d7-62cf5017eb8b admin admin] PATH_INFO: `/v3/users/7eaef5f6ca21428a9c87bb7dffc2017d` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:17.658038 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95133bf1-4337-4943-81d7-62cf5017eb8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eaef5f6ca21428a9c87bb7dffc2017d)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:17.660002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95133bf1-4337-4943-81d7-62cf5017eb8b admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:17.713313 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-95133bf1-4337-4943-81d7-62cf5017eb8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eaef5f6ca21428a9c87bb7dffc2017d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:17.713962 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-95133bf1-4337-4943-81d7-62cf5017eb8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eaef5f6ca21428a9c87bb7dffc2017d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:17.726032 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-95133bf1-4337-4943-81d7-62cf5017eb8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eaef5f6ca21428a9c87bb7dffc2017d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:17.733793 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-95133bf1-4337-4943-81d7-62cf5017eb8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eaef5f6ca21428a9c87bb7dffc2017d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:17.740959 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-95133bf1-4337-4943-81d7-62cf5017eb8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eaef5f6ca21428a9c87bb7dffc2017d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:17.747509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1210/2436] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:38:17 2022] DELETE /identity/v3/users/7eaef5f6ca21428a9c87bb7dffc2017d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:38:17.945988 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784286d-ca87-41a9-bd98-6dce85fc2b1f service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:17.957947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784286d-ca87-41a9-bd98-6dce85fc2b1f service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:18.020730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9c98e-32ba-4221-92ee-dd2d52fd6880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:18.021287 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9c98e-32ba-4221-92ee-dd2d52fd6880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:18.021585 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9c98e-32ba-4221-92ee-dd2d52fd6880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:18.021855 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9c98e-32ba-4221-92ee-dd2d52fd6880 admin admin] PATH_INFO: `/v3/projects/d84c5f42b0ec44e08dbdd1fffafb3cc1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:18.022995 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9c98e-32ba-4221-92ee-dd2d52fd6880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d84c5f42b0ec44e08dbdd1fffafb3cc1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:18.024955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9c98e-32ba-4221-92ee-dd2d52fd6880 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:18.076805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4fc9c98e-32ba-4221-92ee-dd2d52fd6880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd84c5f42b0ec44e08dbdd1fffafb3cc1', 'request_id': 'req-4fc9c98e-32ba-4221-92ee-dd2d52fd6880'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:18.082306 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4fc9c98e-32ba-4221-92ee-dd2d52fd6880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd84c5f42b0ec44e08dbdd1fffafb3cc1', 'request_id': 'req-4fc9c98e-32ba-4221-92ee-dd2d52fd6880'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:18.088525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4fc9c98e-32ba-4221-92ee-dd2d52fd6880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd84c5f42b0ec44e08dbdd1fffafb3cc1', 'request_id': 'req-4fc9c98e-32ba-4221-92ee-dd2d52fd6880'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:18.091113 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:18.103552 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4fc9c98e-32ba-4221-92ee-dd2d52fd6880 admin admin] The token cache is being invalidate because project d84c5f42b0ec44e08dbdd1fffafb3cc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:38:18.103868 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4fc9c98e-32ba-4221-92ee-dd2d52fd6880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:18.104514 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4fc9c98e-32ba-4221-92ee-dd2d52fd6880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:18.106010 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1227/2437] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:38:17 2022] DELETE /identity/v3/projects/d84c5f42b0ec44e08dbdd1fffafb3cc1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:38:18.112119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a728b-20be-4bc9-9d6b-02c1916e90f4 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:18.112464 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a728b-20be-4bc9-9d6b-02c1916e90f4 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:18.112884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a728b-20be-4bc9-9d6b-02c1916e90f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:18.182887 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-461a728b-20be-4bc9-9d6b-02c1916e90f4 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:38:18.184134 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-461a728b-20be-4bc9-9d6b-02c1916e90f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:18.244060 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1211/2438] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:38:18.252078 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9cccc-2ea0-481b-be98-aa140a8bfb87 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:18.252370 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9cccc-2ea0-481b-be98-aa140a8bfb87 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:18.252644 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9cccc-2ea0-481b-be98-aa140a8bfb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:18.272829 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-49b9cccc-2ea0-481b-be98-aa140a8bfb87 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:38:18.275014 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-49b9cccc-2ea0-481b-be98-aa140a8bfb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:18.282952 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1228/2439] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:38:18.287338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a728b-20be-4bc9-9d6b-02c1916e90f4 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:18.298256 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a728b-20be-4bc9-9d6b-02c1916e90f4 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:18.302861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3389882-a74d-41cc-8577-f30ff22f5d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:18.303459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3389882-a74d-41cc-8577-f30ff22f5d16 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:18.303765 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3389882-a74d-41cc-8577-f30ff22f5d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:18.304040 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3389882-a74d-41cc-8577-f30ff22f5d16 admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:18.304677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3389882-a74d-41cc-8577-f30ff22f5d16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:38:18.305022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3389882-a74d-41cc-8577-f30ff22f5d16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:18.306622 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3389882-a74d-41cc-8577-f30ff22f5d16 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:18.318444 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1212/2440] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:38:18.322898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9cccc-2ea0-481b-be98-aa140a8bfb87 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:18.332203 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9cccc-2ea0-481b-be98-aa140a8bfb87 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:18.337601 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f78a1-6fb0-4a71-abe1-3c0b3fd06a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:18.338197 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f78a1-6fb0-4a71-abe1-3c0b3fd06a43 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:18.338474 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f78a1-6fb0-4a71-abe1-3c0b3fd06a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:18.338745 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f78a1-6fb0-4a71-abe1-3c0b3fd06a43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:18.339374 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f78a1-6fb0-4a71-abe1-3c0b3fd06a43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:18.341280 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f78a1-6fb0-4a71-abe1-3c0b3fd06a43 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:18.369778 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1229/2441] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:38:18 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:38:18.373961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3389882-a74d-41cc-8577-f30ff22f5d16 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:18.379058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:18.385205 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3389882-a74d-41cc-8577-f30ff22f5d16 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:18.444394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536d96d-1693-446c-b775-800613ad7a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:18.444999 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536d96d-1693-446c-b775-800613ad7a03 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:18.445279 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536d96d-1693-446c-b775-800613ad7a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:18.445562 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536d96d-1693-446c-b775-800613ad7a03 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:18.446715 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536d96d-1693-446c-b775-800613ad7a03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:18.448703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536d96d-1693-446c-b775-800613ad7a03 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:18.473396 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1213/2442] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:38:18 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:38:18.478341 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f78a1-6fb0-4a71-abe1-3c0b3fd06a43 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:18.488695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f78a1-6fb0-4a71-abe1-3c0b3fd06a43 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:18.493686 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100074d-a2e5-45fb-adbf-42f5d802478f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:18.494280 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100074d-a2e5-45fb-adbf-42f5d802478f admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:18.494559 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100074d-a2e5-45fb-adbf-42f5d802478f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:18.494826 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100074d-a2e5-45fb-adbf-42f5d802478f admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:18.495461 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100074d-a2e5-45fb-adbf-42f5d802478f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:18.497078 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100074d-a2e5-45fb-adbf-42f5d802478f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:18.507266 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1230/2443] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:38:18.512024 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536d96d-1693-446c-b775-800613ad7a03 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:18.522194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536d96d-1693-446c-b775-800613ad7a03 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:18.529101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0440d88-a3ce-4f40-959f-fb3d3d22136f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:18.529101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0440d88-a3ce-4f40-959f-fb3d3d22136f admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:18.529101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0440d88-a3ce-4f40-959f-fb3d3d22136f admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:18.529101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0440d88-a3ce-4f40-959f-fb3d3d22136f admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:18.529557 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0440d88-a3ce-4f40-959f-fb3d3d22136f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:18.530781 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0440d88-a3ce-4f40-959f-fb3d3d22136f admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:18.542499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1214/2444] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:38:18.546792 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100074d-a2e5-45fb-adbf-42f5d802478f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:18.557218 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100074d-a2e5-45fb-adbf-42f5d802478f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:18.561807 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453db00-e17e-4e1f-9eed-ce24f460791f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:18.562484 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453db00-e17e-4e1f-9eed-ce24f460791f admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:18.562755 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453db00-e17e-4e1f-9eed-ce24f460791f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:18.563021 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453db00-e17e-4e1f-9eed-ce24f460791f admin admin] PATH_INFO: `/v3/projects/f6dcd26d4f814d70bf544dd7dfc9e96a/users/b69fdd459613467b8184fa58a8ad8f76/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:18.578656 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453db00-e17e-4e1f-9eed-ce24f460791f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6dcd26d4f814d70bf544dd7dfc9e96a, user_id=b69fdd459613467b8184fa58a8ad8f76, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:18.581312 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453db00-e17e-4e1f-9eed-ce24f460791f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:18.594968 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1231/2445] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:38:18 2022] PUT /identity/v3/projects/f6dcd26d4f814d70bf544dd7dfc9e96a/users/b69fdd459613467b8184fa58a8ad8f76/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:38:18.606918 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53a5be-5e7c-413e-a6d3-882bd1a47425 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:18.607451 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53a5be-5e7c-413e-a6d3-882bd1a47425 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:18.607451 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53a5be-5e7c-413e-a6d3-882bd1a47425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:18.639026 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-6c53a5be-5e7c-413e-a6d3-882bd1a47425 None None] MFA Rules not processed for user `b69fdd459613467b8184fa58a8ad8f76`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:38:18.640280 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-6c53a5be-5e7c-413e-a6d3-882bd1a47425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:18.705622 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1215/2446] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:38:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:38:18.710224 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453db00-e17e-4e1f-9eed-ce24f460791f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:18.781376 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453db00-e17e-4e1f-9eed-ce24f460791f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:18.786094 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f4891-3037-4ea3-89b7-60af7df35ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:18.786707 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f4891-3037-4ea3-89b7-60af7df35ced admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:18.786989 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f4891-3037-4ea3-89b7-60af7df35ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:18.787262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f4891-3037-4ea3-89b7-60af7df35ced admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:18.787929 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f4891-3037-4ea3-89b7-60af7df35ced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:18.789875 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f4891-3037-4ea3-89b7-60af7df35ced admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:18.823074 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1232/2447] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:38:18 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:38:18.824213 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53a5be-5e7c-413e-a6d3-882bd1a47425 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:18.834865 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53a5be-5e7c-413e-a6d3-882bd1a47425 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:18.890715 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd18ce-db60-4818-ab05-1788026ff3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:18.891322 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd18ce-db60-4818-ab05-1788026ff3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:18.891602 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd18ce-db60-4818-ab05-1788026ff3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:18.891908 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd18ce-db60-4818-ab05-1788026ff3b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:18.892527 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd18ce-db60-4818-ab05-1788026ff3b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:18.894434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd18ce-db60-4818-ab05-1788026ff3b8 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:18.912934 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:18.921906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1216/2448] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:38:18 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:38:18.923522 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f4891-3037-4ea3-89b7-60af7df35ced admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:18.934298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f4891-3037-4ea3-89b7-60af7df35ced admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:18.939237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019167d5-631b-413f-a9e7-1fce6523e528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:18.939888 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019167d5-631b-413f-a9e7-1fce6523e528 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:18.940172 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019167d5-631b-413f-a9e7-1fce6523e528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:18.940446 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019167d5-631b-413f-a9e7-1fce6523e528 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:18.941345 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019167d5-631b-413f-a9e7-1fce6523e528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:18.942972 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019167d5-631b-413f-a9e7-1fce6523e528 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:18.954718 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1233/2449] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:38:18.958968 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd18ce-db60-4818-ab05-1788026ff3b8 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:18.974040 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd18ce-db60-4818-ab05-1788026ff3b8 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:18.978751 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488250c-8127-4cb2-821f-6b63a51a81c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:18.979396 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488250c-8127-4cb2-821f-6b63a51a81c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:18.979679 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488250c-8127-4cb2-821f-6b63a51a81c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:18.979980 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488250c-8127-4cb2-821f-6b63a51a81c2 admin admin] PATH_INFO: `/v3/projects/a41d32ba5a72462eb164fda7dfc7c63a/users/c1a04bebc7634087a781dfa31068da3b/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:18.997728 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488250c-8127-4cb2-821f-6b63a51a81c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41d32ba5a72462eb164fda7dfc7c63a, user_id=c1a04bebc7634087a781dfa31068da3b, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:19.000464 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488250c-8127-4cb2-821f-6b63a51a81c2 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:19.015118 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1217/2450] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:38:18 2022] PUT /identity/v3/projects/a41d32ba5a72462eb164fda7dfc7c63a/users/c1a04bebc7634087a781dfa31068da3b/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:38:19.019110 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019167d5-631b-413f-a9e7-1fce6523e528 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:19.029486 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019167d5-631b-413f-a9e7-1fce6523e528 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:19.087614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcf8c7-bcce-40fb-bb41-32f28789695d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:19.088164 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcf8c7-bcce-40fb-bb41-32f28789695d admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:19.088447 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcf8c7-bcce-40fb-bb41-32f28789695d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:19.088725 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcf8c7-bcce-40fb-bb41-32f28789695d admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:19.089371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcf8c7-bcce-40fb-bb41-32f28789695d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:19.090956 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcf8c7-bcce-40fb-bb41-32f28789695d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:19.096167 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:19.101798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1234/2451] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:38:19.106542 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488250c-8127-4cb2-821f-6b63a51a81c2 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:19.116831 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488250c-8127-4cb2-821f-6b63a51a81c2 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:19.122261 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf98ba-9768-44be-8390-4d28a51baa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:19.122911 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf98ba-9768-44be-8390-4d28a51baa1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:19.123189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf98ba-9768-44be-8390-4d28a51baa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:19.123461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf98ba-9768-44be-8390-4d28a51baa1c admin admin] PATH_INFO: `/v3/projects/a41d32ba5a72462eb164fda7dfc7c63a/users/c1a04bebc7634087a781dfa31068da3b/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:19.125407 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf98ba-9768-44be-8390-4d28a51baa1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41d32ba5a72462eb164fda7dfc7c63a, user_id=c1a04bebc7634087a781dfa31068da3b, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:19.128060 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf98ba-9768-44be-8390-4d28a51baa1c admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:19.139242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1218/2452] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:38:19 2022] PUT /identity/v3/projects/a41d32ba5a72462eb164fda7dfc7c63a/users/c1a04bebc7634087a781dfa31068da3b/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:38:19.149598 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000dd197-9e21-4f8e-bd4d-e9c5cb9967df None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:19.149883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000dd197-9e21-4f8e-bd4d-e9c5cb9967df None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:19.150181 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000dd197-9e21-4f8e-bd4d-e9c5cb9967df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:19.177668 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-000dd197-9e21-4f8e-bd4d-e9c5cb9967df None None] MFA Rules not processed for user `c1a04bebc7634087a781dfa31068da3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:38:19.178872 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-000dd197-9e21-4f8e-bd4d-e9c5cb9967df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:19.252844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1235/2453] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:38:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:38:19.265390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf98ba-9768-44be-8390-4d28a51baa1c admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:19.267414 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-91cf98ba-9768-44be-8390-4d28a51baa1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:19.351235 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf98ba-9768-44be-8390-4d28a51baa1c admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:19.355068 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63cb2f-2cd1-4f1d-ac5a-13628e2edd23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:19.355671 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63cb2f-2cd1-4f1d-ac5a-13628e2edd23 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:19.355989 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63cb2f-2cd1-4f1d-ac5a-13628e2edd23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:19.356257 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63cb2f-2cd1-4f1d-ac5a-13628e2edd23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:19.365332 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63cb2f-2cd1-4f1d-ac5a-13628e2edd23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:19.366758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63cb2f-2cd1-4f1d-ac5a-13628e2edd23 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:19.376362 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1219/2454] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:38:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:38:19.455218 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000dd197-9e21-4f8e-bd4d-e9c5cb9967df None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:19.465583 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000dd197-9e21-4f8e-bd4d-e9c5cb9967df None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:19.469284 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2b042-03fd-4708-a0c8-682795cebfd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:19.469884 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2b042-03fd-4708-a0c8-682795cebfd9 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:19.470180 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2b042-03fd-4708-a0c8-682795cebfd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:19.470447 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2b042-03fd-4708-a0c8-682795cebfd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:19.526910 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2b042-03fd-4708-a0c8-682795cebfd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:19.528417 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2b042-03fd-4708-a0c8-682795cebfd9 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:19.537915 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1236/2455] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:38:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:38:29.372792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=50,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:29.533659 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=62 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:34.489620 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63cb2f-2cd1-4f1d-ac5a-13628e2edd23 service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:34.498702 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-1e63cb2f-2cd1-4f1d-ac5a-13628e2edd23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:34.624403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63cb2f-2cd1-4f1d-ac5a-13628e2edd23 service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:34.629999 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f1f7c-7db3-4dc0-b02a-4a98224b7592 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f98c07455a241398784d221df273aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:34.630734 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f1f7c-7db3-4dc0-b02a-4a98224b7592 service placement] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:34.631015 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f1f7c-7db3-4dc0-b02a-4a98224b7592 service placement] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:34.631285 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f1f7c-7db3-4dc0-b02a-4a98224b7592 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:34.633218 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-ac9f1f7c-7db3-4dc0-b02a-4a98224b7592 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:34.652186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f1f7c-7db3-4dc0-b02a-4a98224b7592 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:34.654185 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f1f7c-7db3-4dc0-b02a-4a98224b7592 service placement] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:34.675258 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1220/2456] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:38:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:38:44.668503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=41 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:49.546533 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2b042-03fd-4708-a0c8-682795cebfd9 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:49.615209 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2b042-03fd-4708-a0c8-682795cebfd9 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:49.621431 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3da967-bccc-420f-b547-d521c9d3d8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:49.622087 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3da967-bccc-420f-b547-d521c9d3d8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:49.622372 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3da967-bccc-420f-b547-d521c9d3d8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:49.622676 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3da967-bccc-420f-b547-d521c9d3d8e6 admin admin] PATH_INFO: `/v3/users/b69fdd459613467b8184fa58a8ad8f76` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:49.623857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3da967-bccc-420f-b547-d521c9d3d8e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b69fdd459613467b8184fa58a8ad8f76)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:49.625821 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3da967-bccc-420f-b547-d521c9d3d8e6 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:49.698305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ed3da967-bccc-420f-b547-d521c9d3d8e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b69fdd459613467b8184fa58a8ad8f76'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:49.699002 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ed3da967-bccc-420f-b547-d521c9d3d8e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b69fdd459613467b8184fa58a8ad8f76'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:49.706139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ed3da967-bccc-420f-b547-d521c9d3d8e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b69fdd459613467b8184fa58a8ad8f76'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:49.719151 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ed3da967-bccc-420f-b547-d521c9d3d8e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b69fdd459613467b8184fa58a8ad8f76'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:49.730058 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-ed3da967-bccc-420f-b547-d521c9d3d8e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b69fdd459613467b8184fa58a8ad8f76'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:49.736452 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1237/2457] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:38:49 2022] DELETE /identity/v3/users/b69fdd459613467b8184fa58a8ad8f76 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:38:49.741016 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d86d70-beb0-4be0-b2a5-ce8119cfe8eb None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:49.741496 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d86d70-beb0-4be0-b2a5-ce8119cfe8eb None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:49.741594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d86d70-beb0-4be0-b2a5-ce8119cfe8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:49.762339 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-97d86d70-beb0-4be0-b2a5-ce8119cfe8eb None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:38:49.763536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-97d86d70-beb0-4be0-b2a5-ce8119cfe8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:49.830917 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1221/2458] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:38:49.842599 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3da967-bccc-420f-b547-d521c9d3d8e6 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:49.844056 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ed3da967-bccc-420f-b547-d521c9d3d8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:49.920572 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3da967-bccc-420f-b547-d521c9d3d8e6 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:49.924666 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67ec1b-958f-4c3a-841a-a88af86fcc48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:49.925420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67ec1b-958f-4c3a-841a-a88af86fcc48 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:49.925727 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67ec1b-958f-4c3a-841a-a88af86fcc48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:49.926035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67ec1b-958f-4c3a-841a-a88af86fcc48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:49.936210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67ec1b-958f-4c3a-841a-a88af86fcc48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:49.937730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67ec1b-958f-4c3a-841a-a88af86fcc48 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:49.948861 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1238/2459] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:38:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:38:50.228541 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d86d70-beb0-4be0-b2a5-ce8119cfe8eb None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:50.230066 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-97d86d70-beb0-4be0-b2a5-ce8119cfe8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:50.242097 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d86d70-beb0-4be0-b2a5-ce8119cfe8eb None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:50.247606 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c466be-6145-411b-86b1-11ebdc858722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:50.248304 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c466be-6145-411b-86b1-11ebdc858722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:50.248999 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c466be-6145-411b-86b1-11ebdc858722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:50.248999 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c466be-6145-411b-86b1-11ebdc858722 admin admin] PATH_INFO: `/v3/projects/f6dcd26d4f814d70bf544dd7dfc9e96a` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:50.249987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c466be-6145-411b-86b1-11ebdc858722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6dcd26d4f814d70bf544dd7dfc9e96a)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:50.251902 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c466be-6145-411b-86b1-11ebdc858722 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:50.300468 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b0c466be-6145-411b-86b1-11ebdc858722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6dcd26d4f814d70bf544dd7dfc9e96a', 'request_id': 'req-b0c466be-6145-411b-86b1-11ebdc858722'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:50.306533 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b0c466be-6145-411b-86b1-11ebdc858722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6dcd26d4f814d70bf544dd7dfc9e96a', 'request_id': 'req-b0c466be-6145-411b-86b1-11ebdc858722'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:50.314319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b0c466be-6145-411b-86b1-11ebdc858722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6dcd26d4f814d70bf544dd7dfc9e96a', 'request_id': 'req-b0c466be-6145-411b-86b1-11ebdc858722'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:50.326366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b0c466be-6145-411b-86b1-11ebdc858722 admin admin] The token cache is being invalidate because project f6dcd26d4f814d70bf544dd7dfc9e96a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:38:50.326656 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b0c466be-6145-411b-86b1-11ebdc858722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:50.327296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-b0c466be-6145-411b-86b1-11ebdc858722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:50.328807 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1222/2460] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:38:50 2022] DELETE /identity/v3/projects/f6dcd26d4f814d70bf544dd7dfc9e96a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:38:50.332882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67ec1b-958f-4c3a-841a-a88af86fcc48 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:50.343962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67ec1b-958f-4c3a-841a-a88af86fcc48 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:50.352035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:50.407473 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ec6f7-e0c0-457e-8c5b-8555bd00716e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:50.408165 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ec6f7-e0c0-457e-8c5b-8555bd00716e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:50.408441 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ec6f7-e0c0-457e-8c5b-8555bd00716e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:50.408709 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ec6f7-e0c0-457e-8c5b-8555bd00716e admin admin] PATH_INFO: `/v3/users/c1a04bebc7634087a781dfa31068da3b` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:50.409822 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ec6f7-e0c0-457e-8c5b-8555bd00716e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1a04bebc7634087a781dfa31068da3b)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:50.411734 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ec6f7-e0c0-457e-8c5b-8555bd00716e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:50.458172 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8d9ec6f7-e0c0-457e-8c5b-8555bd00716e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1a04bebc7634087a781dfa31068da3b'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:50.458813 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8d9ec6f7-e0c0-457e-8c5b-8555bd00716e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1a04bebc7634087a781dfa31068da3b'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:50.466194 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8d9ec6f7-e0c0-457e-8c5b-8555bd00716e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1a04bebc7634087a781dfa31068da3b'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:50.478329 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8d9ec6f7-e0c0-457e-8c5b-8555bd00716e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1a04bebc7634087a781dfa31068da3b'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:50.485152 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8d9ec6f7-e0c0-457e-8c5b-8555bd00716e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1a04bebc7634087a781dfa31068da3b'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:50.490927 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1239/2461] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:38:50 2022] DELETE /identity/v3/users/c1a04bebc7634087a781dfa31068da3b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:38:50.787227 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c466be-6145-411b-86b1-11ebdc858722 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:50.788888 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b0c466be-6145-411b-86b1-11ebdc858722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:50.803308 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c466be-6145-411b-86b1-11ebdc858722 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:50.871664 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038c58c-dd0f-4500-b31c-5aa433c097d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:50.872440 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038c58c-dd0f-4500-b31c-5aa433c097d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:50.873258 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038c58c-dd0f-4500-b31c-5aa433c097d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:50.873258 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038c58c-dd0f-4500-b31c-5aa433c097d0 admin admin] PATH_INFO: `/v3/projects/a41d32ba5a72462eb164fda7dfc7c63a` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:50.874323 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038c58c-dd0f-4500-b31c-5aa433c097d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a41d32ba5a72462eb164fda7dfc7c63a)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:50.878642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038c58c-dd0f-4500-b31c-5aa433c097d0 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:50.923753 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:50.953676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c038c58c-dd0f-4500-b31c-5aa433c097d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a41d32ba5a72462eb164fda7dfc7c63a', 'request_id': 'req-c038c58c-dd0f-4500-b31c-5aa433c097d0'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:50.963077 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c038c58c-dd0f-4500-b31c-5aa433c097d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a41d32ba5a72462eb164fda7dfc7c63a', 'request_id': 'req-c038c58c-dd0f-4500-b31c-5aa433c097d0'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:50.974215 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c038c58c-dd0f-4500-b31c-5aa433c097d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a41d32ba5a72462eb164fda7dfc7c63a', 'request_id': 'req-c038c58c-dd0f-4500-b31c-5aa433c097d0'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:50.998070 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c038c58c-dd0f-4500-b31c-5aa433c097d0 admin admin] The token cache is being invalidate because project a41d32ba5a72462eb164fda7dfc7c63a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:38:50.998445 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c038c58c-dd0f-4500-b31c-5aa433c097d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:50.999516 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c038c58c-dd0f-4500-b31c-5aa433c097d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:51.005096 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1223/2462] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:38:50 2022] DELETE /identity/v3/projects/a41d32ba5a72462eb164fda7dfc7c63a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:38:51.006412 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ad1fc-ce57-47e5-97f5-477df3835118 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:51.006869 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ad1fc-ce57-47e5-97f5-477df3835118 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:51.006970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ad1fc-ce57-47e5-97f5-477df3835118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:51.032336 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-899ad1fc-ce57-47e5-97f5-477df3835118 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:38:51.035257 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-899ad1fc-ce57-47e5-97f5-477df3835118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:51.106575 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1240/2463] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:38:51.115755 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a081e-a85c-4a3b-948f-b80bc737edbd None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:51.116044 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a081e-a85c-4a3b-948f-b80bc737edbd None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:51.116344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a081e-a85c-4a3b-948f-b80bc737edbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:51.137632 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-583a081e-a85c-4a3b-948f-b80bc737edbd None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:38:51.138822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-583a081e-a85c-4a3b-948f-b80bc737edbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:51.155942 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1224/2464] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:38:51.156122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ad1fc-ce57-47e5-97f5-477df3835118 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:51.162004 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ad1fc-ce57-47e5-97f5-477df3835118 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:51.167855 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47656012-a7e6-4a68-94ac-0c8aeac748a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:51.168577 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47656012-a7e6-4a68-94ac-0c8aeac748a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:51.168913 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47656012-a7e6-4a68-94ac-0c8aeac748a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:51.169161 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47656012-a7e6-4a68-94ac-0c8aeac748a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:51.169815 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47656012-a7e6-4a68-94ac-0c8aeac748a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:38:51.170117 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47656012-a7e6-4a68-94ac-0c8aeac748a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:51.171703 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47656012-a7e6-4a68-94ac-0c8aeac748a5 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:51.184293 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1241/2465] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:38:51.188594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a081e-a85c-4a3b-948f-b80bc737edbd None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:51.198643 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a081e-a85c-4a3b-948f-b80bc737edbd None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:51.203301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f332237-4cbb-4dd2-9b09-7232f5289380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:51.203993 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f332237-4cbb-4dd2-9b09-7232f5289380 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:51.204207 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f332237-4cbb-4dd2-9b09-7232f5289380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:51.204589 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f332237-4cbb-4dd2-9b09-7232f5289380 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:51.205227 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f332237-4cbb-4dd2-9b09-7232f5289380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:51.207113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f332237-4cbb-4dd2-9b09-7232f5289380 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:51.235214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1225/2466] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:38:51 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:38:51.239446 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47656012-a7e6-4a68-94ac-0c8aeac748a5 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:51.251065 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47656012-a7e6-4a68-94ac-0c8aeac748a5 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:51.265599 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:51.318106 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9dbe65-a4f2-46fe-af32-be747141aa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:51.318713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9dbe65-a4f2-46fe-af32-be747141aa92 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:51.318995 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9dbe65-a4f2-46fe-af32-be747141aa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:51.319266 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9dbe65-a4f2-46fe-af32-be747141aa92 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:51.319946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9dbe65-a4f2-46fe-af32-be747141aa92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:51.322917 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9dbe65-a4f2-46fe-af32-be747141aa92 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:51.343950 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1242/2467] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:38:51 2022] POST /identity/v3/users => generated 282 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:38:51.348177 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f332237-4cbb-4dd2-9b09-7232f5289380 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:51.360664 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f332237-4cbb-4dd2-9b09-7232f5289380 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:51.366197 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae74b3-672a-48e1-b74c-8e1c0ab191bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:51.366823 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae74b3-672a-48e1-b74c-8e1c0ab191bd admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:51.367102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae74b3-672a-48e1-b74c-8e1c0ab191bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:51.367372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae74b3-672a-48e1-b74c-8e1c0ab191bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:51.368085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae74b3-672a-48e1-b74c-8e1c0ab191bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:51.370868 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae74b3-672a-48e1-b74c-8e1c0ab191bd admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:51.381304 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1226/2468] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:38:51.386072 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9dbe65-a4f2-46fe-af32-be747141aa92 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:51.396159 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9dbe65-a4f2-46fe-af32-be747141aa92 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:51.400969 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f81d85-d637-4f3f-9373-dc2037f3a644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:51.401556 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f81d85-d637-4f3f-9373-dc2037f3a644 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:51.402236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f81d85-d637-4f3f-9373-dc2037f3a644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:51.402525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f81d85-d637-4f3f-9373-dc2037f3a644 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:51.403163 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f81d85-d637-4f3f-9373-dc2037f3a644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:51.404787 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f81d85-d637-4f3f-9373-dc2037f3a644 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:51.415910 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1243/2469] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:38:51.420140 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae74b3-672a-48e1-b74c-8e1c0ab191bd admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:51.429870 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae74b3-672a-48e1-b74c-8e1c0ab191bd admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:51.434925 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112039f-03ca-414d-954c-0dcb691be5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:51.435556 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112039f-03ca-414d-954c-0dcb691be5be admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:51.435868 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112039f-03ca-414d-954c-0dcb691be5be admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:51.436134 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112039f-03ca-414d-954c-0dcb691be5be admin admin] PATH_INFO: `/v3/projects/86d3fc02dde5407d8a460f79d24d751d/users/e6b4150b480a4c6e825a896887b53e95/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:51.451160 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112039f-03ca-414d-954c-0dcb691be5be admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d3fc02dde5407d8a460f79d24d751d, user_id=e6b4150b480a4c6e825a896887b53e95, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:51.453814 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112039f-03ca-414d-954c-0dcb691be5be admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:51.466462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1227/2470] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:38:51 2022] PUT /identity/v3/projects/86d3fc02dde5407d8a460f79d24d751d/users/e6b4150b480a4c6e825a896887b53e95/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:38:51.476537 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d5f85-d666-4c78-baca-35f2b4c5d7d6 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:51.476819 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d5f85-d666-4c78-baca-35f2b4c5d7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:51.477088 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d5f85-d666-4c78-baca-35f2b4c5d7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:51.504658 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ac3d5f85-d666-4c78-baca-35f2b4c5d7d6 None None] MFA Rules not processed for user `e6b4150b480a4c6e825a896887b53e95`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:38:51.505851 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ac3d5f85-d666-4c78-baca-35f2b4c5d7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:51.576136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1244/2471] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:38:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:38:51.580789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112039f-03ca-414d-954c-0dcb691be5be admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:51.641985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112039f-03ca-414d-954c-0dcb691be5be admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:51.646768 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53ed14-6564-4258-a42c-9baac60e3080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:51.647292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53ed14-6564-4258-a42c-9baac60e3080 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:51.647571 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53ed14-6564-4258-a42c-9baac60e3080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:51.647873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53ed14-6564-4258-a42c-9baac60e3080 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:51.648513 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53ed14-6564-4258-a42c-9baac60e3080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:51.650488 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53ed14-6564-4258-a42c-9baac60e3080 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:51.680774 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1228/2472] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:38:51 2022] POST /identity/v3/projects => generated 363 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:38:51.682574 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d5f85-d666-4c78-baca-35f2b4c5d7d6 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:51.693855 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d5f85-d666-4c78-baca-35f2b4c5d7d6 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:51.751143 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e262a0-ead3-40f9-a601-95eff17dcf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:51.751771 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e262a0-ead3-40f9-a601-95eff17dcf5c admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:51.752052 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e262a0-ead3-40f9-a601-95eff17dcf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:51.752322 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e262a0-ead3-40f9-a601-95eff17dcf5c admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:51.752967 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e262a0-ead3-40f9-a601-95eff17dcf5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:51.754879 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e262a0-ead3-40f9-a601-95eff17dcf5c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:51.775651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1245/2473] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:38:51 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:38:51.779666 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53ed14-6564-4258-a42c-9baac60e3080 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:51.789824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53ed14-6564-4258-a42c-9baac60e3080 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:51.795349 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7ce69-13dc-46f6-8872-bbf704eda4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:51.795970 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7ce69-13dc-46f6-8872-bbf704eda4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:51.796248 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7ce69-13dc-46f6-8872-bbf704eda4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:51.796516 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7ce69-13dc-46f6-8872-bbf704eda4a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:51.797148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f7ce69-13dc-46f6-8872-bbf704eda4a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:51.798738 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f7ce69-13dc-46f6-8872-bbf704eda4a5 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:51.810425 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1229/2474] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:38:51.815587 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e262a0-ead3-40f9-a601-95eff17dcf5c admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:51.825926 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e262a0-ead3-40f9-a601-95eff17dcf5c admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:51.830588 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af66cc1-554e-4401-a536-21194a474fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:51.831242 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af66cc1-554e-4401-a536-21194a474fff admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:51.831522 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af66cc1-554e-4401-a536-21194a474fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:51.831925 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af66cc1-554e-4401-a536-21194a474fff admin admin] PATH_INFO: `/v3/projects/5a5d9a2c7d8c41298c754968a533f60e/users/b62fbddc1b154873846241ccd16118ed/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:51.844151 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:51.847857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af66cc1-554e-4401-a536-21194a474fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a5d9a2c7d8c41298c754968a533f60e, user_id=b62fbddc1b154873846241ccd16118ed, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:51.851374 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af66cc1-554e-4401-a536-21194a474fff admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:51.865066 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1246/2475] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:38:51 2022] PUT /identity/v3/projects/5a5d9a2c7d8c41298c754968a533f60e/users/b62fbddc1b154873846241ccd16118ed/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:38:51.869906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7ce69-13dc-46f6-8872-bbf704eda4a5 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:51.880802 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7ce69-13dc-46f6-8872-bbf704eda4a5 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:51.900481 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:51.940341 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77800c1a-371d-45a5-adb8-cc768ab73c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:51.940939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77800c1a-371d-45a5-adb8-cc768ab73c51 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:51.941470 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77800c1a-371d-45a5-adb8-cc768ab73c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:51.941737 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77800c1a-371d-45a5-adb8-cc768ab73c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:51.942359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77800c1a-371d-45a5-adb8-cc768ab73c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:51.943963 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77800c1a-371d-45a5-adb8-cc768ab73c51 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:51.953943 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1230/2476] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:38:51.958228 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af66cc1-554e-4401-a536-21194a474fff admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:51.969646 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af66cc1-554e-4401-a536-21194a474fff admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:51.974329 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f2f02-1748-4b51-b618-928b1f547874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:51.974979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f2f02-1748-4b51-b618-928b1f547874 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:51.975278 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f2f02-1748-4b51-b618-928b1f547874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:51.975555 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f2f02-1748-4b51-b618-928b1f547874 admin admin] PATH_INFO: `/v3/projects/5a5d9a2c7d8c41298c754968a533f60e/users/b62fbddc1b154873846241ccd16118ed/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:51.977594 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f2f02-1748-4b51-b618-928b1f547874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a5d9a2c7d8c41298c754968a533f60e, user_id=b62fbddc1b154873846241ccd16118ed, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:51.981690 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f2f02-1748-4b51-b618-928b1f547874 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:51.992284 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1247/2477] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:38:51 2022] PUT /identity/v3/projects/5a5d9a2c7d8c41298c754968a533f60e/users/b62fbddc1b154873846241ccd16118ed/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:38:52.004544 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73047d5-d379-4661-89e9-e63edf57fc24 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:52.004825 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73047d5-d379-4661-89e9-e63edf57fc24 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:52.005099 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73047d5-d379-4661-89e9-e63edf57fc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:52.034466 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-d73047d5-d379-4661-89e9-e63edf57fc24 None None] MFA Rules not processed for user `b62fbddc1b154873846241ccd16118ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:38:52.035725 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d73047d5-d379-4661-89e9-e63edf57fc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:52.110177 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1231/2478] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:38:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:38:52.122340 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f2f02-1748-4b51-b618-928b1f547874 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:52.124165 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-540f2f02-1748-4b51-b618-928b1f547874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:52.197336 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f2f02-1748-4b51-b618-928b1f547874 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:52.201631 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da670662-3254-4b4c-a53b-b6ec1fafd805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:52.202375 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da670662-3254-4b4c-a53b-b6ec1fafd805 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:52.204088 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da670662-3254-4b4c-a53b-b6ec1fafd805 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:52.204430 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da670662-3254-4b4c-a53b-b6ec1fafd805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:52.215482 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da670662-3254-4b4c-a53b-b6ec1fafd805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:52.222866 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da670662-3254-4b4c-a53b-b6ec1fafd805 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:52.229322 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1248/2479] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:38:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:38:52.273174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73047d5-d379-4661-89e9-e63edf57fc24 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:52.274553 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d73047d5-d379-4661-89e9-e63edf57fc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:52.308174 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da670662-3254-4b4c-a53b-b6ec1fafd805 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:52.316987 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da670662-3254-4b4c-a53b-b6ec1fafd805 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:52.320864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e687cc7-b31d-4d4a-901e-1853aa82fdd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:52.321470 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e687cc7-b31d-4d4a-901e-1853aa82fdd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:52.322297 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e687cc7-b31d-4d4a-901e-1853aa82fdd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:52.322631 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e687cc7-b31d-4d4a-901e-1853aa82fdd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:52.335323 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73047d5-d379-4661-89e9-e63edf57fc24 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:52.340310 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81db15-5962-48f6-87e8-507e04da3254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:52.341134 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81db15-5962-48f6-87e8-507e04da3254 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:52.341410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81db15-5962-48f6-87e8-507e04da3254 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:52.341674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81db15-5962-48f6-87e8-507e04da3254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:52.343392 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-6b81db15-5962-48f6-87e8-507e04da3254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:52.385569 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e687cc7-b31d-4d4a-901e-1853aa82fdd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:52.387220 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e687cc7-b31d-4d4a-901e-1853aa82fdd2 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:52.397184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1249/2480] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:38:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:38:52.417133 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:52.419768 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81db15-5962-48f6-87e8-507e04da3254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:52.421542 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81db15-5962-48f6-87e8-507e04da3254 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:52.431965 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1232/2481] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:38:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:38:55.203803 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e687cc7-b31d-4d4a-901e-1853aa82fdd2 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:55.216078 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e687cc7-b31d-4d4a-901e-1853aa82fdd2 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:55.222674 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598de7b-dffd-4d56-8018-aef53b6cffba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:55.223320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598de7b-dffd-4d56-8018-aef53b6cffba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:55.223628 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598de7b-dffd-4d56-8018-aef53b6cffba admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:55.223913 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598de7b-dffd-4d56-8018-aef53b6cffba admin admin] PATH_INFO: `/v3/users/e6b4150b480a4c6e825a896887b53e95` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:55.226348 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598de7b-dffd-4d56-8018-aef53b6cffba admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6b4150b480a4c6e825a896887b53e95)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:55.227976 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598de7b-dffd-4d56-8018-aef53b6cffba admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:55.288783 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e598de7b-dffd-4d56-8018-aef53b6cffba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6b4150b480a4c6e825a896887b53e95'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:55.289832 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e598de7b-dffd-4d56-8018-aef53b6cffba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6b4150b480a4c6e825a896887b53e95'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:55.302485 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e598de7b-dffd-4d56-8018-aef53b6cffba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6b4150b480a4c6e825a896887b53e95'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:55.319515 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e598de7b-dffd-4d56-8018-aef53b6cffba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6b4150b480a4c6e825a896887b53e95'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:55.322836 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:55.331270 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e598de7b-dffd-4d56-8018-aef53b6cffba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6b4150b480a4c6e825a896887b53e95'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:55.343320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1250/2482] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:38:55 2022] DELETE /identity/v3/users/e6b4150b480a4c6e825a896887b53e95 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:38:55.347792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb61b6-3101-4d02-87a3-eaba81240943 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:55.348227 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb61b6-3101-4d02-87a3-eaba81240943 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:55.348337 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb61b6-3101-4d02-87a3-eaba81240943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:55.370889 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-a2fb61b6-3101-4d02-87a3-eaba81240943 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:38:55.372524 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a2fb61b6-3101-4d02-87a3-eaba81240943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:55.469062 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1233/2483] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:38:55.477226 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598de7b-dffd-4d56-8018-aef53b6cffba admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:55.479815 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e598de7b-dffd-4d56-8018-aef53b6cffba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:55.572562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598de7b-dffd-4d56-8018-aef53b6cffba admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:55.576980 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5a7e2-0fa8-45b6-aa69-4c95ecc8e512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:55.577665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5a7e2-0fa8-45b6-aa69-4c95ecc8e512 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:55.577945 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5a7e2-0fa8-45b6-aa69-4c95ecc8e512 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:55.578213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5a7e2-0fa8-45b6-aa69-4c95ecc8e512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:55.594523 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5a7e2-0fa8-45b6-aa69-4c95ecc8e512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:55.596079 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5a7e2-0fa8-45b6-aa69-4c95ecc8e512 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:55.613156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1251/2484] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:38:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:38:55.992700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb61b6-3101-4d02-87a3-eaba81240943 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:55.995241 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a2fb61b6-3101-4d02-87a3-eaba81240943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:56.030220 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb61b6-3101-4d02-87a3-eaba81240943 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:56.034842 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1458a-26fd-4875-a3d2-f5610a703399 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:56.035199 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1458a-26fd-4875-a3d2-f5610a703399 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:56.035424 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1458a-26fd-4875-a3d2-f5610a703399 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:56.036819 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1252/2485] 10.222.0.62 () {54 vars in 921 bytes} [Tue Oct 4 14:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:38:56.037735 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141a1a0-9778-4f25-a345-d26bb29f6c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:56.038453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141a1a0-9778-4f25-a345-d26bb29f6c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:56.039281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141a1a0-9778-4f25-a345-d26bb29f6c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:56.039281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141a1a0-9778-4f25-a345-d26bb29f6c04 admin admin] PATH_INFO: `/v3/projects/86d3fc02dde5407d8a460f79d24d751d` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:56.044174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141a1a0-9778-4f25-a345-d26bb29f6c04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86d3fc02dde5407d8a460f79d24d751d)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:56.046675 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141a1a0-9778-4f25-a345-d26bb29f6c04 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:56.078433 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7e3ce-c472-4a85-8944-e31d5a57f7a9 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:56.079278 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7e3ce-c472-4a85-8944-e31d5a57f7a9 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:56.079732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7e3ce-c472-4a85-8944-e31d5a57f7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:56.132293 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-7141a1a0-9778-4f25-a345-d26bb29f6c04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86d3fc02dde5407d8a460f79d24d751d', 'request_id': 'req-7141a1a0-9778-4f25-a345-d26bb29f6c04'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:56.145010 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-7141a1a0-9778-4f25-a345-d26bb29f6c04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86d3fc02dde5407d8a460f79d24d751d', 'request_id': 'req-7141a1a0-9778-4f25-a345-d26bb29f6c04'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:56.179499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-7141a1a0-9778-4f25-a345-d26bb29f6c04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86d3fc02dde5407d8a460f79d24d751d', 'request_id': 'req-7141a1a0-9778-4f25-a345-d26bb29f6c04'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:56.180070 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-2be7e3ce-c472-4a85-8944-e31d5a57f7a9 None None] MFA Rules not processed for user `6f98c07455a241398784d221df273aba`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:38:56.180070 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2be7e3ce-c472-4a85-8944-e31d5a57f7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:56.192206 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-7141a1a0-9778-4f25-a345-d26bb29f6c04 admin admin] The token cache is being invalidate because project 86d3fc02dde5407d8a460f79d24d751d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:38:56.192522 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-7141a1a0-9778-4f25-a345-d26bb29f6c04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:56.193234 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-7141a1a0-9778-4f25-a345-d26bb29f6c04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:56.194692 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1234/2486] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:38:55 2022] DELETE /identity/v3/projects/86d3fc02dde5407d8a460f79d24d751d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:38:56.195795 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141a1a0-9778-4f25-a345-d26bb29f6c04 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:56.197071 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-7141a1a0-9778-4f25-a345-d26bb29f6c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:56.247398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1253/2487] 10.222.0.62 () {58 vars in 1018 bytes} [Tue Oct 4 14:38:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:38:56.248290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7e3ce-c472-4a85-8944-e31d5a57f7a9 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:56.249863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-2be7e3ce-c472-4a85-8944-e31d5a57f7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:56.265093 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141a1a0-9778-4f25-a345-d26bb29f6c04 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:56.265279 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7e3ce-c472-4a85-8944-e31d5a57f7a9 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:56.269962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522aca79-2738-4e6f-8ea6-5f46a034d15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:56.270106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdc188-9cf7-451e-bd89-4b81dca6cbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:56.270661 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522aca79-2738-4e6f-8ea6-5f46a034d15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:56.270905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdc188-9cf7-451e-bd89-4b81dca6cbdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:56.271025 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522aca79-2738-4e6f-8ea6-5f46a034d15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:56.271201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522aca79-2738-4e6f-8ea6-5f46a034d15e admin admin] PATH_INFO: `/v3/users/b62fbddc1b154873846241ccd16118ed` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:56.271305 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdc188-9cf7-451e-bd89-4b81dca6cbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:56.271581 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdc188-9cf7-451e-bd89-4b81dca6cbdd admin admin] PATH_INFO: `/v3/users/f16d427fee2b4acd8832bee31d6603e2` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:56.272492 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522aca79-2738-4e6f-8ea6-5f46a034d15e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b62fbddc1b154873846241ccd16118ed)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:56.273148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bdc188-9cf7-451e-bd89-4b81dca6cbdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f16d427fee2b4acd8832bee31d6603e2)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:56.274408 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522aca79-2738-4e6f-8ea6-5f46a034d15e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:56.275893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bdc188-9cf7-451e-bd89-4b81dca6cbdd admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:56.307686 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:56.336409 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-522aca79-2738-4e6f-8ea6-5f46a034d15e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b62fbddc1b154873846241ccd16118ed'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:56.337125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-522aca79-2738-4e6f-8ea6-5f46a034d15e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b62fbddc1b154873846241ccd16118ed'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:56.342780 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-18bdc188-9cf7-451e-bd89-4b81dca6cbdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f16d427fee2b4acd8832bee31d6603e2'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:56.343544 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-18bdc188-9cf7-451e-bd89-4b81dca6cbdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f16d427fee2b4acd8832bee31d6603e2'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:56.346723 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-522aca79-2738-4e6f-8ea6-5f46a034d15e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b62fbddc1b154873846241ccd16118ed'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:56.355789 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:56.358237 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-18bdc188-9cf7-451e-bd89-4b81dca6cbdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f16d427fee2b4acd8832bee31d6603e2'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:56.365680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-522aca79-2738-4e6f-8ea6-5f46a034d15e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b62fbddc1b154873846241ccd16118ed'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:56.367225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-18bdc188-9cf7-451e-bd89-4b81dca6cbdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f16d427fee2b4acd8832bee31d6603e2'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:56.374723 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-522aca79-2738-4e6f-8ea6-5f46a034d15e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b62fbddc1b154873846241ccd16118ed'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:56.381107 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1254/2488] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:38:56 2022] DELETE /identity/v3/users/b62fbddc1b154873846241ccd16118ed => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:38:56.381917 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-18bdc188-9cf7-451e-bd89-4b81dca6cbdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f16d427fee2b4acd8832bee31d6603e2'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:56.386342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522aca79-2738-4e6f-8ea6-5f46a034d15e admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:56.387606 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-522aca79-2738-4e6f-8ea6-5f46a034d15e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:56.397891 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1235/2489] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:38:56 2022] DELETE /identity/v3/users/f16d427fee2b4acd8832bee31d6603e2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:38:56.489232 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522aca79-2738-4e6f-8ea6-5f46a034d15e admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:56.566646 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f12a96-dbe2-40da-b1bc-5d4c2798a399 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f98c07455a241398784d221df273aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:56.567402 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f12a96-dbe2-40da-b1bc-5d4c2798a399 service placement] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:56.567676 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f12a96-dbe2-40da-b1bc-5d4c2798a399 service placement] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:56.567970 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f12a96-dbe2-40da-b1bc-5d4c2798a399 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:56.569733 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f6f12a96-dbe2-40da-b1bc-5d4c2798a399 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:56.581175 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f12a96-dbe2-40da-b1bc-5d4c2798a399 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:56.582728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f12a96-dbe2-40da-b1bc-5d4c2798a399 service placement] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:56.593638 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1255/2490] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:38:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:38:56.684560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdc188-9cf7-451e-bd89-4b81dca6cbdd admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:56.686701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-18bdc188-9cf7-451e-bd89-4b81dca6cbdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:56.762201 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdc188-9cf7-451e-bd89-4b81dca6cbdd admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:56.767513 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66433ef7-de50-47ff-a88b-e48aab02bd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:56.768246 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66433ef7-de50-47ff-a88b-e48aab02bd51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:56.768619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66433ef7-de50-47ff-a88b-e48aab02bd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:56.768965 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66433ef7-de50-47ff-a88b-e48aab02bd51 admin admin] PATH_INFO: `/v3/projects/a27288b8a2aa47f5ac8dd00277fe91f0` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:56.770091 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66433ef7-de50-47ff-a88b-e48aab02bd51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a27288b8a2aa47f5ac8dd00277fe91f0)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:56.772197 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66433ef7-de50-47ff-a88b-e48aab02bd51 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:56.788529 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f12a96-dbe2-40da-b1bc-5d4c2798a399 service placement] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:56.790913 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f6f12a96-dbe2-40da-b1bc-5d4c2798a399 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:56.814416 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f12a96-dbe2-40da-b1bc-5d4c2798a399 service placement] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:56.830678 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-66433ef7-de50-47ff-a88b-e48aab02bd51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a27288b8a2aa47f5ac8dd00277fe91f0', 'request_id': 'req-66433ef7-de50-47ff-a88b-e48aab02bd51'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:56.837098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-66433ef7-de50-47ff-a88b-e48aab02bd51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a27288b8a2aa47f5ac8dd00277fe91f0', 'request_id': 'req-66433ef7-de50-47ff-a88b-e48aab02bd51'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:56.845866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-66433ef7-de50-47ff-a88b-e48aab02bd51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a27288b8a2aa47f5ac8dd00277fe91f0', 'request_id': 'req-66433ef7-de50-47ff-a88b-e48aab02bd51'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:56.859583 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-66433ef7-de50-47ff-a88b-e48aab02bd51 admin admin] The token cache is being invalidate because project a27288b8a2aa47f5ac8dd00277fe91f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:38:56.859910 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-66433ef7-de50-47ff-a88b-e48aab02bd51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:56.860582 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-66433ef7-de50-47ff-a88b-e48aab02bd51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:56.862099 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1236/2491] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:38:56 2022] DELETE /identity/v3/projects/a27288b8a2aa47f5ac8dd00277fe91f0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:38:56.868012 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c335f1-e5e1-4131-ae7e-765ae133acb6 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:56.868310 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c335f1-e5e1-4131-ae7e-765ae133acb6 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:56.868650 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c335f1-e5e1-4131-ae7e-765ae133acb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:56.879982 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808dc971-73c0-449b-b365-078882a356b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:56.880628 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808dc971-73c0-449b-b365-078882a356b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:56.880906 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808dc971-73c0-449b-b365-078882a356b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:56.881177 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808dc971-73c0-449b-b365-078882a356b5 admin admin] PATH_INFO: `/v3/projects/5a5d9a2c7d8c41298c754968a533f60e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:56.882313 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808dc971-73c0-449b-b365-078882a356b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a5d9a2c7d8c41298c754968a533f60e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:56.884303 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808dc971-73c0-449b-b365-078882a356b5 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:56.888466 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-b8c335f1-e5e1-4131-ae7e-765ae133acb6 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:38:56.889659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b8c335f1-e5e1-4131-ae7e-765ae133acb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:56.897564 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1237/2492] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:38:56.902495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:56.905737 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1359157-aab0-4dd3-a043-fb0a6bbb71f0 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:56.906022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1359157-aab0-4dd3-a043-fb0a6bbb71f0 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:56.906295 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1359157-aab0-4dd3-a043-fb0a6bbb71f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:56.928127 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-e1359157-aab0-4dd3-a043-fb0a6bbb71f0 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:38:56.929322 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e1359157-aab0-4dd3-a043-fb0a6bbb71f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:56.936488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-808dc971-73c0-449b-b365-078882a356b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a5d9a2c7d8c41298c754968a533f60e', 'request_id': 'req-808dc971-73c0-449b-b365-078882a356b5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:56.942512 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-808dc971-73c0-449b-b365-078882a356b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a5d9a2c7d8c41298c754968a533f60e', 'request_id': 'req-808dc971-73c0-449b-b365-078882a356b5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:56.948128 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:56.950895 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-808dc971-73c0-449b-b365-078882a356b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a5d9a2c7d8c41298c754968a533f60e', 'request_id': 'req-808dc971-73c0-449b-b365-078882a356b5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:56.966029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-808dc971-73c0-449b-b365-078882a356b5 admin admin] The token cache is being invalidate because project 5a5d9a2c7d8c41298c754968a533f60e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:38:56.967600 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-808dc971-73c0-449b-b365-078882a356b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:56.967600 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-808dc971-73c0-449b-b365-078882a356b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:56.968708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1256/2493] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:38:56 2022] DELETE /identity/v3/projects/5a5d9a2c7d8c41298c754968a533f60e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:38:56.973751 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d4b04-f5d1-491a-b35e-6e9db98e8a08 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:56.974032 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d4b04-f5d1-491a-b35e-6e9db98e8a08 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:56.974368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d4b04-f5d1-491a-b35e-6e9db98e8a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:56.994381 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ee5d4b04-f5d1-491a-b35e-6e9db98e8a08 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:38:56.995941 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ee5d4b04-f5d1-491a-b35e-6e9db98e8a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:56.996084 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1238/2494] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:38:57.000248 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1359157-aab0-4dd3-a043-fb0a6bbb71f0 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:57.004056 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1257/2495] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:38:57.009754 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1359157-aab0-4dd3-a043-fb0a6bbb71f0 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:57.011864 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392889b-7dbd-4a88-bf10-d3c59e5b060a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:57.012150 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392889b-7dbd-4a88-bf10-d3c59e5b060a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:57.012506 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392889b-7dbd-4a88-bf10-d3c59e5b060a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:57.014672 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15f215-e633-481a-9225-10a34ab3838a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:57.015324 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15f215-e633-481a-9225-10a34ab3838a admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:57.015549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15f215-e633-481a-9225-10a34ab3838a admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:57.015859 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15f215-e633-481a-9225-10a34ab3838a admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:57.016497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15f215-e633-481a-9225-10a34ab3838a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:38:57.016800 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15f215-e633-481a-9225-10a34ab3838a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:57.018375 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15f215-e633-481a-9225-10a34ab3838a admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:57.032781 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1239/2496] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:38:57.033716 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e392889b-7dbd-4a88-bf10-d3c59e5b060a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:38:57.035834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e392889b-7dbd-4a88-bf10-d3c59e5b060a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:57.045939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15f215-e633-481a-9225-10a34ab3838a admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:57.046127 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1258/2497] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:38:57.048434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15f215-e633-481a-9225-10a34ab3838a admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:57.049984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392889b-7dbd-4a88-bf10-d3c59e5b060a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:57.053515 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c117e2-64e4-4a76-9a67-d8da71f07efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:57.054192 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c117e2-64e4-4a76-9a67-d8da71f07efd admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:57.054539 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c117e2-64e4-4a76-9a67-d8da71f07efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:57.054875 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c117e2-64e4-4a76-9a67-d8da71f07efd admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:57.055584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c117e2-64e4-4a76-9a67-d8da71f07efd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:57.058053 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c117e2-64e4-4a76-9a67-d8da71f07efd admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:57.059732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392889b-7dbd-4a88-bf10-d3c59e5b060a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:57.065626 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d186e6-208f-476f-a1ae-947d0ed919eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:57.066645 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d186e6-208f-476f-a1ae-947d0ed919eb admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:57.066919 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d186e6-208f-476f-a1ae-947d0ed919eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:57.067241 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d186e6-208f-476f-a1ae-947d0ed919eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:57.069459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d186e6-208f-476f-a1ae-947d0ed919eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:38:57.069459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d186e6-208f-476f-a1ae-947d0ed919eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:57.069823 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d186e6-208f-476f-a1ae-947d0ed919eb admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:57.090699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1259/2498] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:38:57.094493 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1240/2499] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:38:57 2022] POST /identity/v3/projects => generated 403 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:38:57.095153 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d186e6-208f-476f-a1ae-947d0ed919eb admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:57.095551 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c117e2-64e4-4a76-9a67-d8da71f07efd admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:57.107929 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d186e6-208f-476f-a1ae-947d0ed919eb admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:57.164656 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c117e2-64e4-4a76-9a67-d8da71f07efd admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:57.169624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdee13b-b2a4-423f-a96a-2de4996438e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:57.170249 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdee13b-b2a4-423f-a96a-2de4996438e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:57.170534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdee13b-b2a4-423f-a96a-2de4996438e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:57.170666 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8fe7d-1d61-462e-8004-9c4b64b37589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:57.170798 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdee13b-b2a4-423f-a96a-2de4996438e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:57.171275 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8fe7d-1d61-462e-8004-9c4b64b37589 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:57.171417 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdee13b-b2a4-423f-a96a-2de4996438e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:57.171558 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8fe7d-1d61-462e-8004-9c4b64b37589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:57.171862 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8fe7d-1d61-462e-8004-9c4b64b37589 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:57.172490 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8fe7d-1d61-462e-8004-9c4b64b37589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:57.173376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdee13b-b2a4-423f-a96a-2de4996438e5 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:57.174378 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8fe7d-1d61-462e-8004-9c4b64b37589 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:57.202123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1241/2500] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:38:57 2022] POST /identity/v3/users => generated 302 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:38:57.206932 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdee13b-b2a4-423f-a96a-2de4996438e5 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:57.211277 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1260/2501] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:38:57 2022] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:38:57.216652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8fe7d-1d61-462e-8004-9c4b64b37589 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:57.223552 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdee13b-b2a4-423f-a96a-2de4996438e5 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:57.288868 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8fe7d-1d61-462e-8004-9c4b64b37589 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:57.293931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74030306-ad4c-40ba-8b53-2162d011a509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:57.294089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e396e9d-e401-4409-9bf4-db1415a1d1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:57.294601 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74030306-ad4c-40ba-8b53-2162d011a509 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:57.294717 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e396e9d-e401-4409-9bf4-db1415a1d1ce admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:57.294896 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74030306-ad4c-40ba-8b53-2162d011a509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:57.295009 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e396e9d-e401-4409-9bf4-db1415a1d1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:57.295172 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74030306-ad4c-40ba-8b53-2162d011a509 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:57.295279 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e396e9d-e401-4409-9bf4-db1415a1d1ce admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:57.295813 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74030306-ad4c-40ba-8b53-2162d011a509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:57.295935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e396e9d-e401-4409-9bf4-db1415a1d1ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:57.297427 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74030306-ad4c-40ba-8b53-2162d011a509 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:57.297747 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e396e9d-e401-4409-9bf4-db1415a1d1ce admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:57.307656 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:57.308808 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1242/2502] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:38:57.312911 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74030306-ad4c-40ba-8b53-2162d011a509 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:57.325337 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74030306-ad4c-40ba-8b53-2162d011a509 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:57.332795 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1261/2503] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:38:57 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:38:57.332997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07f6bb-a802-459a-85e8-3543f73430a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:57.332997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07f6bb-a802-459a-85e8-3543f73430a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:57.332997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07f6bb-a802-459a-85e8-3543f73430a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:57.332997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07f6bb-a802-459a-85e8-3543f73430a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:57.333358 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07f6bb-a802-459a-85e8-3543f73430a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:57.333975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e396e9d-e401-4409-9bf4-db1415a1d1ce admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:57.334098 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07f6bb-a802-459a-85e8-3543f73430a6 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:57.347886 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1243/2504] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:38:57.348899 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07f6bb-a802-459a-85e8-3543f73430a6 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:57.349035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e396e9d-e401-4409-9bf4-db1415a1d1ce admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:57.354337 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7eb22-4e2c-4020-985d-d2b93975fc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:57.354959 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7eb22-4e2c-4020-985d-d2b93975fc4d admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:57.355238 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7eb22-4e2c-4020-985d-d2b93975fc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:57.355386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:57.355518 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7eb22-4e2c-4020-985d-d2b93975fc4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:57.356196 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7eb22-4e2c-4020-985d-d2b93975fc4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:57.357805 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7eb22-4e2c-4020-985d-d2b93975fc4d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:57.362207 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07f6bb-a802-459a-85e8-3543f73430a6 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:57.368267 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c04c7-8135-4f3e-b081-aca8055cc7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:57.369204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c04c7-8135-4f3e-b081-aca8055cc7df admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:57.369661 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c04c7-8135-4f3e-b081-aca8055cc7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:57.369938 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c04c7-8135-4f3e-b081-aca8055cc7df admin admin] PATH_INFO: `/v3/projects/a076bf22b6794b78a981a7628faba47f/users/e5adfce7e2da493a89b98f0ed2231fb5/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:57.372963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1262/2505] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:38:57.377652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7eb22-4e2c-4020-985d-d2b93975fc4d admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:57.387703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c04c7-8135-4f3e-b081-aca8055cc7df admin admin] RBAC: Authorizing `identity:create_grant(project_id=a076bf22b6794b78a981a7628faba47f, user_id=e5adfce7e2da493a89b98f0ed2231fb5, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:57.390676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c04c7-8135-4f3e-b081-aca8055cc7df admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:57.390919 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7eb22-4e2c-4020-985d-d2b93975fc4d admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:57.396226 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586d2d7-f840-4bb9-9678-5dcab3368bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:57.396837 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586d2d7-f840-4bb9-9678-5dcab3368bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:57.397209 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586d2d7-f840-4bb9-9678-5dcab3368bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:57.397555 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586d2d7-f840-4bb9-9678-5dcab3368bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:57.398223 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586d2d7-f840-4bb9-9678-5dcab3368bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:57.400799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586d2d7-f840-4bb9-9678-5dcab3368bd4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:57.406299 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1244/2506] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:38:57 2022] PUT /identity/v3/projects/a076bf22b6794b78a981a7628faba47f/users/e5adfce7e2da493a89b98f0ed2231fb5/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:38:57.411614 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e007d-1c70-4531-b4be-932174e0f247 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:57.411930 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e007d-1c70-4531-b4be-932174e0f247 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:57.412202 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e007d-1c70-4531-b4be-932174e0f247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:57.414800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1263/2507] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:38:57.416471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586d2d7-f840-4bb9-9678-5dcab3368bd4 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:57.427969 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586d2d7-f840-4bb9-9678-5dcab3368bd4 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:57.434623 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-027e007d-1c70-4531-b4be-932174e0f247 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:38:57.435987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-027e007d-1c70-4531-b4be-932174e0f247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:57.492992 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08030e-9f83-4ed1-a894-221c162d433b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:57.494275 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08030e-9f83-4ed1-a894-221c162d433b admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:57.495071 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08030e-9f83-4ed1-a894-221c162d433b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:57.495655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08030e-9f83-4ed1-a894-221c162d433b admin admin] PATH_INFO: `/v3/projects/602333ae8a1747d88cfb64735c9a1ed9/users/eeed7f032f064994a5747f3076b2227b/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:57.507766 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1245/2508] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:38:57.515773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e007d-1c70-4531-b4be-932174e0f247 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:57.517151 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-027e007d-1c70-4531-b4be-932174e0f247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:57.517377 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08030e-9f83-4ed1-a894-221c162d433b admin admin] RBAC: Authorizing `identity:create_grant(project_id=602333ae8a1747d88cfb64735c9a1ed9, user_id=eeed7f032f064994a5747f3076b2227b, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:57.520832 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08030e-9f83-4ed1-a894-221c162d433b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:57.544880 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1264/2509] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:38:57 2022] PUT /identity/v3/projects/602333ae8a1747d88cfb64735c9a1ed9/users/eeed7f032f064994a5747f3076b2227b/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:38:57.557160 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb6bd1-5a00-49f5-b78b-9a64e881f8b8 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:57.557634 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb6bd1-5a00-49f5-b78b-9a64e881f8b8 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:57.558338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb6bd1-5a00-49f5-b78b-9a64e881f8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:57.586672 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e007d-1c70-4531-b4be-932174e0f247 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:57.597225 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-19cb6bd1-5a00-49f5-b78b-9a64e881f8b8 None None] MFA Rules not processed for user `eeed7f032f064994a5747f3076b2227b`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:38:57.598899 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-19cb6bd1-5a00-49f5-b78b-9a64e881f8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:57.644457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210aaa56-88d5-4abf-8d4b-92d5b229e9b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:57.645136 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210aaa56-88d5-4abf-8d4b-92d5b229e9b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:57.645428 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210aaa56-88d5-4abf-8d4b-92d5b229e9b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:57.645690 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210aaa56-88d5-4abf-8d4b-92d5b229e9b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:57.699318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1265/2510] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:38:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:38:57.703561 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb6bd1-5a00-49f5-b78b-9a64e881f8b8 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:57.708659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:57.725216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210aaa56-88d5-4abf-8d4b-92d5b229e9b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:57.726655 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210aaa56-88d5-4abf-8d4b-92d5b229e9b0 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:57.737143 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1246/2511] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:38:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:38:57.751567 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:57.772951 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb6bd1-5a00-49f5-b78b-9a64e881f8b8 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:57.778635 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5ed2f-0d7b-4ea8-96a5-56fb2f4ee66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:57.779260 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5ed2f-0d7b-4ea8-96a5-56fb2f4ee66c admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:57.779537 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5ed2f-0d7b-4ea8-96a5-56fb2f4ee66c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:57.779863 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5ed2f-0d7b-4ea8-96a5-56fb2f4ee66c admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:57.780493 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5ed2f-0d7b-4ea8-96a5-56fb2f4ee66c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:57.782421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5ed2f-0d7b-4ea8-96a5-56fb2f4ee66c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:57.818983 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1266/2512] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:38:57 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:38:57.823415 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210aaa56-88d5-4abf-8d4b-92d5b229e9b0 service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:57.834053 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210aaa56-88d5-4abf-8d4b-92d5b229e9b0 service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:57.895424 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eaa533-76c3-4d62-9b10-363a4ac869e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:57.896056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eaa533-76c3-4d62-9b10-363a4ac869e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:57.896334 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eaa533-76c3-4d62-9b10-363a4ac869e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:57.896604 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eaa533-76c3-4d62-9b10-363a4ac869e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:57.897248 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eaa533-76c3-4d62-9b10-363a4ac869e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:57.899202 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eaa533-76c3-4d62-9b10-363a4ac869e3 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:57.924796 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1247/2513] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:38:57 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:38:57.928931 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5ed2f-0d7b-4ea8-96a5-56fb2f4ee66c admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:57.939869 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5ed2f-0d7b-4ea8-96a5-56fb2f4ee66c admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:57.945222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdeedb1-031f-431a-b39c-c00668a0ea89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:57.945842 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeedb1-031f-431a-b39c-c00668a0ea89 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:57.946113 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeedb1-031f-431a-b39c-c00668a0ea89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:57.946381 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeedb1-031f-431a-b39c-c00668a0ea89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:57.947555 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdeedb1-031f-431a-b39c-c00668a0ea89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:57.949189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdeedb1-031f-431a-b39c-c00668a0ea89 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:57.964692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1267/2514] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:38:57.966046 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eaa533-76c3-4d62-9b10-363a4ac869e3 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:57.976353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eaa533-76c3-4d62-9b10-363a4ac869e3 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:57.984249 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d8878-25bb-426f-8926-d01457514624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:57.984249 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d8878-25bb-426f-8926-d01457514624 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:57.984249 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d8878-25bb-426f-8926-d01457514624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:57.984249 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d8878-25bb-426f-8926-d01457514624 admin admin] PATH_INFO: `/v3/projects/ae4ed53401c74a5ba02b15c5da0028a5/users/432481e1085e41f886a90ec87a55dda3/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:57.999959 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d8878-25bb-426f-8926-d01457514624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4ed53401c74a5ba02b15c5da0028a5, user_id=432481e1085e41f886a90ec87a55dda3, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:58.002644 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d8878-25bb-426f-8926-d01457514624 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:58.022998 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1248/2515] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:38:57 2022] PUT /identity/v3/projects/ae4ed53401c74a5ba02b15c5da0028a5/users/432481e1085e41f886a90ec87a55dda3/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:38:58.027553 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdeedb1-031f-431a-b39c-c00668a0ea89 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:58.037742 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdeedb1-031f-431a-b39c-c00668a0ea89 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:58.110236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f51222-41f2-4d2d-8b0b-8b90e4d49e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:58.110859 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f51222-41f2-4d2d-8b0b-8b90e4d49e60 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:58.111139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f51222-41f2-4d2d-8b0b-8b90e4d49e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:58.111414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f51222-41f2-4d2d-8b0b-8b90e4d49e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:58.112098 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f51222-41f2-4d2d-8b0b-8b90e4d49e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:58.113791 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f51222-41f2-4d2d-8b0b-8b90e4d49e60 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:58.126855 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1268/2516] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:38:58.130761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d8878-25bb-426f-8926-d01457514624 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:58.143435 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d8878-25bb-426f-8926-d01457514624 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:58.148607 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee16b64-7dc8-42ec-892f-27c28a399ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:58.149668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee16b64-7dc8-42ec-892f-27c28a399ced admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:58.150664 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee16b64-7dc8-42ec-892f-27c28a399ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:58.151005 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee16b64-7dc8-42ec-892f-27c28a399ced admin admin] PATH_INFO: `/v3/projects/ae4ed53401c74a5ba02b15c5da0028a5/users/432481e1085e41f886a90ec87a55dda3/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:58.153109 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee16b64-7dc8-42ec-892f-27c28a399ced admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4ed53401c74a5ba02b15c5da0028a5, user_id=432481e1085e41f886a90ec87a55dda3, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:58.156288 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee16b64-7dc8-42ec-892f-27c28a399ced admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:58.169504 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1249/2517] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:38:58 2022] PUT /identity/v3/projects/ae4ed53401c74a5ba02b15c5da0028a5/users/432481e1085e41f886a90ec87a55dda3/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:38:58.181225 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6a58c-6456-4ef0-a8be-a7d43d6e17d2 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:58.181636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6a58c-6456-4ef0-a8be-a7d43d6e17d2 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:58.182084 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6a58c-6456-4ef0-a8be-a7d43d6e17d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:58.214308 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-44d6a58c-6456-4ef0-a8be-a7d43d6e17d2 None None] MFA Rules not processed for user `432481e1085e41f886a90ec87a55dda3`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:38:58.215779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-44d6a58c-6456-4ef0-a8be-a7d43d6e17d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:58.291515 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1269/2518] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:38:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:38:58.304233 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee16b64-7dc8-42ec-892f-27c28a399ced admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:58.306695 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-cee16b64-7dc8-42ec-892f-27c28a399ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:58.371565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee16b64-7dc8-42ec-892f-27c28a399ced admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:58.375362 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad954ea4-4399-4fa4-b762-53148c9389c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:58.376003 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad954ea4-4399-4fa4-b762-53148c9389c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:58.376277 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad954ea4-4399-4fa4-b762-53148c9389c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:58.376547 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad954ea4-4399-4fa4-b762-53148c9389c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:58.387631 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad954ea4-4399-4fa4-b762-53148c9389c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:58.389415 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad954ea4-4399-4fa4-b762-53148c9389c0 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:58.402138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1250/2519] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:38:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:38:58.437958 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750773d9-aa15-4a03-8740-01f9c1614d5e None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:58.438257 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750773d9-aa15-4a03-8740-01f9c1614d5e None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:58.438551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750773d9-aa15-4a03-8740-01f9c1614d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:58.492467 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-750773d9-aa15-4a03-8740-01f9c1614d5e None None] MFA Rules not processed for user `e5adfce7e2da493a89b98f0ed2231fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:38:58.493175 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-750773d9-aa15-4a03-8740-01f9c1614d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:58.560216 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:58.632430 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1270/2520] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:38:58 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:38:58.636859 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad954ea4-4399-4fa4-b762-53148c9389c0 service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:58.692377 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:58.736103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad954ea4-4399-4fa4-b762-53148c9389c0 service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:58.741789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573b2e3-3157-47bb-aab7-0a620e339502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:58.742632 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573b2e3-3157-47bb-aab7-0a620e339502 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:58.742964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573b2e3-3157-47bb-aab7-0a620e339502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:58.743397 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573b2e3-3157-47bb-aab7-0a620e339502 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:58.744283 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4573b2e3-3157-47bb-aab7-0a620e339502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:58.746277 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4573b2e3-3157-47bb-aab7-0a620e339502 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:58.778953 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1251/2521] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:38:58 2022] POST /identity/v3/projects => generated 405 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:38:58.783147 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750773d9-aa15-4a03-8740-01f9c1614d5e None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:58.795485 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750773d9-aa15-4a03-8740-01f9c1614d5e None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:58.867598 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccb146-3b0e-4b68-85ae-05cb84f527d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:58.869139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccb146-3b0e-4b68-85ae-05cb84f527d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:58.869402 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccb146-3b0e-4b68-85ae-05cb84f527d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:58.869735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccb146-3b0e-4b68-85ae-05cb84f527d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:58.870385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ccb146-3b0e-4b68-85ae-05cb84f527d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:58.872713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ccb146-3b0e-4b68-85ae-05cb84f527d9 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:58.889142 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573b2e3-3157-47bb-aab7-0a620e339502 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:58.898683 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1271/2522] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:38:58 2022] POST /identity/v3/users => generated 309 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:38:58.903256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccb146-3b0e-4b68-85ae-05cb84f527d9 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:58.914699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccb146-3b0e-4b68-85ae-05cb84f527d9 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:58.919519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455f834-2440-40d8-8adb-15b4d798c365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:58.920154 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455f834-2440-40d8-8adb-15b4d798c365 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:58.920425 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455f834-2440-40d8-8adb-15b4d798c365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:58.920691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455f834-2440-40d8-8adb-15b4d798c365 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:58.921762 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455f834-2440-40d8-8adb-15b4d798c365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:58.922901 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455f834-2440-40d8-8adb-15b4d798c365 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:58.933221 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1272/2523] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:38:58.934252 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379e6c6-964c-43f7-8b4b-3956dcabd65b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:58.934531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379e6c6-964c-43f7-8b4b-3956dcabd65b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:58.934803 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379e6c6-964c-43f7-8b4b-3956dcabd65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:58.955399 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-1379e6c6-964c-43f7-8b4b-3956dcabd65b None None] MFA Rules not processed for user `c5dc12a8bc2b406b8a148bf609d5d2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:38:58.956777 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1379e6c6-964c-43f7-8b4b-3956dcabd65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:58.958104 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573b2e3-3157-47bb-aab7-0a620e339502 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:58.963412 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e8919-fd62-4437-9371-7087af71f27c tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432481e1085e41f886a90ec87a55dda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4ed53401c74a5ba02b15c5da0028a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:58.964033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e8919-fd62-4437-9371-7087af71f27c tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:58.964310 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e8919-fd62-4437-9371-7087af71f27c tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:58.964581 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e8919-fd62-4437-9371-7087af71f27c tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:58.965217 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e8919-fd62-4437-9371-7087af71f27c tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:38:58.965518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e8919-fd62-4437-9371-7087af71f27c tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:58.967101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e8919-fd62-4437-9371-7087af71f27c tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:58.982455 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1252/2524] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:38:58.982455 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e8919-fd62-4437-9371-7087af71f27c tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:58.991743 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e8919-fd62-4437-9371-7087af71f27c tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:58.996625 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a9c97-6950-40d8-ae2c-9901babf8170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:58.997275 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a9c97-6950-40d8-ae2c-9901babf8170 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:58.997554 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a9c97-6950-40d8-ae2c-9901babf8170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:58.997847 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a9c97-6950-40d8-ae2c-9901babf8170 admin admin] PATH_INFO: `/v3/projects/c52b66b19e274db48803c15ef7b8a7f4/users/e71391bb2e1c4e46a66ddbbb23258f51/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:59.013781 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a9c97-6950-40d8-ae2c-9901babf8170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c52b66b19e274db48803c15ef7b8a7f4, user_id=e71391bb2e1c4e46a66ddbbb23258f51, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:59.016461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a9c97-6950-40d8-ae2c-9901babf8170 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:59.024085 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1273/2525] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Oct 4 14:38:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:38:59.025875 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379e6c6-964c-43f7-8b4b-3956dcabd65b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:59.032609 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1253/2526] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:38:58 2022] PUT /identity/v3/projects/c52b66b19e274db48803c15ef7b8a7f4/users/e71391bb2e1c4e46a66ddbbb23258f51/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:38:59.036938 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a9c97-6950-40d8-ae2c-9901babf8170 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:59.041316 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379e6c6-964c-43f7-8b4b-3956dcabd65b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:59.091530 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:59.108585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a9c97-6950-40d8-ae2c-9901babf8170 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:59.108809 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578620d-d3ef-41d3-a9de-215fab7d7926 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432481e1085e41f886a90ec87a55dda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4ed53401c74a5ba02b15c5da0028a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:59.109278 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578620d-d3ef-41d3-a9de-215fab7d7926 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:59.109560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578620d-d3ef-41d3-a9de-215fab7d7926 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:59.109836 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578620d-d3ef-41d3-a9de-215fab7d7926 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:59.110470 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578620d-d3ef-41d3-a9de-215fab7d7926 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:59.112464 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578620d-d3ef-41d3-a9de-215fab7d7926 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:59.113191 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99d9aa-99fc-4b47-b9fb-4550ed8e1ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:59.113798 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99d9aa-99fc-4b47-b9fb-4550ed8e1ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:59.114079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99d9aa-99fc-4b47-b9fb-4550ed8e1ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:59.114351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99d9aa-99fc-4b47-b9fb-4550ed8e1ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:59.114992 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99d9aa-99fc-4b47-b9fb-4550ed8e1ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:59.116599 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99d9aa-99fc-4b47-b9fb-4550ed8e1ce0 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:59.127430 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1254/2527] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:38:59.127430 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99d9aa-99fc-4b47-b9fb-4550ed8e1ce0 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:59.127430 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-1b99d9aa-99fc-4b47-b9fb-4550ed8e1ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:38:59.147685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1274/2528] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:38:59 2022] POST /identity/v3/projects => generated 352 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:38:59.147685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578620d-d3ef-41d3-a9de-215fab7d7926 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:59.172917 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:59.218011 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578620d-d3ef-41d3-a9de-215fab7d7926 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:59.221854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99d9aa-99fc-4b47-b9fb-4550ed8e1ce0 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:59.222744 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2e5f3-a239-4b12-b83a-06caa65e815f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:59.223419 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2e5f3-a239-4b12-b83a-06caa65e815f admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:59.223764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2e5f3-a239-4b12-b83a-06caa65e815f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:59.224038 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2e5f3-a239-4b12-b83a-06caa65e815f admin admin] PATH_INFO: `/v3/projects/c52b66b19e274db48803c15ef7b8a7f4/users/e71391bb2e1c4e46a66ddbbb23258f51/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:59.226129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2e5f3-a239-4b12-b83a-06caa65e815f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c52b66b19e274db48803c15ef7b8a7f4, user_id=e71391bb2e1c4e46a66ddbbb23258f51, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:59.228872 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2e5f3-a239-4b12-b83a-06caa65e815f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:59.239977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1275/2529] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:38:59 2022] PUT /identity/v3/projects/c52b66b19e274db48803c15ef7b8a7f4/users/e71391bb2e1c4e46a66ddbbb23258f51/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:38:59.240945 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2e5f3-a239-4b12-b83a-06caa65e815f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:59.287636 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c71d28-d9ac-49dc-8b1f-dc9b2430720f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4860d5958e724e568576a9067290a27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:59.288354 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c71d28-d9ac-49dc-8b1f-dc9b2430720f service swift] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:59.288639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c71d28-d9ac-49dc-8b1f-dc9b2430720f service swift] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:59.288910 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c71d28-d9ac-49dc-8b1f-dc9b2430720f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:59.324047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2e5f3-a239-4b12-b83a-06caa65e815f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:59.329517 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952b612-4dca-47bf-8adb-fb2f21a83133 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432481e1085e41f886a90ec87a55dda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4ed53401c74a5ba02b15c5da0028a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:59.330135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952b612-4dca-47bf-8adb-fb2f21a83133 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:59.330431 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952b612-4dca-47bf-8adb-fb2f21a83133 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:59.330704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952b612-4dca-47bf-8adb-fb2f21a83133 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:59.331390 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952b612-4dca-47bf-8adb-fb2f21a83133 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:38:59.331771 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952b612-4dca-47bf-8adb-fb2f21a83133 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:59.333368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952b612-4dca-47bf-8adb-fb2f21a83133 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:59.348064 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1276/2530] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:38:59.364392 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c71d28-d9ac-49dc-8b1f-dc9b2430720f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:59.366319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c71d28-d9ac-49dc-8b1f-dc9b2430720f service swift] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:59.376059 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1255/2531] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Oct 4 14:38:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 14:38:59.395423 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952b612-4dca-47bf-8adb-fb2f21a83133 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:59.416976 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952b612-4dca-47bf-8adb-fb2f21a83133 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:38:59.422945 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa105a9c-0607-4928-b9e1-67b8cf2c30a5 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432481e1085e41f886a90ec87a55dda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4ed53401c74a5ba02b15c5da0028a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:38:59.423859 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa105a9c-0607-4928-b9e1-67b8cf2c30a5 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:38:59.424506 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa105a9c-0607-4928-b9e1-67b8cf2c30a5 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:38:59.424898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa105a9c-0607-4928-b9e1-67b8cf2c30a5 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] PATH_INFO: `/v3/projects/1745473bc9394cf891c76d49d1f1ae73` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:38:59.426219 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa105a9c-0607-4928-b9e1-67b8cf2c30a5 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1745473bc9394cf891c76d49d1f1ae73)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:38:59.428396 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa105a9c-0607-4928-b9e1-67b8cf2c30a5 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:38:59.507377 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-fa105a9c-0607-4928-b9e1-67b8cf2c30a5 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1745473bc9394cf891c76d49d1f1ae73', 'request_id': 'req-fa105a9c-0607-4928-b9e1-67b8cf2c30a5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:59.510354 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:59.516697 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-fa105a9c-0607-4928-b9e1-67b8cf2c30a5 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1745473bc9394cf891c76d49d1f1ae73', 'request_id': 'req-fa105a9c-0607-4928-b9e1-67b8cf2c30a5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:59.532331 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-fa105a9c-0607-4928-b9e1-67b8cf2c30a5 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1745473bc9394cf891c76d49d1f1ae73', 'request_id': 'req-fa105a9c-0607-4928-b9e1-67b8cf2c30a5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:59.551980 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-fa105a9c-0607-4928-b9e1-67b8cf2c30a5 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] The token cache is being invalidate because project 1745473bc9394cf891c76d49d1f1ae73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:38:59.552349 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-fa105a9c-0607-4928-b9e1-67b8cf2c30a5 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:59.553335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-fa105a9c-0607-4928-b9e1-67b8cf2c30a5 tempest-VolumeQuotaClassesTest-1826383081 tempest-VolumeQuotaClassesTest-1826383081-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:38:59.556457 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1277/2532] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:38:59 2022] DELETE /identity/v3/projects/1745473bc9394cf891c76d49d1f1ae73 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:38:59.889522 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c71d28-d9ac-49dc-8b1f-dc9b2430720f service swift] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:38:59.920748 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c71d28-d9ac-49dc-8b1f-dc9b2430720f service swift] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:00.033855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5001545-69a9-462e-8eda-0d6bb32b40d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:00.034515 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5001545-69a9-462e-8eda-0d6bb32b40d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:00.034794 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5001545-69a9-462e-8eda-0d6bb32b40d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:00.035065 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5001545-69a9-462e-8eda-0d6bb32b40d6 admin admin] PATH_INFO: `/v3/users/eeed7f032f064994a5747f3076b2227b` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:00.036561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5001545-69a9-462e-8eda-0d6bb32b40d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeed7f032f064994a5747f3076b2227b)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:00.038824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5001545-69a9-462e-8eda-0d6bb32b40d6 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:00.076433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:00.129145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-f5001545-69a9-462e-8eda-0d6bb32b40d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeed7f032f064994a5747f3076b2227b'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:00.131506 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-f5001545-69a9-462e-8eda-0d6bb32b40d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeed7f032f064994a5747f3076b2227b'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:00.149463 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-f5001545-69a9-462e-8eda-0d6bb32b40d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeed7f032f064994a5747f3076b2227b'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:00.163551 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-f5001545-69a9-462e-8eda-0d6bb32b40d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeed7f032f064994a5747f3076b2227b'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:00.174396 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-f5001545-69a9-462e-8eda-0d6bb32b40d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeed7f032f064994a5747f3076b2227b'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:00.185122 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1256/2533] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:38:59 2022] DELETE /identity/v3/users/eeed7f032f064994a5747f3076b2227b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:00.190099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78675bd-391e-497e-88d1-ea80b29913a1 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:00.190626 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78675bd-391e-497e-88d1-ea80b29913a1 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:00.191045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78675bd-391e-497e-88d1-ea80b29913a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:00.223566 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-d78675bd-391e-497e-88d1-ea80b29913a1 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:00.225418 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d78675bd-391e-497e-88d1-ea80b29913a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:00.330766 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1278/2534] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:00.341289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5001545-69a9-462e-8eda-0d6bb32b40d6 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:00.345208 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f5001545-69a9-462e-8eda-0d6bb32b40d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:00.345391 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fda04-985f-49db-a329-8955830dc58c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:00.345391 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fda04-985f-49db-a329-8955830dc58c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:00.345391 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fda04-985f-49db-a329-8955830dc58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:00.389302 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c34fda04-985f-49db-a329-8955830dc58c None None] MFA Rules not processed for user `e71391bb2e1c4e46a66ddbbb23258f51`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:00.390604 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c34fda04-985f-49db-a329-8955830dc58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:00.504107 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5001545-69a9-462e-8eda-0d6bb32b40d6 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:00.510581 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51e249-7158-4207-aa99-ce72f03c4d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:00.511761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51e249-7158-4207-aa99-ce72f03c4d1a service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:00.512049 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51e249-7158-4207-aa99-ce72f03c4d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:00.512324 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51e249-7158-4207-aa99-ce72f03c4d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:00.513815 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1279/2535] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:00 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:39:00.539908 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51e249-7158-4207-aa99-ce72f03c4d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:00.541590 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51e249-7158-4207-aa99-ce72f03c4d1a service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:00.559817 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1257/2536] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:39:01.094421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fda04-985f-49db-a329-8955830dc58c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:01.095901 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c34fda04-985f-49db-a329-8955830dc58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:01.110484 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fda04-985f-49db-a329-8955830dc58c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:01.115581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a584b-c8e1-4443-89c2-0af83e24eb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:01.116638 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a584b-c8e1-4443-89c2-0af83e24eb18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:01.117147 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a584b-c8e1-4443-89c2-0af83e24eb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:01.117632 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a584b-c8e1-4443-89c2-0af83e24eb18 admin admin] PATH_INFO: `/v3/projects/602333ae8a1747d88cfb64735c9a1ed9` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:01.119605 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a584b-c8e1-4443-89c2-0af83e24eb18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=602333ae8a1747d88cfb64735c9a1ed9)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:01.121708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a584b-c8e1-4443-89c2-0af83e24eb18 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:01.232860 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d53a584b-c8e1-4443-89c2-0af83e24eb18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '602333ae8a1747d88cfb64735c9a1ed9', 'request_id': 'req-d53a584b-c8e1-4443-89c2-0af83e24eb18'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:01.245502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d53a584b-c8e1-4443-89c2-0af83e24eb18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '602333ae8a1747d88cfb64735c9a1ed9', 'request_id': 'req-d53a584b-c8e1-4443-89c2-0af83e24eb18'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:01.248889 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:01.256219 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d53a584b-c8e1-4443-89c2-0af83e24eb18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '602333ae8a1747d88cfb64735c9a1ed9', 'request_id': 'req-d53a584b-c8e1-4443-89c2-0af83e24eb18'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:01.275226 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d53a584b-c8e1-4443-89c2-0af83e24eb18 admin admin] The token cache is being invalidate because project 602333ae8a1747d88cfb64735c9a1ed9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:39:01.275581 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d53a584b-c8e1-4443-89c2-0af83e24eb18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:01.276336 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d53a584b-c8e1-4443-89c2-0af83e24eb18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:01.281171 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1280/2537] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:39:01 2022] DELETE /identity/v3/projects/602333ae8a1747d88cfb64735c9a1ed9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:01.283327 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51e249-7158-4207-aa99-ce72f03c4d1a service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:01.297925 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51e249-7158-4207-aa99-ce72f03c4d1a service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:01.416830 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec372fa-ff72-4e13-8ae2-e28bc85dcc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:01.417951 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec372fa-ff72-4e13-8ae2-e28bc85dcc80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:01.418420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec372fa-ff72-4e13-8ae2-e28bc85dcc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:01.419692 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec372fa-ff72-4e13-8ae2-e28bc85dcc80 admin admin] PATH_INFO: `/v3/users/432481e1085e41f886a90ec87a55dda3` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:01.421558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec372fa-ff72-4e13-8ae2-e28bc85dcc80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=432481e1085e41f886a90ec87a55dda3)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:01.427370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec372fa-ff72-4e13-8ae2-e28bc85dcc80 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:01.506026 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:01.513881 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-dec372fa-ff72-4e13-8ae2-e28bc85dcc80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '432481e1085e41f886a90ec87a55dda3'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:01.514949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-dec372fa-ff72-4e13-8ae2-e28bc85dcc80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '432481e1085e41f886a90ec87a55dda3'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:01.546994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-dec372fa-ff72-4e13-8ae2-e28bc85dcc80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '432481e1085e41f886a90ec87a55dda3'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:01.563306 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-dec372fa-ff72-4e13-8ae2-e28bc85dcc80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '432481e1085e41f886a90ec87a55dda3'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:01.578231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-dec372fa-ff72-4e13-8ae2-e28bc85dcc80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '432481e1085e41f886a90ec87a55dda3'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:01.586697 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1258/2538] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:39:01 2022] DELETE /identity/v3/users/432481e1085e41f886a90ec87a55dda3 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:39:02.049168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a584b-c8e1-4443-89c2-0af83e24eb18 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:02.051484 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d53a584b-c8e1-4443-89c2-0af83e24eb18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:02.073655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a584b-c8e1-4443-89c2-0af83e24eb18 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:02.185398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c041f26-3f58-4530-bc5e-ab6f8f44c75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:02.186060 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c041f26-3f58-4530-bc5e-ab6f8f44c75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:02.186556 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c041f26-3f58-4530-bc5e-ab6f8f44c75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:02.186746 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c041f26-3f58-4530-bc5e-ab6f8f44c75e admin admin] PATH_INFO: `/v3/projects/ae4ed53401c74a5ba02b15c5da0028a5` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:02.188659 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c041f26-3f58-4530-bc5e-ab6f8f44c75e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae4ed53401c74a5ba02b15c5da0028a5)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:02.190593 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c041f26-3f58-4530-bc5e-ab6f8f44c75e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:02.261107 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8c041f26-3f58-4530-bc5e-ab6f8f44c75e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae4ed53401c74a5ba02b15c5da0028a5', 'request_id': 'req-8c041f26-3f58-4530-bc5e-ab6f8f44c75e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:02.273855 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8c041f26-3f58-4530-bc5e-ab6f8f44c75e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae4ed53401c74a5ba02b15c5da0028a5', 'request_id': 'req-8c041f26-3f58-4530-bc5e-ab6f8f44c75e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:02.283670 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8c041f26-3f58-4530-bc5e-ab6f8f44c75e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae4ed53401c74a5ba02b15c5da0028a5', 'request_id': 'req-8c041f26-3f58-4530-bc5e-ab6f8f44c75e'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:02.299470 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8c041f26-3f58-4530-bc5e-ab6f8f44c75e admin admin] The token cache is being invalidate because project ae4ed53401c74a5ba02b15c5da0028a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:39:02.299829 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8c041f26-3f58-4530-bc5e-ab6f8f44c75e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:02.300416 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-8c041f26-3f58-4530-bc5e-ab6f8f44c75e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:02.305493 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1281/2539] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:39:02 2022] DELETE /identity/v3/projects/ae4ed53401c74a5ba02b15c5da0028a5 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:02.307183 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95704fa-4bed-4967-82e1-c2d47ad84aa7 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:02.307472 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95704fa-4bed-4967-82e1-c2d47ad84aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:02.307772 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95704fa-4bed-4967-82e1-c2d47ad84aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:02.340404 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-f95704fa-4bed-4967-82e1-c2d47ad84aa7 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:02.352896 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f95704fa-4bed-4967-82e1-c2d47ad84aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:02.435072 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c041f26-3f58-4530-bc5e-ab6f8f44c75e admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:02.437403 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8c041f26-3f58-4530-bc5e-ab6f8f44c75e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:02.443809 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1259/2540] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:02.451521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e17457-a085-4cf8-ad6d-3105ad5710be None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:02.452792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e17457-a085-4cf8-ad6d-3105ad5710be None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:02.453273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e17457-a085-4cf8-ad6d-3105ad5710be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:02.460057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c041f26-3f58-4530-bc5e-ab6f8f44c75e admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:02.468006 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709dc6d-83ab-472c-87c5-a3830dd09a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:02.468784 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709dc6d-83ab-472c-87c5-a3830dd09a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:02.469163 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709dc6d-83ab-472c-87c5-a3830dd09a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:02.469559 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709dc6d-83ab-472c-87c5-a3830dd09a33 admin admin] PATH_INFO: `/v3/users/e5adfce7e2da493a89b98f0ed2231fb5` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:02.471012 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709dc6d-83ab-472c-87c5-a3830dd09a33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5adfce7e2da493a89b98f0ed2231fb5)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:02.473707 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709dc6d-83ab-472c-87c5-a3830dd09a33 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:02.480741 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-74e17457-a085-4cf8-ad6d-3105ad5710be None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:02.482505 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-74e17457-a085-4cf8-ad6d-3105ad5710be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:02.494176 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1260/2541] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:02.498188 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e17457-a085-4cf8-ad6d-3105ad5710be None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:02.511582 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e17457-a085-4cf8-ad6d-3105ad5710be None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:02.523484 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda7d57-454b-4770-b08b-d2c141f402b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:02.525519 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda7d57-454b-4770-b08b-d2c141f402b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:02.525519 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda7d57-454b-4770-b08b-d2c141f402b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:02.525519 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda7d57-454b-4770-b08b-d2c141f402b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:02.530032 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda7d57-454b-4770-b08b-d2c141f402b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:39:02.530032 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda7d57-454b-4770-b08b-d2c141f402b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:02.530032 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda7d57-454b-4770-b08b-d2c141f402b8 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:02.542427 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1261/2542] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:39:02.547945 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda7d57-454b-4770-b08b-d2c141f402b8 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:02.563937 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda7d57-454b-4770-b08b-d2c141f402b8 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:02.570481 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed4821-7cb4-4812-a312-232b4e077ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:02.571101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed4821-7cb4-4812-a312-232b4e077ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:02.572155 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed4821-7cb4-4812-a312-232b4e077ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:02.572654 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed4821-7cb4-4812-a312-232b4e077ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:02.572955 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed4821-7cb4-4812-a312-232b4e077ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:02.575138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed4821-7cb4-4812-a312-232b4e077ca4 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:02.575909 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5709dc6d-83ab-472c-87c5-a3830dd09a33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5adfce7e2da493a89b98f0ed2231fb5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:02.579342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5709dc6d-83ab-472c-87c5-a3830dd09a33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5adfce7e2da493a89b98f0ed2231fb5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:02.600947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5709dc6d-83ab-472c-87c5-a3830dd09a33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5adfce7e2da493a89b98f0ed2231fb5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:02.629340 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5709dc6d-83ab-472c-87c5-a3830dd09a33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5adfce7e2da493a89b98f0ed2231fb5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:02.633447 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=79,keystone:INSERT=3,keystone:DELETE=18 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:02.637718 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1262/2543] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:39:02 2022] POST /identity/v3/projects => generated 401 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:39:02.642278 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed4821-7cb4-4812-a312-232b4e077ca4 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:02.647188 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5709dc6d-83ab-472c-87c5-a3830dd09a33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5adfce7e2da493a89b98f0ed2231fb5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:02.669313 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1282/2544] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:39:02 2022] DELETE /identity/v3/users/e5adfce7e2da493a89b98f0ed2231fb5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:02.773585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed4821-7cb4-4812-a312-232b4e077ca4 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:02.800941 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:02.867260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c3201-8146-4772-a653-4d77c1850911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:02.868064 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c3201-8146-4772-a653-4d77c1850911 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:02.869008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c3201-8146-4772-a653-4d77c1850911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:02.869768 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c3201-8146-4772-a653-4d77c1850911 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:02.870045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c3201-8146-4772-a653-4d77c1850911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:02.872610 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c3201-8146-4772-a653-4d77c1850911 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:02.904270 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1263/2545] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:39:02 2022] POST /identity/v3/users => generated 301 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:39:02.907958 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709dc6d-83ab-472c-87c5-a3830dd09a33 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:02.909662 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5709dc6d-83ab-472c-87c5-a3830dd09a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:02.929882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709dc6d-83ab-472c-87c5-a3830dd09a33 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:02.933038 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c3201-8146-4772-a653-4d77c1850911 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:02.934900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-421c3201-8146-4772-a653-4d77c1850911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:02.950724 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c3201-8146-4772-a653-4d77c1850911 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:02.953840 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf0eae-5d87-485c-87a7-513dda6cb9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:02.954479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf0eae-5d87-485c-87a7-513dda6cb9eb admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:02.954754 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf0eae-5d87-485c-87a7-513dda6cb9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:02.955023 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf0eae-5d87-485c-87a7-513dda6cb9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:02.955671 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf0eae-5d87-485c-87a7-513dda6cb9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:02.957289 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf0eae-5d87-485c-87a7-513dda6cb9eb admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:02.957500 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011f0d3-5410-473f-af8a-09e1eb5e25b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:02.958142 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011f0d3-5410-473f-af8a-09e1eb5e25b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:02.958421 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011f0d3-5410-473f-af8a-09e1eb5e25b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:02.958881 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011f0d3-5410-473f-af8a-09e1eb5e25b3 admin admin] PATH_INFO: `/v3/projects/a076bf22b6794b78a981a7628faba47f` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:02.960565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011f0d3-5410-473f-af8a-09e1eb5e25b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a076bf22b6794b78a981a7628faba47f)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:02.969749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1283/2546] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:39:02.974249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf0eae-5d87-485c-87a7-513dda6cb9eb admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:02.979663 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011f0d3-5410-473f-af8a-09e1eb5e25b3 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:02.990364 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf0eae-5d87-485c-87a7-513dda6cb9eb admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:02.999867 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db0dfb-12ba-4a38-b73b-7db4f97a0ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:03.000741 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db0dfb-12ba-4a38-b73b-7db4f97a0ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:03.001452 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db0dfb-12ba-4a38-b73b-7db4f97a0ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:03.001803 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db0dfb-12ba-4a38-b73b-7db4f97a0ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:03.002915 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db0dfb-12ba-4a38-b73b-7db4f97a0ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:03.004636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db0dfb-12ba-4a38-b73b-7db4f97a0ea4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:03.021433 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1284/2547] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:39:03.025167 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db0dfb-12ba-4a38-b73b-7db4f97a0ea4 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:03.042398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db0dfb-12ba-4a38-b73b-7db4f97a0ea4 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:03.049363 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db148dd3-ebe7-47ab-a221-291ad35a522d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:03.050000 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db148dd3-ebe7-47ab-a221-291ad35a522d admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:03.050260 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db148dd3-ebe7-47ab-a221-291ad35a522d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:03.050528 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db148dd3-ebe7-47ab-a221-291ad35a522d admin admin] PATH_INFO: `/v3/projects/4b99273f72e741b382ceae6723304fde/users/f8bf97b1668f4d3fbd99f42163cae7cc/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:03.063077 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-f011f0d3-5410-473f-af8a-09e1eb5e25b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a076bf22b6794b78a981a7628faba47f', 'request_id': 'req-f011f0d3-5410-473f-af8a-09e1eb5e25b3'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:03.073083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-f011f0d3-5410-473f-af8a-09e1eb5e25b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a076bf22b6794b78a981a7628faba47f', 'request_id': 'req-f011f0d3-5410-473f-af8a-09e1eb5e25b3'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:03.085348 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-f011f0d3-5410-473f-af8a-09e1eb5e25b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a076bf22b6794b78a981a7628faba47f', 'request_id': 'req-f011f0d3-5410-473f-af8a-09e1eb5e25b3'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:03.100517 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-f011f0d3-5410-473f-af8a-09e1eb5e25b3 admin admin] The token cache is being invalidate because project a076bf22b6794b78a981a7628faba47f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:39:03.100978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-f011f0d3-5410-473f-af8a-09e1eb5e25b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:03.101827 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-f011f0d3-5410-473f-af8a-09e1eb5e25b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:03.104826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1264/2548] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:39:02 2022] DELETE /identity/v3/projects/a076bf22b6794b78a981a7628faba47f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:39:03.110771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011f0d3-5410-473f-af8a-09e1eb5e25b3 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:03.112574 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f011f0d3-5410-473f-af8a-09e1eb5e25b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:03.234305 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011f0d3-5410-473f-af8a-09e1eb5e25b3 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:03.250109 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db148dd3-ebe7-47ab-a221-291ad35a522d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b99273f72e741b382ceae6723304fde, user_id=f8bf97b1668f4d3fbd99f42163cae7cc, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:03.254210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db148dd3-ebe7-47ab-a221-291ad35a522d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:03.260090 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf5fdf-0835-4057-8959-3b98cfac5399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:03.260777 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf5fdf-0835-4057-8959-3b98cfac5399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:03.261043 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf5fdf-0835-4057-8959-3b98cfac5399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:03.261316 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf5fdf-0835-4057-8959-3b98cfac5399 admin admin] PATH_INFO: `/v3/users/e71391bb2e1c4e46a66ddbbb23258f51` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:03.265127 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf5fdf-0835-4057-8959-3b98cfac5399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e71391bb2e1c4e46a66ddbbb23258f51)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:03.267257 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf5fdf-0835-4057-8959-3b98cfac5399 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:03.314268 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1285/2549] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:39:03 2022] PUT /identity/v3/projects/4b99273f72e741b382ceae6723304fde/users/f8bf97b1668f4d3fbd99f42163cae7cc/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:39:03.325962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c523a4a-1e8d-4b40-835c-9fe28720377f None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:03.326243 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c523a4a-1e8d-4b40-835c-9fe28720377f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:03.326722 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c523a4a-1e8d-4b40-835c-9fe28720377f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:03.330043 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:03.341352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-78cf5fdf-0835-4057-8959-3b98cfac5399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e71391bb2e1c4e46a66ddbbb23258f51'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:03.342338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-78cf5fdf-0835-4057-8959-3b98cfac5399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e71391bb2e1c4e46a66ddbbb23258f51'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:03.358493 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-6c523a4a-1e8d-4b40-835c-9fe28720377f None None] MFA Rules not processed for user `f8bf97b1668f4d3fbd99f42163cae7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:03.359270 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6c523a4a-1e8d-4b40-835c-9fe28720377f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:03.359729 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-78cf5fdf-0835-4057-8959-3b98cfac5399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e71391bb2e1c4e46a66ddbbb23258f51'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:03.370513 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-78cf5fdf-0835-4057-8959-3b98cfac5399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e71391bb2e1c4e46a66ddbbb23258f51'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:03.379263 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-78cf5fdf-0835-4057-8959-3b98cfac5399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e71391bb2e1c4e46a66ddbbb23258f51'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:03.402373 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1265/2550] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:39:03 2022] DELETE /identity/v3/users/e71391bb2e1c4e46a66ddbbb23258f51 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:03.474563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1286/2551] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:03 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:39:03.479392 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf5fdf-0835-4057-8959-3b98cfac5399 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:03.480964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-78cf5fdf-0835-4057-8959-3b98cfac5399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:03.571185 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf5fdf-0835-4057-8959-3b98cfac5399 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:03.577338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f54df-d155-4f14-ab50-c7723974ed02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:03.577986 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f54df-d155-4f14-ab50-c7723974ed02 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:03.578261 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f54df-d155-4f14-ab50-c7723974ed02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:03.578529 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f54df-d155-4f14-ab50-c7723974ed02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:03.579162 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f54df-d155-4f14-ab50-c7723974ed02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:03.581102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f54df-d155-4f14-ab50-c7723974ed02 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:03.621477 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1266/2552] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:39:03 2022] POST /identity/v3/projects => generated 399 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:39:03.622249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c523a4a-1e8d-4b40-835c-9fe28720377f None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:03.635397 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f54df-d155-4f14-ab50-c7723974ed02 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:03.637682 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-8d2f54df-d155-4f14-ab50-c7723974ed02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:03.731320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c523a4a-1e8d-4b40-835c-9fe28720377f None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:03.736246 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2963e-41ad-4439-a8b7-6f79e483e770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:03.736954 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2963e-41ad-4439-a8b7-6f79e483e770 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:03.737222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2963e-41ad-4439-a8b7-6f79e483e770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:03.737492 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2963e-41ad-4439-a8b7-6f79e483e770 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:03.738132 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2963e-41ad-4439-a8b7-6f79e483e770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:03.740248 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2963e-41ad-4439-a8b7-6f79e483e770 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:03.741210 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f54df-d155-4f14-ab50-c7723974ed02 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:03.749643 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98af083-344e-41df-8637-74917f8cbe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:03.751462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98af083-344e-41df-8637-74917f8cbe14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:03.751881 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98af083-344e-41df-8637-74917f8cbe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:03.752251 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98af083-344e-41df-8637-74917f8cbe14 admin admin] PATH_INFO: `/v3/projects/c52b66b19e274db48803c15ef7b8a7f4` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:03.755227 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98af083-344e-41df-8637-74917f8cbe14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c52b66b19e274db48803c15ef7b8a7f4)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:03.757843 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98af083-344e-41df-8637-74917f8cbe14 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:03.768666 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1287/2553] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:39:03 2022] POST /identity/v3/users => generated 306 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:39:03.772494 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2963e-41ad-4439-a8b7-6f79e483e770 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:03.784838 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2963e-41ad-4439-a8b7-6f79e483e770 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:03.794537 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df5abd-55d5-49b9-8be7-b7ffb5e5305b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:03.795665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df5abd-55d5-49b9-8be7-b7ffb5e5305b admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:03.795902 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df5abd-55d5-49b9-8be7-b7ffb5e5305b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:03.796053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df5abd-55d5-49b9-8be7-b7ffb5e5305b admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:03.796756 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df5abd-55d5-49b9-8be7-b7ffb5e5305b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:03.808039 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df5abd-55d5-49b9-8be7-b7ffb5e5305b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:03.826664 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1288/2554] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:39:03.828949 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df5abd-55d5-49b9-8be7-b7ffb5e5305b admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:03.841177 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df5abd-55d5-49b9-8be7-b7ffb5e5305b admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:03.847410 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c9264-0b81-44aa-b9d9-00cbfb199444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:03.848298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c9264-0b81-44aa-b9d9-00cbfb199444 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:03.848519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c9264-0b81-44aa-b9d9-00cbfb199444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:03.848897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c9264-0b81-44aa-b9d9-00cbfb199444 admin admin] PATH_INFO: `/v3/projects/f2439dd15a1b44e1a101f2b4ad2453ca/users/e7cc7ece57ef45689809923b13bdac60/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:03.862189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:03.871123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:03.871694 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c9264-0b81-44aa-b9d9-00cbfb199444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2439dd15a1b44e1a101f2b4ad2453ca, user_id=e7cc7ece57ef45689809923b13bdac60, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:03.877082 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c9264-0b81-44aa-b9d9-00cbfb199444 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:03.883373 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c98af083-344e-41df-8637-74917f8cbe14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c52b66b19e274db48803c15ef7b8a7f4', 'request_id': 'req-c98af083-344e-41df-8637-74917f8cbe14'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:03.897854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c98af083-344e-41df-8637-74917f8cbe14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c52b66b19e274db48803c15ef7b8a7f4', 'request_id': 'req-c98af083-344e-41df-8637-74917f8cbe14'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:03.910980 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1289/2555] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:39:03 2022] PUT /identity/v3/projects/f2439dd15a1b44e1a101f2b4ad2453ca/users/e7cc7ece57ef45689809923b13bdac60/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:03.912367 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c98af083-344e-41df-8637-74917f8cbe14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c52b66b19e274db48803c15ef7b8a7f4', 'request_id': 'req-c98af083-344e-41df-8637-74917f8cbe14'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:03.917181 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c9264-0b81-44aa-b9d9-00cbfb199444 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:03.928420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c98af083-344e-41df-8637-74917f8cbe14 admin admin] The token cache is being invalidate because project c52b66b19e274db48803c15ef7b8a7f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:39:03.929046 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c98af083-344e-41df-8637-74917f8cbe14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:03.930044 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c98af083-344e-41df-8637-74917f8cbe14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:03.933655 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1267/2556] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:39:03 2022] DELETE /identity/v3/projects/c52b66b19e274db48803c15ef7b8a7f4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:03.943460 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70649a7-835a-4bc9-bdbb-c1b64337a4c4 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:03.944078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70649a7-835a-4bc9-bdbb-c1b64337a4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:03.944539 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70649a7-835a-4bc9-bdbb-c1b64337a4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:03.969376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-e70649a7-835a-4bc9-bdbb-c1b64337a4c4 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:03.971467 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e70649a7-835a-4bc9-bdbb-c1b64337a4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:04.029263 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c9264-0b81-44aa-b9d9-00cbfb199444 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:04.046496 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b6409-aee9-4ae4-b1aa-8288864ff66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:04.047431 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b6409-aee9-4ae4-b1aa-8288864ff66e admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:04.047878 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b6409-aee9-4ae4-b1aa-8288864ff66e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:04.048156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b6409-aee9-4ae4-b1aa-8288864ff66e admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:04.048866 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b6409-aee9-4ae4-b1aa-8288864ff66e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:04.050457 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b6409-aee9-4ae4-b1aa-8288864ff66e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:04.062647 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1290/2557] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:39:04.067266 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b6409-aee9-4ae4-b1aa-8288864ff66e admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:04.069366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1268/2558] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:04.076511 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c37b6409-aee9-4ae4-b1aa-8288864ff66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:04.077497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af218e10-507b-4a4a-968d-af2d17f02a78 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:04.077722 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af218e10-507b-4a4a-968d-af2d17f02a78 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:04.078511 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af218e10-507b-4a4a-968d-af2d17f02a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:04.095827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b6409-aee9-4ae4-b1aa-8288864ff66e admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:04.100259 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-af218e10-507b-4a4a-968d-af2d17f02a78 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:04.101085 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b529dd-8c9d-4ab6-bf0d-81b5bad07af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:04.101463 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-af218e10-507b-4a4a-968d-af2d17f02a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:04.101999 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b529dd-8c9d-4ab6-bf0d-81b5bad07af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:04.101999 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b529dd-8c9d-4ab6-bf0d-81b5bad07af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:04.102359 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b529dd-8c9d-4ab6-bf0d-81b5bad07af5 admin admin] PATH_INFO: `/v3/projects/f2439dd15a1b44e1a101f2b4ad2453ca/users/e7cc7ece57ef45689809923b13bdac60/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:04.104929 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b529dd-8c9d-4ab6-bf0d-81b5bad07af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2439dd15a1b44e1a101f2b4ad2453ca, user_id=e7cc7ece57ef45689809923b13bdac60, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:04.108055 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b529dd-8c9d-4ab6-bf0d-81b5bad07af5 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:04.110413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1269/2559] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:04.114113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af218e10-507b-4a4a-968d-af2d17f02a78 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:04.126416 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af218e10-507b-4a4a-968d-af2d17f02a78 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:04.126671 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1291/2560] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:39:04 2022] PUT /identity/v3/projects/f2439dd15a1b44e1a101f2b4ad2453ca/users/e7cc7ece57ef45689809923b13bdac60/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:39:04.138222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804d735-bcb2-4e80-b032-5f8f2abe2003 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:04.138552 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804d735-bcb2-4e80-b032-5f8f2abe2003 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:04.138765 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804d735-bcb2-4e80-b032-5f8f2abe2003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:04.172279 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c804d735-bcb2-4e80-b032-5f8f2abe2003 None None] MFA Rules not processed for user `e7cc7ece57ef45689809923b13bdac60`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:04.173861 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c804d735-bcb2-4e80-b032-5f8f2abe2003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:04.213853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948c13d-7792-4e24-8c35-00ae2a09bf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:04.214366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948c13d-7792-4e24-8c35-00ae2a09bf3c admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:04.214680 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948c13d-7792-4e24-8c35-00ae2a09bf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:04.214919 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948c13d-7792-4e24-8c35-00ae2a09bf3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:04.215576 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2948c13d-7792-4e24-8c35-00ae2a09bf3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:39:04.215933 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2948c13d-7792-4e24-8c35-00ae2a09bf3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:04.219911 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2948c13d-7792-4e24-8c35-00ae2a09bf3c admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:04.238689 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1270/2561] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:39:04.243350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948c13d-7792-4e24-8c35-00ae2a09bf3c admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:04.256234 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948c13d-7792-4e24-8c35-00ae2a09bf3c admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:04.263328 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a1560-d7d3-462f-9b79-1ba205b1bd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:04.264487 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a1560-d7d3-462f-9b79-1ba205b1bd02 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:04.264992 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a1560-d7d3-462f-9b79-1ba205b1bd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:04.265484 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a1560-d7d3-462f-9b79-1ba205b1bd02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:04.266323 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a1560-d7d3-462f-9b79-1ba205b1bd02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:04.268260 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1292/2562] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:04 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:39:04.268739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a1560-d7d3-462f-9b79-1ba205b1bd02 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:04.281439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804d735-bcb2-4e80-b032-5f8f2abe2003 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:04.282869 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c804d735-bcb2-4e80-b032-5f8f2abe2003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:04.311938 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1271/2563] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:39:04 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:39:04.315742 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a1560-d7d3-462f-9b79-1ba205b1bd02 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:04.366997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:04.368003 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804d735-bcb2-4e80-b032-5f8f2abe2003 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:04.383745 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:04.402837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a1560-d7d3-462f-9b79-1ba205b1bd02 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:04.409877 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c313d-a1b0-40fc-98c4-0bb0ae9f8a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:04.410853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c313d-a1b0-40fc-98c4-0bb0ae9f8a3f admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:04.411144 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c313d-a1b0-40fc-98c4-0bb0ae9f8a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:04.411541 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c313d-a1b0-40fc-98c4-0bb0ae9f8a3f admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:04.412355 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c313d-a1b0-40fc-98c4-0bb0ae9f8a3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:04.414300 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c313d-a1b0-40fc-98c4-0bb0ae9f8a3f admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:04.451792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1272/2564] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:39:04 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:39:04.456130 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c313d-a1b0-40fc-98c4-0bb0ae9f8a3f admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:04.465109 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251f4f6-08fd-41e8-b342-11c3f64ca975 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:04.466725 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251f4f6-08fd-41e8-b342-11c3f64ca975 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:04.467900 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251f4f6-08fd-41e8-b342-11c3f64ca975 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:04.468217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251f4f6-08fd-41e8-b342-11c3f64ca975 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:04.473691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c313d-a1b0-40fc-98c4-0bb0ae9f8a3f admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:04.481590 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c61e2-b657-403c-af7b-99c29e9ca994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:04.483293 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c61e2-b657-403c-af7b-99c29e9ca994 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:04.489713 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c61e2-b657-403c-af7b-99c29e9ca994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:04.490078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c61e2-b657-403c-af7b-99c29e9ca994 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:04.490778 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c61e2-b657-403c-af7b-99c29e9ca994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:04.492460 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c61e2-b657-403c-af7b-99c29e9ca994 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:04.512853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1273/2565] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:39:04.516836 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c61e2-b657-403c-af7b-99c29e9ca994 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:04.538123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c61e2-b657-403c-af7b-99c29e9ca994 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:04.546560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d3e76-bf77-4e9d-b2fd-1f45fb0999b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:04.547655 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d3e76-bf77-4e9d-b2fd-1f45fb0999b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:04.548343 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d3e76-bf77-4e9d-b2fd-1f45fb0999b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:04.548745 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d3e76-bf77-4e9d-b2fd-1f45fb0999b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:04.550014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d3e76-bf77-4e9d-b2fd-1f45fb0999b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:04.551959 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d3e76-bf77-4e9d-b2fd-1f45fb0999b3 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:04.569975 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1274/2566] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:39:04.571035 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d3e76-bf77-4e9d-b2fd-1f45fb0999b3 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:04.589503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d3e76-bf77-4e9d-b2fd-1f45fb0999b3 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:04.592758 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b251f4f6-08fd-41e8-b342-11c3f64ca975 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:04.594825 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b251f4f6-08fd-41e8-b342-11c3f64ca975 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:04.597900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415e39d-99f2-4763-ab06-0116519f41e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:04.598174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415e39d-99f2-4763-ab06-0116519f41e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:04.598658 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415e39d-99f2-4763-ab06-0116519f41e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:04.598907 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415e39d-99f2-4763-ab06-0116519f41e8 admin admin] PATH_INFO: `/v3/projects/371c9047c7194da8ad27afeafe5a6a40/users/4ac49be8d8164d7ab07c09d1d421160d/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:04.615884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415e39d-99f2-4763-ab06-0116519f41e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=371c9047c7194da8ad27afeafe5a6a40, user_id=4ac49be8d8164d7ab07c09d1d421160d, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:04.618011 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1293/2567] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:04 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:39:04.619599 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415e39d-99f2-4763-ab06-0116519f41e8 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:04.638310 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1275/2568] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:39:04 2022] PUT /identity/v3/projects/371c9047c7194da8ad27afeafe5a6a40/users/4ac49be8d8164d7ab07c09d1d421160d/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:04.649196 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720aab78-62be-48a0-bce9-43024b77e196 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:04.650200 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720aab78-62be-48a0-bce9-43024b77e196 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:04.650474 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720aab78-62be-48a0-bce9-43024b77e196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:04.694625 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-720aab78-62be-48a0-bce9-43024b77e196 None None] MFA Rules not processed for user `4ac49be8d8164d7ab07c09d1d421160d`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:04.696569 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-720aab78-62be-48a0-bce9-43024b77e196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:04.719575 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415e39d-99f2-4763-ab06-0116519f41e8 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:04.786529 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415e39d-99f2-4763-ab06-0116519f41e8 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:04.793978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e0155-83ff-4285-80e9-745ed07cc52f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:04.794904 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e0155-83ff-4285-80e9-745ed07cc52f service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:04.796046 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e0155-83ff-4285-80e9-745ed07cc52f service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:04.796521 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e0155-83ff-4285-80e9-745ed07cc52f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:04.800335 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e88e0155-83ff-4285-80e9-745ed07cc52f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:04.802746 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1294/2569] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:04.807890 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720aab78-62be-48a0-bce9-43024b77e196 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:04.876522 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:04.888125 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e0155-83ff-4285-80e9-745ed07cc52f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:04.889684 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720aab78-62be-48a0-bce9-43024b77e196 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:04.890252 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e0155-83ff-4285-80e9-745ed07cc52f service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:04.894542 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e7c16-b8c0-402b-ab14-d92f393616f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:04.895187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e7c16-b8c0-402b-ab14-d92f393616f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:04.895550 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e7c16-b8c0-402b-ab14-d92f393616f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:04.895914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e7c16-b8c0-402b-ab14-d92f393616f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:04.896860 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e7c16-b8c0-402b-ab14-d92f393616f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:04.898996 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e7c16-b8c0-402b-ab14-d92f393616f9 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:04.901591 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1276/2570] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:04 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:39:04.936423 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1295/2571] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:39:04 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:39:04.940562 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e0155-83ff-4285-80e9-745ed07cc52f service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:04.954560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e0155-83ff-4285-80e9-745ed07cc52f service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:05.002823 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:05.041227 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f1356-a265-4673-88bc-eef9a4bda226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:05.041849 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f1356-a265-4673-88bc-eef9a4bda226 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:05.042149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f1356-a265-4673-88bc-eef9a4bda226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:05.042392 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f1356-a265-4673-88bc-eef9a4bda226 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:05.043670 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f1356-a265-4673-88bc-eef9a4bda226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:05.045624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f1356-a265-4673-88bc-eef9a4bda226 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:05.077099 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1277/2572] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:39:04 2022] POST /identity/v3/users => generated 294 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:39:05.080176 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e7c16-b8c0-402b-ab14-d92f393616f9 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:05.099826 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e7c16-b8c0-402b-ab14-d92f393616f9 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:05.109908 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684deb3-9921-404f-bba5-38ea5d52e117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:05.110865 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684deb3-9921-404f-bba5-38ea5d52e117 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:05.111548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684deb3-9921-404f-bba5-38ea5d52e117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:05.111894 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684deb3-9921-404f-bba5-38ea5d52e117 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:05.113491 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684deb3-9921-404f-bba5-38ea5d52e117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:05.115401 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684deb3-9921-404f-bba5-38ea5d52e117 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:05.141630 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1296/2573] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:39:05.145777 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f1356-a265-4673-88bc-eef9a4bda226 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:05.163292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f1356-a265-4673-88bc-eef9a4bda226 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:05.171058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e675a2-b1d4-4899-a498-6072c958dc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:05.172539 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e675a2-b1d4-4899-a498-6072c958dc0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:05.172999 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e675a2-b1d4-4899-a498-6072c958dc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:05.173380 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e675a2-b1d4-4899-a498-6072c958dc0f admin admin] PATH_INFO: `/v3/projects/81862bdf17bf4cd19288a6c1c210a695/users/7b4fe1f1dc144ea88908e501438f9b6a/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:05.197412 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e675a2-b1d4-4899-a498-6072c958dc0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=81862bdf17bf4cd19288a6c1c210a695, user_id=7b4fe1f1dc144ea88908e501438f9b6a, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:05.201566 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e675a2-b1d4-4899-a498-6072c958dc0f admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:05.231055 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1278/2574] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:39:05 2022] PUT /identity/v3/projects/81862bdf17bf4cd19288a6c1c210a695/users/7b4fe1f1dc144ea88908e501438f9b6a/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:39:05.235488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684deb3-9921-404f-bba5-38ea5d52e117 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:05.251269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684deb3-9921-404f-bba5-38ea5d52e117 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:05.412724 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95170ed3-3e60-474d-a83d-b36a03084801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:05.413453 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95170ed3-3e60-474d-a83d-b36a03084801 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:05.414016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95170ed3-3e60-474d-a83d-b36a03084801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:05.414383 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95170ed3-3e60-474d-a83d-b36a03084801 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:05.416329 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95170ed3-3e60-474d-a83d-b36a03084801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:05.417995 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95170ed3-3e60-474d-a83d-b36a03084801 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:05.433933 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1297/2575] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:39:05.438355 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e675a2-b1d4-4899-a498-6072c958dc0f admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:05.449999 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e675a2-b1d4-4899-a498-6072c958dc0f admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:05.454669 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2823c-c053-4da7-bc93-ba14775b6803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:05.455329 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2823c-c053-4da7-bc93-ba14775b6803 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:05.455606 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2823c-c053-4da7-bc93-ba14775b6803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:05.455906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2823c-c053-4da7-bc93-ba14775b6803 admin admin] PATH_INFO: `/v3/projects/81862bdf17bf4cd19288a6c1c210a695/users/7b4fe1f1dc144ea88908e501438f9b6a/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:05.458078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2823c-c053-4da7-bc93-ba14775b6803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81862bdf17bf4cd19288a6c1c210a695, user_id=7b4fe1f1dc144ea88908e501438f9b6a, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:05.460740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2823c-c053-4da7-bc93-ba14775b6803 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:05.483802 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1279/2576] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:39:05 2022] PUT /identity/v3/projects/81862bdf17bf4cd19288a6c1c210a695/users/7b4fe1f1dc144ea88908e501438f9b6a/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:05.488953 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea6883-136b-47ce-ba78-d37c2363e080 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:05.489269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea6883-136b-47ce-ba78-d37c2363e080 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:05.489512 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea6883-136b-47ce-ba78-d37c2363e080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:05.521298 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-37ea6883-136b-47ce-ba78-d37c2363e080 None None] MFA Rules not processed for user `7b4fe1f1dc144ea88908e501438f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:05.522912 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-37ea6883-136b-47ce-ba78-d37c2363e080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:05.613998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1298/2577] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:05.626283 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2823c-c053-4da7-bc93-ba14775b6803 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:05.689135 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2823c-c053-4da7-bc93-ba14775b6803 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:05.693660 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70066e74-0ad8-4f5d-b3b6-a24d6e808185 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:05.694472 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70066e74-0ad8-4f5d-b3b6-a24d6e808185 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:05.694925 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70066e74-0ad8-4f5d-b3b6-a24d6e808185 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:05.695188 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70066e74-0ad8-4f5d-b3b6-a24d6e808185 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:05.759336 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70066e74-0ad8-4f5d-b3b6-a24d6e808185 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:05.760938 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70066e74-0ad8-4f5d-b3b6-a24d6e808185 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:05.770421 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1280/2578] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:39:07.216104 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea6883-136b-47ce-ba78-d37c2363e080 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:07.217913 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-37ea6883-136b-47ce-ba78-d37c2363e080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:07.237483 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea6883-136b-47ce-ba78-d37c2363e080 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:07.241277 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be522e1-eb31-4485-ad38-b49855ed6021 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:07.241890 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be522e1-eb31-4485-ad38-b49855ed6021 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:07.242170 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be522e1-eb31-4485-ad38-b49855ed6021 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:07.242441 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be522e1-eb31-4485-ad38-b49855ed6021 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:07.258768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be522e1-eb31-4485-ad38-b49855ed6021 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:07.262704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be522e1-eb31-4485-ad38-b49855ed6021 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:07.276702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1299/2579] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:39:09.347403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70066e74-0ad8-4f5d-b3b6-a24d6e808185 service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:09.400319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:09.427582 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70066e74-0ad8-4f5d-b3b6-a24d6e808185 service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:09.433324 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56981ab3-9ff5-494f-82ae-e7b5e3ed3cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:09.433962 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56981ab3-9ff5-494f-82ae-e7b5e3ed3cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:09.434250 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56981ab3-9ff5-494f-82ae-e7b5e3ed3cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:09.434600 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56981ab3-9ff5-494f-82ae-e7b5e3ed3cd7 admin admin] PATH_INFO: `/v3/users/f8bf97b1668f4d3fbd99f42163cae7cc` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:09.437137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56981ab3-9ff5-494f-82ae-e7b5e3ed3cd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8bf97b1668f4d3fbd99f42163cae7cc)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:09.437792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56981ab3-9ff5-494f-82ae-e7b5e3ed3cd7 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:09.492723 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-56981ab3-9ff5-494f-82ae-e7b5e3ed3cd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8bf97b1668f4d3fbd99f42163cae7cc'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:09.494777 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-56981ab3-9ff5-494f-82ae-e7b5e3ed3cd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8bf97b1668f4d3fbd99f42163cae7cc'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:09.507880 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-56981ab3-9ff5-494f-82ae-e7b5e3ed3cd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8bf97b1668f4d3fbd99f42163cae7cc'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:09.518296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-56981ab3-9ff5-494f-82ae-e7b5e3ed3cd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8bf97b1668f4d3fbd99f42163cae7cc'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:09.531007 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-56981ab3-9ff5-494f-82ae-e7b5e3ed3cd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8bf97b1668f4d3fbd99f42163cae7cc'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:09.538711 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1281/2580] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:39:09 2022] DELETE /identity/v3/users/f8bf97b1668f4d3fbd99f42163cae7cc => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:09.545013 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161588d-0d44-478e-8e75-9c6e2f9ef967 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:09.546201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161588d-0d44-478e-8e75-9c6e2f9ef967 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:09.546570 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161588d-0d44-478e-8e75-9c6e2f9ef967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:09.575552 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c161588d-0d44-478e-8e75-9c6e2f9ef967 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:09.576838 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c161588d-0d44-478e-8e75-9c6e2f9ef967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:09.618377 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:09.659417 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1300/2581] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:09.672403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56981ab3-9ff5-494f-82ae-e7b5e3ed3cd7 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:09.673885 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-56981ab3-9ff5-494f-82ae-e7b5e3ed3cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:09.749675 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56981ab3-9ff5-494f-82ae-e7b5e3ed3cd7 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:09.753582 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383dc9ea-dcc5-44a4-a79b-5d039c4a8302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:09.754434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383dc9ea-dcc5-44a4-a79b-5d039c4a8302 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:09.754715 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383dc9ea-dcc5-44a4-a79b-5d039c4a8302 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:09.754984 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383dc9ea-dcc5-44a4-a79b-5d039c4a8302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:09.765435 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383dc9ea-dcc5-44a4-a79b-5d039c4a8302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:09.766874 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383dc9ea-dcc5-44a4-a79b-5d039c4a8302 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:09.777520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1282/2582] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:39:10.199854 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161588d-0d44-478e-8e75-9c6e2f9ef967 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:10.201655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c161588d-0d44-478e-8e75-9c6e2f9ef967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:10.223529 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161588d-0d44-478e-8e75-9c6e2f9ef967 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:10.232203 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5d1e5-c3fd-4915-bbde-61482d2f1092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:10.232954 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5d1e5-c3fd-4915-bbde-61482d2f1092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:10.233255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5d1e5-c3fd-4915-bbde-61482d2f1092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:10.233624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5d1e5-c3fd-4915-bbde-61482d2f1092 admin admin] PATH_INFO: `/v3/projects/4b99273f72e741b382ceae6723304fde` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:10.235089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5d1e5-c3fd-4915-bbde-61482d2f1092 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b99273f72e741b382ceae6723304fde)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:10.237255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5d1e5-c3fd-4915-bbde-61482d2f1092 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:10.329866 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5cd5d1e5-c3fd-4915-bbde-61482d2f1092 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b99273f72e741b382ceae6723304fde', 'request_id': 'req-5cd5d1e5-c3fd-4915-bbde-61482d2f1092'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:10.336628 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5cd5d1e5-c3fd-4915-bbde-61482d2f1092 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b99273f72e741b382ceae6723304fde', 'request_id': 'req-5cd5d1e5-c3fd-4915-bbde-61482d2f1092'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:10.349084 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5cd5d1e5-c3fd-4915-bbde-61482d2f1092 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b99273f72e741b382ceae6723304fde', 'request_id': 'req-5cd5d1e5-c3fd-4915-bbde-61482d2f1092'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:10.366179 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5cd5d1e5-c3fd-4915-bbde-61482d2f1092 admin admin] The token cache is being invalidate because project 4b99273f72e741b382ceae6723304fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:39:10.366570 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5cd5d1e5-c3fd-4915-bbde-61482d2f1092 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:10.367521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5cd5d1e5-c3fd-4915-bbde-61482d2f1092 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:10.375366 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383dc9ea-dcc5-44a4-a79b-5d039c4a8302 service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:10.379826 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1301/2583] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:39:10 2022] DELETE /identity/v3/projects/4b99273f72e741b382ceae6723304fde => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:10.387966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383dc9ea-dcc5-44a4-a79b-5d039c4a8302 service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:10.466414 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38285620-7bb8-4a13-9cd5-c96ed118936e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:10.467072 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38285620-7bb8-4a13-9cd5-c96ed118936e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:10.467418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38285620-7bb8-4a13-9cd5-c96ed118936e admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:10.467701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38285620-7bb8-4a13-9cd5-c96ed118936e admin admin] PATH_INFO: `/v3/users/e7cc7ece57ef45689809923b13bdac60` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:10.469033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38285620-7bb8-4a13-9cd5-c96ed118936e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7cc7ece57ef45689809923b13bdac60)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:10.471191 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38285620-7bb8-4a13-9cd5-c96ed118936e admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:10.474287 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:10.536646 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-38285620-7bb8-4a13-9cd5-c96ed118936e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7cc7ece57ef45689809923b13bdac60'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:10.537433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-38285620-7bb8-4a13-9cd5-c96ed118936e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7cc7ece57ef45689809923b13bdac60'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:10.552562 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-38285620-7bb8-4a13-9cd5-c96ed118936e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7cc7ece57ef45689809923b13bdac60'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:10.564487 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-38285620-7bb8-4a13-9cd5-c96ed118936e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7cc7ece57ef45689809923b13bdac60'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:10.574217 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-38285620-7bb8-4a13-9cd5-c96ed118936e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7cc7ece57ef45689809923b13bdac60'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:10.580936 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1283/2584] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:39:10 2022] DELETE /identity/v3/users/e7cc7ece57ef45689809923b13bdac60 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:10.909186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5d1e5-c3fd-4915-bbde-61482d2f1092 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:10.910708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5cd5d1e5-c3fd-4915-bbde-61482d2f1092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:10.924585 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5d1e5-c3fd-4915-bbde-61482d2f1092 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:10.981718 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfe37b-6807-4e4f-a79e-2984ab3408fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:10.982351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfe37b-6807-4e4f-a79e-2984ab3408fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:10.982622 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfe37b-6807-4e4f-a79e-2984ab3408fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:10.982887 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfe37b-6807-4e4f-a79e-2984ab3408fb admin admin] PATH_INFO: `/v3/projects/f2439dd15a1b44e1a101f2b4ad2453ca` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:10.984028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dfe37b-6807-4e4f-a79e-2984ab3408fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2439dd15a1b44e1a101f2b4ad2453ca)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:10.985901 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dfe37b-6807-4e4f-a79e-2984ab3408fb admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:11.034588 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-71dfe37b-6807-4e4f-a79e-2984ab3408fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2439dd15a1b44e1a101f2b4ad2453ca', 'request_id': 'req-71dfe37b-6807-4e4f-a79e-2984ab3408fb'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:11.039965 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-71dfe37b-6807-4e4f-a79e-2984ab3408fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2439dd15a1b44e1a101f2b4ad2453ca', 'request_id': 'req-71dfe37b-6807-4e4f-a79e-2984ab3408fb'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:11.041773 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:11.046355 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-71dfe37b-6807-4e4f-a79e-2984ab3408fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2439dd15a1b44e1a101f2b4ad2453ca', 'request_id': 'req-71dfe37b-6807-4e4f-a79e-2984ab3408fb'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:11.060512 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-71dfe37b-6807-4e4f-a79e-2984ab3408fb admin admin] The token cache is being invalidate because project f2439dd15a1b44e1a101f2b4ad2453ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:39:11.060793 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-71dfe37b-6807-4e4f-a79e-2984ab3408fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:11.061399 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-71dfe37b-6807-4e4f-a79e-2984ab3408fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:11.062871 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1302/2585] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:39:10 2022] DELETE /identity/v3/projects/f2439dd15a1b44e1a101f2b4ad2453ca => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:39:11.067987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdfa0b-6381-4bec-b929-150b12faaa0a None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:11.068299 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdfa0b-6381-4bec-b929-150b12faaa0a None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:11.068575 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdfa0b-6381-4bec-b929-150b12faaa0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:11.088735 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-decdfa0b-6381-4bec-b929-150b12faaa0a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:11.089933 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-decdfa0b-6381-4bec-b929-150b12faaa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:11.151700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1284/2586] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:11.160620 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3bf2d-55d8-45ba-8f52-78d24c337f29 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:11.161095 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3bf2d-55d8-45ba-8f52-78d24c337f29 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:11.161419 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3bf2d-55d8-45ba-8f52-78d24c337f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:11.182951 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e7c3bf2d-55d8-45ba-8f52-78d24c337f29 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:11.184190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e7c3bf2d-55d8-45ba-8f52-78d24c337f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:11.192337 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1303/2587] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:11.197190 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdfa0b-6381-4bec-b929-150b12faaa0a None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:11.207751 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdfa0b-6381-4bec-b929-150b12faaa0a None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:11.212907 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f906b85-ffb2-4acc-8a31-ff0441890f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:11.213502 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f906b85-ffb2-4acc-8a31-ff0441890f8b admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:11.213777 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f906b85-ffb2-4acc-8a31-ff0441890f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:11.214048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f906b85-ffb2-4acc-8a31-ff0441890f8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:11.214682 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f906b85-ffb2-4acc-8a31-ff0441890f8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:39:11.215005 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f906b85-ffb2-4acc-8a31-ff0441890f8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:11.216615 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f906b85-ffb2-4acc-8a31-ff0441890f8b admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:11.227979 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1285/2588] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:39:11.232588 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3bf2d-55d8-45ba-8f52-78d24c337f29 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:11.241728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3bf2d-55d8-45ba-8f52-78d24c337f29 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:11.246774 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4e6c0-81ed-46f0-ba5a-26d2053ce70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:11.247368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4e6c0-81ed-46f0-ba5a-26d2053ce70f admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:11.247641 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4e6c0-81ed-46f0-ba5a-26d2053ce70f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:11.247932 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4e6c0-81ed-46f0-ba5a-26d2053ce70f admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:11.248576 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4e6c0-81ed-46f0-ba5a-26d2053ce70f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:11.250439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4e6c0-81ed-46f0-ba5a-26d2053ce70f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:11.278723 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1304/2589] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:39:11 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:39:11.282920 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f906b85-ffb2-4acc-8a31-ff0441890f8b admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:11.297876 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f906b85-ffb2-4acc-8a31-ff0441890f8b admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:11.320984 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4e6c0-81ed-46f0-ba5a-26d2053ce70f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:11.323365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4de4e6c0-81ed-46f0-ba5a-26d2053ce70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:11.359170 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5233b-7ebf-4128-ad01-a7d0a9688901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:11.359821 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5233b-7ebf-4128-ad01-a7d0a9688901 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:11.360103 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5233b-7ebf-4128-ad01-a7d0a9688901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:11.360375 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5233b-7ebf-4128-ad01-a7d0a9688901 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:11.361072 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e5233b-7ebf-4128-ad01-a7d0a9688901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:11.362973 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e5233b-7ebf-4128-ad01-a7d0a9688901 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:11.387025 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:11.398851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1286/2590] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:39:11 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:39:11.402314 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4e6c0-81ed-46f0-ba5a-26d2053ce70f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:11.403520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5233b-7ebf-4128-ad01-a7d0a9688901 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:11.409499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758db7db-5feb-4574-b9f9-125c8210ff65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:11.410929 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758db7db-5feb-4574-b9f9-125c8210ff65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:11.411115 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758db7db-5feb-4574-b9f9-125c8210ff65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:11.411520 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758db7db-5feb-4574-b9f9-125c8210ff65 admin admin] PATH_INFO: `/v3/users/4ac49be8d8164d7ab07c09d1d421160d` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:11.412895 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758db7db-5feb-4574-b9f9-125c8210ff65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ac49be8d8164d7ab07c09d1d421160d)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:11.415036 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758db7db-5feb-4574-b9f9-125c8210ff65 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:11.420063 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5233b-7ebf-4128-ad01-a7d0a9688901 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:11.426100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ba93b-ab04-4163-af44-98bb06e91771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:11.426717 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ba93b-ab04-4163-af44-98bb06e91771 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:11.426998 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ba93b-ab04-4163-af44-98bb06e91771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:11.427273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ba93b-ab04-4163-af44-98bb06e91771 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:11.427958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ba93b-ab04-4163-af44-98bb06e91771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:11.430059 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ba93b-ab04-4163-af44-98bb06e91771 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:11.451988 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1287/2591] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:39:11.454077 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ba93b-ab04-4163-af44-98bb06e91771 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:11.470682 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ba93b-ab04-4163-af44-98bb06e91771 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:11.476846 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cc6a8-b6c7-4b37-a4c3-1991201d28fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:11.477233 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cc6a8-b6c7-4b37-a4c3-1991201d28fc admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:11.477836 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cc6a8-b6c7-4b37-a4c3-1991201d28fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:11.478238 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cc6a8-b6c7-4b37-a4c3-1991201d28fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:11.479500 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cc6a8-b6c7-4b37-a4c3-1991201d28fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:11.481291 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cc6a8-b6c7-4b37-a4c3-1991201d28fc admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:11.490759 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-758db7db-5feb-4574-b9f9-125c8210ff65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ac49be8d8164d7ab07c09d1d421160d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:11.491393 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-758db7db-5feb-4574-b9f9-125c8210ff65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ac49be8d8164d7ab07c09d1d421160d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:11.493453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1288/2592] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:39:11.498362 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cc6a8-b6c7-4b37-a4c3-1991201d28fc admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:11.506221 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-758db7db-5feb-4574-b9f9-125c8210ff65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ac49be8d8164d7ab07c09d1d421160d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:11.509563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cc6a8-b6c7-4b37-a4c3-1991201d28fc admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:11.515684 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55163c52-09c6-4950-82df-23ef296889d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:11.516386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55163c52-09c6-4950-82df-23ef296889d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:11.516668 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55163c52-09c6-4950-82df-23ef296889d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:11.516939 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55163c52-09c6-4950-82df-23ef296889d6 admin admin] PATH_INFO: `/v3/projects/7c55338ced054e56bc334fc3e34bf741/users/d0c3796e5c5140208657ce9a5f9e95b7/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:11.522885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-758db7db-5feb-4574-b9f9-125c8210ff65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ac49be8d8164d7ab07c09d1d421160d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:11.534041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55163c52-09c6-4950-82df-23ef296889d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c55338ced054e56bc334fc3e34bf741, user_id=d0c3796e5c5140208657ce9a5f9e95b7, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:11.536279 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-758db7db-5feb-4574-b9f9-125c8210ff65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ac49be8d8164d7ab07c09d1d421160d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:11.536768 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55163c52-09c6-4950-82df-23ef296889d6 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:11.545258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1305/2593] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:39:11 2022] DELETE /identity/v3/users/4ac49be8d8164d7ab07c09d1d421160d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:39:11.550775 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dec8a-f1bc-40bd-bf13-d3e207541e89 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:11.551147 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dec8a-f1bc-40bd-bf13-d3e207541e89 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:11.551488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dec8a-f1bc-40bd-bf13-d3e207541e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:11.555459 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1289/2594] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:39:11 2022] PUT /identity/v3/projects/7c55338ced054e56bc334fc3e34bf741/users/d0c3796e5c5140208657ce9a5f9e95b7/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:11.569068 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bac75-ab35-4efe-9560-736187d7ba4e None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:11.569437 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bac75-ab35-4efe-9560-736187d7ba4e None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:11.569781 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bac75-ab35-4efe-9560-736187d7ba4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:11.583520 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-8b7dec8a-f1bc-40bd-bf13-d3e207541e89 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:11.584752 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8b7dec8a-f1bc-40bd-bf13-d3e207541e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:11.601781 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-a14bac75-ab35-4efe-9560-736187d7ba4e None None] MFA Rules not processed for user `d0c3796e5c5140208657ce9a5f9e95b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:11.603115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a14bac75-ab35-4efe-9560-736187d7ba4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:11.619524 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:11.660249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1306/2595] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:39:11.672577 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7dec8a-f1bc-40bd-bf13-d3e207541e89 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:11.674181 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8b7dec8a-f1bc-40bd-bf13-d3e207541e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:11.688479 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1290/2596] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:11.700794 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bac75-ab35-4efe-9560-736187d7ba4e None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:11.702338 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a14bac75-ab35-4efe-9560-736187d7ba4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:11.737438 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7dec8a-f1bc-40bd-bf13-d3e207541e89 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:11.741592 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee7621-9431-44b4-a583-c4fe4ca0f0e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:11.742142 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee7621-9431-44b4-a583-c4fe4ca0f0e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:11.742424 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee7621-9431-44b4-a583-c4fe4ca0f0e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:11.742696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee7621-9431-44b4-a583-c4fe4ca0f0e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:11.753609 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee7621-9431-44b4-a583-c4fe4ca0f0e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:11.755039 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee7621-9431-44b4-a583-c4fe4ca0f0e9 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:11.763037 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bac75-ab35-4efe-9560-736187d7ba4e None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:11.765481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1307/2597] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:39:11.766886 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c4ac0-fa7f-45ee-ba61-e205ab855683 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:11.767566 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c4ac0-fa7f-45ee-ba61-e205ab855683 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:11.767946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c4ac0-fa7f-45ee-ba61-e205ab855683 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:11.768287 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c4ac0-fa7f-45ee-ba61-e205ab855683 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:11.777310 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c4ac0-fa7f-45ee-ba61-e205ab855683 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:11.778844 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c4ac0-fa7f-45ee-ba61-e205ab855683 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:11.788436 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1291/2598] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:39:12.075753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee7621-9431-44b4-a583-c4fe4ca0f0e9 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:12.077971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-19ee7621-9431-44b4-a583-c4fe4ca0f0e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:12.124679 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee7621-9431-44b4-a583-c4fe4ca0f0e9 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:12.137520 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb431c83-5d5b-4f58-a1d0-42f619d1a146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:12.138492 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb431c83-5d5b-4f58-a1d0-42f619d1a146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:12.139022 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb431c83-5d5b-4f58-a1d0-42f619d1a146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:12.140137 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb431c83-5d5b-4f58-a1d0-42f619d1a146 admin admin] PATH_INFO: `/v3/projects/371c9047c7194da8ad27afeafe5a6a40` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:12.141590 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb431c83-5d5b-4f58-a1d0-42f619d1a146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=371c9047c7194da8ad27afeafe5a6a40)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:12.144619 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb431c83-5d5b-4f58-a1d0-42f619d1a146 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:12.227061 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-eb431c83-5d5b-4f58-a1d0-42f619d1a146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '371c9047c7194da8ad27afeafe5a6a40', 'request_id': 'req-eb431c83-5d5b-4f58-a1d0-42f619d1a146'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:12.234534 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-eb431c83-5d5b-4f58-a1d0-42f619d1a146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '371c9047c7194da8ad27afeafe5a6a40', 'request_id': 'req-eb431c83-5d5b-4f58-a1d0-42f619d1a146'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:12.241882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-eb431c83-5d5b-4f58-a1d0-42f619d1a146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '371c9047c7194da8ad27afeafe5a6a40', 'request_id': 'req-eb431c83-5d5b-4f58-a1d0-42f619d1a146'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:12.255778 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-eb431c83-5d5b-4f58-a1d0-42f619d1a146 admin admin] The token cache is being invalidate because project 371c9047c7194da8ad27afeafe5a6a40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:39:12.256013 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-eb431c83-5d5b-4f58-a1d0-42f619d1a146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:12.256647 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-eb431c83-5d5b-4f58-a1d0-42f619d1a146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:12.258131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1308/2599] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:39:12 2022] DELETE /identity/v3/projects/371c9047c7194da8ad27afeafe5a6a40 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:12.262268 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c4ac0-fa7f-45ee-ba61-e205ab855683 service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:12.272753 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c4ac0-fa7f-45ee-ba61-e205ab855683 service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:12.318178 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:12.335562 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25905b27-a3d6-4fec-8b56-24ea210c7e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:12.336239 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25905b27-a3d6-4fec-8b56-24ea210c7e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:12.336518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25905b27-a3d6-4fec-8b56-24ea210c7e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:12.336794 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25905b27-a3d6-4fec-8b56-24ea210c7e85 admin admin] PATH_INFO: `/v3/users/7b4fe1f1dc144ea88908e501438f9b6a` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:12.337942 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25905b27-a3d6-4fec-8b56-24ea210c7e85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b4fe1f1dc144ea88908e501438f9b6a)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:12.340594 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25905b27-a3d6-4fec-8b56-24ea210c7e85 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:12.391475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-25905b27-a3d6-4fec-8b56-24ea210c7e85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b4fe1f1dc144ea88908e501438f9b6a'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:12.392177 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-25905b27-a3d6-4fec-8b56-24ea210c7e85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b4fe1f1dc144ea88908e501438f9b6a'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:12.404689 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-25905b27-a3d6-4fec-8b56-24ea210c7e85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b4fe1f1dc144ea88908e501438f9b6a'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:12.415007 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-25905b27-a3d6-4fec-8b56-24ea210c7e85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b4fe1f1dc144ea88908e501438f9b6a'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:12.422870 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-25905b27-a3d6-4fec-8b56-24ea210c7e85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b4fe1f1dc144ea88908e501438f9b6a'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:12.429506 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1292/2600] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:39:12 2022] DELETE /identity/v3/users/7b4fe1f1dc144ea88908e501438f9b6a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:39:12.809771 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb431c83-5d5b-4f58-a1d0-42f619d1a146 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:12.811163 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-eb431c83-5d5b-4f58-a1d0-42f619d1a146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:12.830458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb431c83-5d5b-4f58-a1d0-42f619d1a146 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:12.888784 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376bccd-a705-4a3d-b03b-463ce5e8db59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:12.889420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376bccd-a705-4a3d-b03b-463ce5e8db59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:12.889696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376bccd-a705-4a3d-b03b-463ce5e8db59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:12.889962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376bccd-a705-4a3d-b03b-463ce5e8db59 admin admin] PATH_INFO: `/v3/projects/81862bdf17bf4cd19288a6c1c210a695` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:12.891067 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376bccd-a705-4a3d-b03b-463ce5e8db59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81862bdf17bf4cd19288a6c1c210a695)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:12.892974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376bccd-a705-4a3d-b03b-463ce5e8db59 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:12.901365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:12.942862 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9376bccd-a705-4a3d-b03b-463ce5e8db59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81862bdf17bf4cd19288a6c1c210a695', 'request_id': 'req-9376bccd-a705-4a3d-b03b-463ce5e8db59'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:12.948859 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9376bccd-a705-4a3d-b03b-463ce5e8db59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81862bdf17bf4cd19288a6c1c210a695', 'request_id': 'req-9376bccd-a705-4a3d-b03b-463ce5e8db59'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:12.954852 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9376bccd-a705-4a3d-b03b-463ce5e8db59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81862bdf17bf4cd19288a6c1c210a695', 'request_id': 'req-9376bccd-a705-4a3d-b03b-463ce5e8db59'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:12.968650 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9376bccd-a705-4a3d-b03b-463ce5e8db59 admin admin] The token cache is being invalidate because project 81862bdf17bf4cd19288a6c1c210a695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:39:12.968936 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9376bccd-a705-4a3d-b03b-463ce5e8db59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:12.969554 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-9376bccd-a705-4a3d-b03b-463ce5e8db59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:12.971015 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1309/2601] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:39:12 2022] DELETE /identity/v3/projects/81862bdf17bf4cd19288a6c1c210a695 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:39:12.975913 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83306c3b-cf12-41ca-816c-5cf7f8fb73fd None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:12.976206 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83306c3b-cf12-41ca-816c-5cf7f8fb73fd None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:12.976484 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83306c3b-cf12-41ca-816c-5cf7f8fb73fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:12.996467 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-83306c3b-cf12-41ca-816c-5cf7f8fb73fd None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:12.997655 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-83306c3b-cf12-41ca-816c-5cf7f8fb73fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:13.055884 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1293/2602] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:13.063937 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc395ae0-f5f0-4b52-a2bd-d5c3888604cc None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:13.064224 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc395ae0-f5f0-4b52-a2bd-d5c3888604cc None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:13.064498 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc395ae0-f5f0-4b52-a2bd-d5c3888604cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:13.084196 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-bc395ae0-f5f0-4b52-a2bd-d5c3888604cc None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:13.085384 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bc395ae0-f5f0-4b52-a2bd-d5c3888604cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:13.094108 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1310/2603] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:13.098321 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83306c3b-cf12-41ca-816c-5cf7f8fb73fd None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:13.108598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83306c3b-cf12-41ca-816c-5cf7f8fb73fd None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:13.113165 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adc57d-cd6b-4df6-ac42-76322a3129be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:13.113760 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adc57d-cd6b-4df6-ac42-76322a3129be admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:13.114042 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adc57d-cd6b-4df6-ac42-76322a3129be admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:13.114316 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adc57d-cd6b-4df6-ac42-76322a3129be admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:13.114962 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adc57d-cd6b-4df6-ac42-76322a3129be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:39:13.115266 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adc57d-cd6b-4df6-ac42-76322a3129be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:13.116944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adc57d-cd6b-4df6-ac42-76322a3129be admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:13.128546 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1294/2604] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:39:13.132837 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc395ae0-f5f0-4b52-a2bd-d5c3888604cc None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:13.141995 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc395ae0-f5f0-4b52-a2bd-d5c3888604cc None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:13.146664 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ef099-1b4a-45b2-a9d6-da42a4f0572e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:13.147258 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ef099-1b4a-45b2-a9d6-da42a4f0572e admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:13.147533 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ef099-1b4a-45b2-a9d6-da42a4f0572e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:13.147833 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ef099-1b4a-45b2-a9d6-da42a4f0572e admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:13.148464 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ef099-1b4a-45b2-a9d6-da42a4f0572e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:13.150335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ef099-1b4a-45b2-a9d6-da42a4f0572e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:13.182721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1311/2605] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:39:13 2022] POST /identity/v3/projects => generated 393 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:39:13.186991 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adc57d-cd6b-4df6-ac42-76322a3129be admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:13.197266 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adc57d-cd6b-4df6-ac42-76322a3129be admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:13.249461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:13.261766 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fecdb7-98ca-4e51-a62b-ae806d74b71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:13.262548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fecdb7-98ca-4e51-a62b-ae806d74b71f admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:13.263180 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fecdb7-98ca-4e51-a62b-ae806d74b71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:13.263457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fecdb7-98ca-4e51-a62b-ae806d74b71f admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:13.264325 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fecdb7-98ca-4e51-a62b-ae806d74b71f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:13.266365 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fecdb7-98ca-4e51-a62b-ae806d74b71f admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:13.292234 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1295/2606] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:39:13 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:39:13.293489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ef099-1b4a-45b2-a9d6-da42a4f0572e admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:13.304216 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ef099-1b4a-45b2-a9d6-da42a4f0572e admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:13.310636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb141ac-b5ef-4de6-b8ab-6e60b1fac7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:13.310636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb141ac-b5ef-4de6-b8ab-6e60b1fac7df admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:13.310636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb141ac-b5ef-4de6-b8ab-6e60b1fac7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:13.310636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb141ac-b5ef-4de6-b8ab-6e60b1fac7df admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:13.311483 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb141ac-b5ef-4de6-b8ab-6e60b1fac7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:13.312447 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb141ac-b5ef-4de6-b8ab-6e60b1fac7df admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:13.324764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1312/2607] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:39:13.328021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fecdb7-98ca-4e51-a62b-ae806d74b71f admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:13.340326 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fecdb7-98ca-4e51-a62b-ae806d74b71f admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:13.345096 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e9e43-cd6d-48ae-a347-034a3b48c2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:13.345732 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e9e43-cd6d-48ae-a347-034a3b48c2db admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:13.346073 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e9e43-cd6d-48ae-a347-034a3b48c2db admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:13.346444 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e9e43-cd6d-48ae-a347-034a3b48c2db admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:13.346955 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e9e43-cd6d-48ae-a347-034a3b48c2db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:13.348569 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e9e43-cd6d-48ae-a347-034a3b48c2db admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:13.358905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1296/2608] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:39:13.363663 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb141ac-b5ef-4de6-b8ab-6e60b1fac7df admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:13.373679 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb141ac-b5ef-4de6-b8ab-6e60b1fac7df admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:13.378446 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896720ba-3a4e-4ab8-a77b-577b759ec5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:13.379149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896720ba-3a4e-4ab8-a77b-577b759ec5c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:13.381770 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896720ba-3a4e-4ab8-a77b-577b759ec5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:13.382064 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896720ba-3a4e-4ab8-a77b-577b759ec5c8 admin admin] PATH_INFO: `/v3/projects/7e210531841e4566b55d3c07cdec1317/users/0e6dd4ab671543d99b4cfd8f5bc05b15/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:13.399019 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896720ba-3a4e-4ab8-a77b-577b759ec5c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e210531841e4566b55d3c07cdec1317, user_id=0e6dd4ab671543d99b4cfd8f5bc05b15, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:13.402416 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896720ba-3a4e-4ab8-a77b-577b759ec5c8 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:13.416822 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1313/2609] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:39:13 2022] PUT /identity/v3/projects/7e210531841e4566b55d3c07cdec1317/users/0e6dd4ab671543d99b4cfd8f5bc05b15/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:13.428585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c209f-d18d-4c6c-af12-5cff1ad29bda None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:13.429088 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c209f-d18d-4c6c-af12-5cff1ad29bda None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:13.429200 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c209f-d18d-4c6c-af12-5cff1ad29bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:13.457488 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-e31c209f-d18d-4c6c-af12-5cff1ad29bda None None] MFA Rules not processed for user `0e6dd4ab671543d99b4cfd8f5bc05b15`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:13.458680 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e31c209f-d18d-4c6c-af12-5cff1ad29bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:13.524362 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1297/2610] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:13.530149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896720ba-3a4e-4ab8-a77b-577b759ec5c8 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:13.596335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896720ba-3a4e-4ab8-a77b-577b759ec5c8 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:13.601324 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd06c08-96bc-4fbb-b50d-c02c9c8eb2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:13.601936 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd06c08-96bc-4fbb-b50d-c02c9c8eb2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:13.602226 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd06c08-96bc-4fbb-b50d-c02c9c8eb2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:13.602470 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd06c08-96bc-4fbb-b50d-c02c9c8eb2b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:13.603122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd06c08-96bc-4fbb-b50d-c02c9c8eb2b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:13.605169 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd06c08-96bc-4fbb-b50d-c02c9c8eb2b4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:13.631895 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1314/2611] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:39:13 2022] POST /identity/v3/projects => generated 393 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:39:13.636733 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c209f-d18d-4c6c-af12-5cff1ad29bda None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:13.647418 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c209f-d18d-4c6c-af12-5cff1ad29bda None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:13.711928 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e80e5-9fae-4a7b-99ca-3170c11ca3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:13.712544 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e80e5-9fae-4a7b-99ca-3170c11ca3a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:13.712822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e80e5-9fae-4a7b-99ca-3170c11ca3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:13.713099 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e80e5-9fae-4a7b-99ca-3170c11ca3a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:13.713847 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e80e5-9fae-4a7b-99ca-3170c11ca3a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:13.715830 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e80e5-9fae-4a7b-99ca-3170c11ca3a2 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:13.737324 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1298/2612] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:39:13 2022] POST /identity/v3/users => generated 303 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:39:13.741447 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd06c08-96bc-4fbb-b50d-c02c9c8eb2b4 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:13.752277 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd06c08-96bc-4fbb-b50d-c02c9c8eb2b4 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:13.756831 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ac89f-36ba-416e-8de1-c1d36326ce8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:13.757425 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ac89f-36ba-416e-8de1-c1d36326ce8d admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:13.757697 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ac89f-36ba-416e-8de1-c1d36326ce8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:13.757963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ac89f-36ba-416e-8de1-c1d36326ce8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:13.758594 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ac89f-36ba-416e-8de1-c1d36326ce8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:13.760200 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ac89f-36ba-416e-8de1-c1d36326ce8d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:13.771276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1315/2613] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:39:13.775595 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e80e5-9fae-4a7b-99ca-3170c11ca3a2 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:13.785984 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e80e5-9fae-4a7b-99ca-3170c11ca3a2 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:13.790681 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41245e-9d38-4d13-a27d-81bd1f0b09df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:13.791327 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41245e-9d38-4d13-a27d-81bd1f0b09df admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:13.791677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41245e-9d38-4d13-a27d-81bd1f0b09df admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:13.792088 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41245e-9d38-4d13-a27d-81bd1f0b09df admin admin] PATH_INFO: `/v3/projects/fce82e4c2b894f75b39a55b3ac10ec25/users/5e9a68f9d72b45dba7cbbb3977dbe94c/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:13.807721 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41245e-9d38-4d13-a27d-81bd1f0b09df admin admin] RBAC: Authorizing `identity:create_grant(project_id=fce82e4c2b894f75b39a55b3ac10ec25, user_id=5e9a68f9d72b45dba7cbbb3977dbe94c, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:13.811597 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41245e-9d38-4d13-a27d-81bd1f0b09df admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:13.825979 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1299/2614] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:39:13 2022] PUT /identity/v3/projects/fce82e4c2b894f75b39a55b3ac10ec25/users/5e9a68f9d72b45dba7cbbb3977dbe94c/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:13.830254 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ac89f-36ba-416e-8de1-c1d36326ce8d admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:13.840255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ac89f-36ba-416e-8de1-c1d36326ce8d admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:13.843930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:13.901306 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801b7c7-8fc7-4591-af6f-df4e93b6ea8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:13.902070 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801b7c7-8fc7-4591-af6f-df4e93b6ea8e admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:13.902343 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801b7c7-8fc7-4591-af6f-df4e93b6ea8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:13.902610 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801b7c7-8fc7-4591-af6f-df4e93b6ea8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:13.903250 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801b7c7-8fc7-4591-af6f-df4e93b6ea8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:13.904866 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801b7c7-8fc7-4591-af6f-df4e93b6ea8e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:13.915383 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1316/2615] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:39:13.920023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41245e-9d38-4d13-a27d-81bd1f0b09df admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:13.931001 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41245e-9d38-4d13-a27d-81bd1f0b09df admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:13.936193 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8bd59-b1be-4a4b-b134-d97f728e349a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:13.936845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8bd59-b1be-4a4b-b134-d97f728e349a admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:13.937246 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8bd59-b1be-4a4b-b134-d97f728e349a admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:13.937522 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8bd59-b1be-4a4b-b134-d97f728e349a admin admin] PATH_INFO: `/v3/projects/fce82e4c2b894f75b39a55b3ac10ec25/users/5e9a68f9d72b45dba7cbbb3977dbe94c/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:13.939397 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8bd59-b1be-4a4b-b134-d97f728e349a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fce82e4c2b894f75b39a55b3ac10ec25, user_id=5e9a68f9d72b45dba7cbbb3977dbe94c, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:13.942301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8bd59-b1be-4a4b-b134-d97f728e349a admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:13.954128 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1300/2616] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:39:13 2022] PUT /identity/v3/projects/fce82e4c2b894f75b39a55b3ac10ec25/users/5e9a68f9d72b45dba7cbbb3977dbe94c/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:13.964192 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6145ee2-91a3-4378-8f7a-953c63a01a24 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:13.964696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6145ee2-91a3-4378-8f7a-953c63a01a24 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:13.964966 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6145ee2-91a3-4378-8f7a-953c63a01a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:13.993014 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f6145ee2-91a3-4378-8f7a-953c63a01a24 None None] MFA Rules not processed for user `5e9a68f9d72b45dba7cbbb3977dbe94c`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:13.994201 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f6145ee2-91a3-4378-8f7a-953c63a01a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:14.063692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1317/2617] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:13 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:14.074630 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8bd59-b1be-4a4b-b134-d97f728e349a admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:14.076369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-18b8bd59-b1be-4a4b-b134-d97f728e349a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:14.090846 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:14.145230 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8bd59-b1be-4a4b-b134-d97f728e349a admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:14.148895 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbac580-47c8-4aac-88c9-47998065ff4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:14.149505 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbac580-47c8-4aac-88c9-47998065ff4f service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:14.149786 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbac580-47c8-4aac-88c9-47998065ff4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:14.150059 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbac580-47c8-4aac-88c9-47998065ff4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:14.164909 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbac580-47c8-4aac-88c9-47998065ff4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:14.167099 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbac580-47c8-4aac-88c9-47998065ff4f service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:14.178711 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1301/2618] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:14 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:39:14.228965 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6145ee2-91a3-4378-8f7a-953c63a01a24 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:14.231449 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f6145ee2-91a3-4378-8f7a-953c63a01a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:14.248961 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6145ee2-91a3-4378-8f7a-953c63a01a24 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:14.253032 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf4b21-d166-44dd-b2fd-7df377206cfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:14.253623 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf4b21-d166-44dd-b2fd-7df377206cfc service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:14.253929 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf4b21-d166-44dd-b2fd-7df377206cfc service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:14.254204 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf4b21-d166-44dd-b2fd-7df377206cfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:14.327989 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf4b21-d166-44dd-b2fd-7df377206cfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:14.329427 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf4b21-d166-44dd-b2fd-7df377206cfc service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:14.339306 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1318/2619] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:14 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:39:14.468316 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbac580-47c8-4aac-88c9-47998065ff4f service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:14.469762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-2cbac580-47c8-4aac-88c9-47998065ff4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:14.542767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbac580-47c8-4aac-88c9-47998065ff4f service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:14.547984 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfced77-fa54-4eb7-ac2b-068894410f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:14.548684 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfced77-fa54-4eb7-ac2b-068894410f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:14.549025 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfced77-fa54-4eb7-ac2b-068894410f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:14.549983 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfced77-fa54-4eb7-ac2b-068894410f1a admin admin] PATH_INFO: `/v3/users/d0c3796e5c5140208657ce9a5f9e95b7` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:14.553189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfced77-fa54-4eb7-ac2b-068894410f1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0c3796e5c5140208657ce9a5f9e95b7)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:14.555159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfced77-fa54-4eb7-ac2b-068894410f1a admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:14.634542 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-dcfced77-fa54-4eb7-ac2b-068894410f1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0c3796e5c5140208657ce9a5f9e95b7'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:14.634542 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-dcfced77-fa54-4eb7-ac2b-068894410f1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0c3796e5c5140208657ce9a5f9e95b7'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:14.654576 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-dcfced77-fa54-4eb7-ac2b-068894410f1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0c3796e5c5140208657ce9a5f9e95b7'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:14.670352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-dcfced77-fa54-4eb7-ac2b-068894410f1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0c3796e5c5140208657ce9a5f9e95b7'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:14.684972 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-dcfced77-fa54-4eb7-ac2b-068894410f1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0c3796e5c5140208657ce9a5f9e95b7'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:14.697441 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1302/2620] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:39:14 2022] DELETE /identity/v3/users/d0c3796e5c5140208657ce9a5f9e95b7 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:14.704528 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3966a-54cd-429d-b90e-f22521dbe563 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:14.704827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3966a-54cd-429d-b90e-f22521dbe563 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:14.705147 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3966a-54cd-429d-b90e-f22521dbe563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:14.726443 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-0bc3966a-54cd-429d-b90e-f22521dbe563 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:14.727947 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0bc3966a-54cd-429d-b90e-f22521dbe563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:14.754594 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:14.812983 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1319/2621] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:14.825446 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfced77-fa54-4eb7-ac2b-068894410f1a admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:14.831184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-dcfced77-fa54-4eb7-ac2b-068894410f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:14.872259 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:14.899823 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfced77-fa54-4eb7-ac2b-068894410f1a admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:14.903693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78efe93-111a-49b9-ad55-3d888eb52598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:14.904365 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78efe93-111a-49b9-ad55-3d888eb52598 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:14.904639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78efe93-111a-49b9-ad55-3d888eb52598 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:14.904911 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78efe93-111a-49b9-ad55-3d888eb52598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:14.915017 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78efe93-111a-49b9-ad55-3d888eb52598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:14.917039 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78efe93-111a-49b9-ad55-3d888eb52598 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:14.928421 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1303/2622] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:39:15.252447 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3966a-54cd-429d-b90e-f22521dbe563 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:15.254278 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0bc3966a-54cd-429d-b90e-f22521dbe563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:15.282996 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3966a-54cd-429d-b90e-f22521dbe563 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:15.288671 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985eee32-8490-4112-a075-5c7bea9af889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:15.289632 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985eee32-8490-4112-a075-5c7bea9af889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:15.289976 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985eee32-8490-4112-a075-5c7bea9af889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:15.290168 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985eee32-8490-4112-a075-5c7bea9af889 admin admin] PATH_INFO: `/v3/projects/7c55338ced054e56bc334fc3e34bf741` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:15.291373 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985eee32-8490-4112-a075-5c7bea9af889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c55338ced054e56bc334fc3e34bf741)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:15.294044 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985eee32-8490-4112-a075-5c7bea9af889 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:15.353456 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-985eee32-8490-4112-a075-5c7bea9af889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c55338ced054e56bc334fc3e34bf741', 'request_id': 'req-985eee32-8490-4112-a075-5c7bea9af889'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:15.360259 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-985eee32-8490-4112-a075-5c7bea9af889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c55338ced054e56bc334fc3e34bf741', 'request_id': 'req-985eee32-8490-4112-a075-5c7bea9af889'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:15.371935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-985eee32-8490-4112-a075-5c7bea9af889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c55338ced054e56bc334fc3e34bf741', 'request_id': 'req-985eee32-8490-4112-a075-5c7bea9af889'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:15.386399 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-985eee32-8490-4112-a075-5c7bea9af889 admin admin] The token cache is being invalidate because project 7c55338ced054e56bc334fc3e34bf741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:39:15.386691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-985eee32-8490-4112-a075-5c7bea9af889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:15.388048 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-985eee32-8490-4112-a075-5c7bea9af889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:15.390666 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1320/2623] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:39:15 2022] DELETE /identity/v3/projects/7c55338ced054e56bc334fc3e34bf741 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:15.395607 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abc564-6f76-44a4-a6dc-137ff58fc24b None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:15.396068 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abc564-6f76-44a4-a6dc-137ff58fc24b None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:15.396405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abc564-6f76-44a4-a6dc-137ff58fc24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:15.418558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-62abc564-6f76-44a4-a6dc-137ff58fc24b None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:15.419962 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-62abc564-6f76-44a4-a6dc-137ff58fc24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:15.486644 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1304/2624] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:39:15.496208 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9f487-a61f-48d5-83d2-d2eb29ae8ab6 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:15.496489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9f487-a61f-48d5-83d2-d2eb29ae8ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:15.496752 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9f487-a61f-48d5-83d2-d2eb29ae8ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:15.520024 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-57c9f487-a61f-48d5-83d2-d2eb29ae8ab6 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:15.521268 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-57c9f487-a61f-48d5-83d2-d2eb29ae8ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:15.529973 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1321/2625] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:15.534254 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abc564-6f76-44a4-a6dc-137ff58fc24b None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:15.545563 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abc564-6f76-44a4-a6dc-137ff58fc24b None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:15.551786 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c222ad6-6033-4602-a118-7b73ef7477d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:15.552522 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c222ad6-6033-4602-a118-7b73ef7477d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:15.552870 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c222ad6-6033-4602-a118-7b73ef7477d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:15.553224 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c222ad6-6033-4602-a118-7b73ef7477d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:15.553944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c222ad6-6033-4602-a118-7b73ef7477d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:39:15.554320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c222ad6-6033-4602-a118-7b73ef7477d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:15.556053 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c222ad6-6033-4602-a118-7b73ef7477d9 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:15.569619 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1305/2626] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 14:39:15.574556 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9f487-a61f-48d5-83d2-d2eb29ae8ab6 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:15.585040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9f487-a61f-48d5-83d2-d2eb29ae8ab6 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:15.591348 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fc07a-73ba-4bc0-b996-8f7649700da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:15.592664 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fc07a-73ba-4bc0-b996-8f7649700da3 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:15.592774 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fc07a-73ba-4bc0-b996-8f7649700da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:15.593139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fc07a-73ba-4bc0-b996-8f7649700da3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:15.594232 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fc07a-73ba-4bc0-b996-8f7649700da3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:15.596460 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fc07a-73ba-4bc0-b996-8f7649700da3 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:15.643055 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1322/2627] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:39:15 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:39:15.648812 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c222ad6-6033-4602-a118-7b73ef7477d9 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:15.662066 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c222ad6-6033-4602-a118-7b73ef7477d9 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:15.756436 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9b91f-6ce2-4c97-8183-945b82885392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:15.757773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9b91f-6ce2-4c97-8183-945b82885392 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:15.758082 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9b91f-6ce2-4c97-8183-945b82885392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:15.758361 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9b91f-6ce2-4c97-8183-945b82885392 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:15.762650 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9b91f-6ce2-4c97-8183-945b82885392 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:15.765777 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9b91f-6ce2-4c97-8183-945b82885392 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:15.803677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1306/2628] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:39:15 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:39:15.809668 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fc07a-73ba-4bc0-b996-8f7649700da3 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:15.826599 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fc07a-73ba-4bc0-b996-8f7649700da3 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:15.834421 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44346a2-ccb6-4dce-8c84-a7385ac1acda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:15.835965 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44346a2-ccb6-4dce-8c84-a7385ac1acda admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:15.836454 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44346a2-ccb6-4dce-8c84-a7385ac1acda admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:15.836924 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44346a2-ccb6-4dce-8c84-a7385ac1acda admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:15.837907 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44346a2-ccb6-4dce-8c84-a7385ac1acda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:15.841596 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44346a2-ccb6-4dce-8c84-a7385ac1acda admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:15.859763 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1323/2629] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:39:15.863914 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9b91f-6ce2-4c97-8183-945b82885392 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:15.875823 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9b91f-6ce2-4c97-8183-945b82885392 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:15.880708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44346a2-ccb6-4dce-8c84-a7385ac1acda admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:15.888305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f44346a2-ccb6-4dce-8c84-a7385ac1acda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:15.890389 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3b236-1749-483c-90c4-761f60485469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:15.891212 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3b236-1749-483c-90c4-761f60485469 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:15.891970 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3b236-1749-483c-90c4-761f60485469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:15.892399 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3b236-1749-483c-90c4-761f60485469 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:15.893180 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3b236-1749-483c-90c4-761f60485469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:15.895787 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3b236-1749-483c-90c4-761f60485469 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:15.910319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1307/2630] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:39:15.914641 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3b236-1749-483c-90c4-761f60485469 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:15.935485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3b236-1749-483c-90c4-761f60485469 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:15.941308 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933170a-8a30-4ba9-8f27-6a46a5b048ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:15.942256 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933170a-8a30-4ba9-8f27-6a46a5b048ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:15.942531 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933170a-8a30-4ba9-8f27-6a46a5b048ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:15.942800 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933170a-8a30-4ba9-8f27-6a46a5b048ce admin admin] PATH_INFO: `/v3/projects/dc0bcfed7d1e49a9bf6ddee938ec7dec/users/05f4de0e8b97416a9a7522e9070250d4/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:15.965688 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933170a-8a30-4ba9-8f27-6a46a5b048ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc0bcfed7d1e49a9bf6ddee938ec7dec, user_id=05f4de0e8b97416a9a7522e9070250d4, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:15.968710 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933170a-8a30-4ba9-8f27-6a46a5b048ce admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:15.969632 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44346a2-ccb6-4dce-8c84-a7385ac1acda admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:15.976371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cb56f-6e54-4b7d-a6b7-f750115618cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:15.977498 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cb56f-6e54-4b7d-a6b7-f750115618cb service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:15.978135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cb56f-6e54-4b7d-a6b7-f750115618cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:15.978609 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cb56f-6e54-4b7d-a6b7-f750115618cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:15.983774 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-255cb56f-6e54-4b7d-a6b7-f750115618cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:15.988089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1308/2631] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:39:15 2022] PUT /identity/v3/projects/dc0bcfed7d1e49a9bf6ddee938ec7dec/users/05f4de0e8b97416a9a7522e9070250d4/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:15.998533 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d370ef-984e-4509-9183-f0d283e9e6dc None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:15.998769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d370ef-984e-4509-9183-f0d283e9e6dc None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:15.998897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cb56f-6e54-4b7d-a6b7-f750115618cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:15.998990 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d370ef-984e-4509-9183-f0d283e9e6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:16.000401 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cb56f-6e54-4b7d-a6b7-f750115618cb service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:16.012926 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1324/2632] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:39:16.038823 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-06d370ef-984e-4509-9183-f0d283e9e6dc None None] MFA Rules not processed for user `05f4de0e8b97416a9a7522e9070250d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:16.041087 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-06d370ef-984e-4509-9183-f0d283e9e6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:16.049115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:16.124704 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1309/2633] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:39:16.137792 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cb56f-6e54-4b7d-a6b7-f750115618cb service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:16.139273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-255cb56f-6e54-4b7d-a6b7-f750115618cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:16.154437 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:16.200996 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cb56f-6e54-4b7d-a6b7-f750115618cb service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:16.254053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c3807-703b-4ba5-bad5-551d07a08f82 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '289b020c9cd242dca9b512803199daae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:16.254809 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c3807-703b-4ba5-bad5-551d07a08f82 service glance] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:16.254946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c3807-703b-4ba5-bad5-551d07a08f82 service glance] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:16.255199 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c3807-703b-4ba5-bad5-551d07a08f82 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:16.266340 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c3807-703b-4ba5-bad5-551d07a08f82 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:16.268199 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c3807-703b-4ba5-bad5-551d07a08f82 service glance] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:16.279098 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1325/2634] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:39:17.167787 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971da28f-420a-4b5d-a9cf-950c42350454 None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:17.168847 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971da28f-420a-4b5d-a9cf-950c42350454 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:17.169011 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971da28f-420a-4b5d-a9cf-950c42350454 None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:17.170399 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1310/2635] 10.222.0.62 () {54 vars in 921 bytes} [Tue Oct 4 14:39:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:39:17.179189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545aded2-0e14-45a5-ad88-4be523763b1a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:17.180045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545aded2-0e14-45a5-ad88-4be523763b1a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:17.181071 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545aded2-0e14-45a5-ad88-4be523763b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:17.248167 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-545aded2-0e14-45a5-ad88-4be523763b1a None None] MFA Rules not processed for user `151e7b9c7a7b46d58dc2f563d05775e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:17.250179 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-545aded2-0e14-45a5-ad88-4be523763b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:17.369597 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1326/2636] 10.222.0.62 () {58 vars in 1018 bytes} [Tue Oct 4 14:39:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:17.382083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971da28f-420a-4b5d-a9cf-950c42350454 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:17.383870 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-971da28f-420a-4b5d-a9cf-950c42350454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:17.398026 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971da28f-420a-4b5d-a9cf-950c42350454 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:17.401558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed107a-321a-43d0-bc2f-56e64772b6fd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '289b020c9cd242dca9b512803199daae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:17.402154 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed107a-321a-43d0-bc2f-56e64772b6fd service glance] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:17.402580 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed107a-321a-43d0-bc2f-56e64772b6fd service glance] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:17.402850 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed107a-321a-43d0-bc2f-56e64772b6fd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:17.413242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed107a-321a-43d0-bc2f-56e64772b6fd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:17.414651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed107a-321a-43d0-bc2f-56e64772b6fd service glance] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:17.427986 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1311/2637] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:39:17.506729 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097d94a-c7f6-4bc5-bf32-8efbb5bbece9 None None] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:17.506927 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097d94a-c7f6-4bc5-bf32-8efbb5bbece9 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:17.507214 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097d94a-c7f6-4bc5-bf32-8efbb5bbece9 None None] PATH_INFO: `/` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:17.508584 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1327/2638] 10.222.0.62 () {54 vars in 921 bytes} [Tue Oct 4 14:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 14:39:17.514921 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d974e1-6375-498f-8edf-7e9196e4c25a None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:17.515267 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d974e1-6375-498f-8edf-7e9196e4c25a None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:17.515587 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d974e1-6375-498f-8edf-7e9196e4c25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:17.536799 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-a3d974e1-6375-498f-8edf-7e9196e4c25a None None] MFA Rules not processed for user `624487005e4f4180a9d56a29a7daad1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:17.538003 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a3d974e1-6375-498f-8edf-7e9196e4c25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:17.591069 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1312/2639] 10.222.0.62 () {58 vars in 1018 bytes} [Tue Oct 4 14:39:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:17.602913 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097d94a-c7f6-4bc5-bf32-8efbb5bbece9 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:17.604721 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0097d94a-c7f6-4bc5-bf32-8efbb5bbece9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:17.618391 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097d94a-c7f6-4bc5-bf32-8efbb5bbece9 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:17.622626 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6e1a7-614f-457d-9612-1df83195affb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:17.623228 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6e1a7-614f-457d-9612-1df83195affb service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:17.623504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6e1a7-614f-457d-9612-1df83195affb service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:17.623799 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6e1a7-614f-457d-9612-1df83195affb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:17.630819 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6e1a7-614f-457d-9612-1df83195affb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:17.632276 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6e1a7-614f-457d-9612-1df83195affb service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:17.641102 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1328/2640] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:39:17.994901 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d974e1-6375-498f-8edf-7e9196e4c25a None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:17.996589 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a3d974e1-6375-498f-8edf-7e9196e4c25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:18.061350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d974e1-6375-498f-8edf-7e9196e4c25a None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:18.065769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de7b1a-4008-4733-a265-2b93b56a1709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:18.066401 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de7b1a-4008-4733-a265-2b93b56a1709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:18.066931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de7b1a-4008-4733-a265-2b93b56a1709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:18.067199 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de7b1a-4008-4733-a265-2b93b56a1709 admin admin] PATH_INFO: `/v3/users/0e6dd4ab671543d99b4cfd8f5bc05b15` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:18.068344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de7b1a-4008-4733-a265-2b93b56a1709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e6dd4ab671543d99b4cfd8f5bc05b15)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:18.070239 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de7b1a-4008-4733-a265-2b93b56a1709 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:18.118342 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:18.120477 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c0de7b1a-4008-4733-a265-2b93b56a1709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e6dd4ab671543d99b4cfd8f5bc05b15'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:18.121991 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c0de7b1a-4008-4733-a265-2b93b56a1709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e6dd4ab671543d99b4cfd8f5bc05b15'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:18.137873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c0de7b1a-4008-4733-a265-2b93b56a1709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e6dd4ab671543d99b4cfd8f5bc05b15'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:18.145581 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c0de7b1a-4008-4733-a265-2b93b56a1709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e6dd4ab671543d99b4cfd8f5bc05b15'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:18.152426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-c0de7b1a-4008-4733-a265-2b93b56a1709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e6dd4ab671543d99b4cfd8f5bc05b15'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:18.158225 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1313/2641] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:39:17 2022] DELETE /identity/v3/users/0e6dd4ab671543d99b4cfd8f5bc05b15 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:18.162589 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06cc79-f722-4f8c-98d5-748a6b4ff517 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:18.162873 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06cc79-f722-4f8c-98d5-748a6b4ff517 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:18.163138 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06cc79-f722-4f8c-98d5-748a6b4ff517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:18.181692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-df06cc79-f722-4f8c-98d5-748a6b4ff517 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:18.182893 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-df06cc79-f722-4f8c-98d5-748a6b4ff517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:18.208854 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:18.242264 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1329/2642] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:18.253021 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de7b1a-4008-4733-a265-2b93b56a1709 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:18.254460 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-c0de7b1a-4008-4733-a265-2b93b56a1709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:18.327465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de7b1a-4008-4733-a265-2b93b56a1709 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:18.334702 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f508da1-43ff-4932-ac5f-be215710659c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:18.335606 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f508da1-43ff-4932-ac5f-be215710659c service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:18.335935 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f508da1-43ff-4932-ac5f-be215710659c service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:18.336318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f508da1-43ff-4932-ac5f-be215710659c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:18.348376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f508da1-43ff-4932-ac5f-be215710659c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:18.350120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f508da1-43ff-4932-ac5f-be215710659c service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:18.362238 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1314/2643] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:39:18.741125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06cc79-f722-4f8c-98d5-748a6b4ff517 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:18.743109 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-df06cc79-f722-4f8c-98d5-748a6b4ff517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:18.750599 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf905e-e34b-434d-b853-fef0f6dcde4d None None] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:18.751080 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf905e-e34b-434d-b853-fef0f6dcde4d None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:18.751451 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf905e-e34b-434d-b853-fef0f6dcde4d None None] PATH_INFO: `/` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:18.753023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1315/2644] 10.222.0.62 () {54 vars in 921 bytes} [Tue Oct 4 14:39:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 14:39:18.758863 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a4f04-d031-4d90-85ca-555a748e5bb5 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:18.759149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a4f04-d031-4d90-85ca-555a748e5bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:18.759600 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a4f04-d031-4d90-85ca-555a748e5bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:18.763622 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06cc79-f722-4f8c-98d5-748a6b4ff517 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:18.771813 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfdc75-edff-4752-a7d8-252017f21619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:18.772611 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfdc75-edff-4752-a7d8-252017f21619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:18.773006 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfdc75-edff-4752-a7d8-252017f21619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:18.773341 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfdc75-edff-4752-a7d8-252017f21619 admin admin] PATH_INFO: `/v3/projects/7e210531841e4566b55d3c07cdec1317` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:18.774680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfdc75-edff-4752-a7d8-252017f21619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e210531841e4566b55d3c07cdec1317)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:18.776655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfdc75-edff-4752-a7d8-252017f21619 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:18.780971 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-637a4f04-d031-4d90-85ca-555a748e5bb5 None None] MFA Rules not processed for user `151e7b9c7a7b46d58dc2f563d05775e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:18.782263 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-637a4f04-d031-4d90-85ca-555a748e5bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:18.839677 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c9dfdc75-edff-4752-a7d8-252017f21619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e210531841e4566b55d3c07cdec1317', 'request_id': 'req-c9dfdc75-edff-4752-a7d8-252017f21619'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:18.846749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c9dfdc75-edff-4752-a7d8-252017f21619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e210531841e4566b55d3c07cdec1317', 'request_id': 'req-c9dfdc75-edff-4752-a7d8-252017f21619'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:18.853235 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c9dfdc75-edff-4752-a7d8-252017f21619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e210531841e4566b55d3c07cdec1317', 'request_id': 'req-c9dfdc75-edff-4752-a7d8-252017f21619'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:18.867301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c9dfdc75-edff-4752-a7d8-252017f21619 admin admin] The token cache is being invalidate because project 7e210531841e4566b55d3c07cdec1317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:39:18.867589 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c9dfdc75-edff-4752-a7d8-252017f21619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:18.868248 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c9dfdc75-edff-4752-a7d8-252017f21619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:18.869801 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1330/2645] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:39:18 2022] DELETE /identity/v3/projects/7e210531841e4566b55d3c07cdec1317 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:39:18.870255 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1316/2646] 10.222.0.62 () {58 vars in 1018 bytes} [Tue Oct 4 14:39:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:39:18.874770 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfdc75-edff-4752-a7d8-252017f21619 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:18.876242 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c9dfdc75-edff-4752-a7d8-252017f21619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:18.882023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a4f04-d031-4d90-85ca-555a748e5bb5 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:18.883740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-637a4f04-d031-4d90-85ca-555a748e5bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:18.896070 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a4f04-d031-4d90-85ca-555a748e5bb5 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:18.947454 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d295772-5288-4120-b812-a74030a777bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:18.948083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d295772-5288-4120-b812-a74030a777bd service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:18.948364 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d295772-5288-4120-b812-a74030a777bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:18.948634 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d295772-5288-4120-b812-a74030a777bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:18.950897 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-0d295772-5288-4120-b812-a74030a777bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:18.960724 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:18.964652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfdc75-edff-4752-a7d8-252017f21619 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:18.972453 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d6ae0-2c2a-47de-b6a4-975a21997fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:18.973182 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d6ae0-2c2a-47de-b6a4-975a21997fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:18.973462 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d6ae0-2c2a-47de-b6a4-975a21997fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:18.973751 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d6ae0-2c2a-47de-b6a4-975a21997fc8 admin admin] PATH_INFO: `/v3/users/5e9a68f9d72b45dba7cbbb3977dbe94c` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:18.975087 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d6ae0-2c2a-47de-b6a4-975a21997fc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e9a68f9d72b45dba7cbbb3977dbe94c)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:18.977216 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d6ae0-2c2a-47de-b6a4-975a21997fc8 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:19.034213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a78d6ae0-2c2a-47de-b6a4-975a21997fc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e9a68f9d72b45dba7cbbb3977dbe94c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:19.034938 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a78d6ae0-2c2a-47de-b6a4-975a21997fc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e9a68f9d72b45dba7cbbb3977dbe94c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:19.038212 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d295772-5288-4120-b812-a74030a777bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:19.041375 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d295772-5288-4120-b812-a74030a777bd service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:19.046478 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a78d6ae0-2c2a-47de-b6a4-975a21997fc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e9a68f9d72b45dba7cbbb3977dbe94c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:19.049046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:19.056450 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1317/2647] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:39:19.064768 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a78d6ae0-2c2a-47de-b6a4-975a21997fc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e9a68f9d72b45dba7cbbb3977dbe94c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:19.071988 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-a78d6ae0-2c2a-47de-b6a4-975a21997fc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e9a68f9d72b45dba7cbbb3977dbe94c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:19.079167 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1331/2648] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:39:18 2022] DELETE /identity/v3/users/5e9a68f9d72b45dba7cbbb3977dbe94c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:19.380704 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d295772-5288-4120-b812-a74030a777bd service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:19.392639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d295772-5288-4120-b812-a74030a777bd service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:19.462158 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d228be-3f70-41a3-88a4-e13ee534de65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:19.462789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d228be-3f70-41a3-88a4-e13ee534de65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:19.463071 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d228be-3f70-41a3-88a4-e13ee534de65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:19.463346 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d228be-3f70-41a3-88a4-e13ee534de65 admin admin] PATH_INFO: `/v3/projects/fce82e4c2b894f75b39a55b3ac10ec25` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:19.464484 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d228be-3f70-41a3-88a4-e13ee534de65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fce82e4c2b894f75b39a55b3ac10ec25)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:19.466640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d228be-3f70-41a3-88a4-e13ee534de65 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:19.515588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-d0d228be-3f70-41a3-88a4-e13ee534de65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fce82e4c2b894f75b39a55b3ac10ec25', 'request_id': 'req-d0d228be-3f70-41a3-88a4-e13ee534de65'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:19.522263 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-d0d228be-3f70-41a3-88a4-e13ee534de65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fce82e4c2b894f75b39a55b3ac10ec25', 'request_id': 'req-d0d228be-3f70-41a3-88a4-e13ee534de65'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:19.533774 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-d0d228be-3f70-41a3-88a4-e13ee534de65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fce82e4c2b894f75b39a55b3ac10ec25', 'request_id': 'req-d0d228be-3f70-41a3-88a4-e13ee534de65'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:19.547264 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-d0d228be-3f70-41a3-88a4-e13ee534de65 admin admin] The token cache is being invalidate because project fce82e4c2b894f75b39a55b3ac10ec25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:39:19.547567 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-d0d228be-3f70-41a3-88a4-e13ee534de65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:19.549182 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-d0d228be-3f70-41a3-88a4-e13ee534de65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:19.549938 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1318/2649] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:39:19 2022] DELETE /identity/v3/projects/fce82e4c2b894f75b39a55b3ac10ec25 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:19.557847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc491e23-8c32-478a-a068-068292f4e3a9 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:19.557847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc491e23-8c32-478a-a068-068292f4e3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:19.557847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc491e23-8c32-478a-a068-068292f4e3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:19.577169 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-bc491e23-8c32-478a-a068-068292f4e3a9 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:19.578376 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bc491e23-8c32-478a-a068-068292f4e3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:19.650486 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1332/2650] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:39:19.659575 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43befd8-e70e-4a81-b239-8289d68c9c49 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:19.660039 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43befd8-e70e-4a81-b239-8289d68c9c49 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:19.661000 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43befd8-e70e-4a81-b239-8289d68c9c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:19.682728 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-f43befd8-e70e-4a81-b239-8289d68c9c49 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:19.684066 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f43befd8-e70e-4a81-b239-8289d68c9c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:19.697438 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1319/2651] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:19.702790 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc491e23-8c32-478a-a068-068292f4e3a9 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:19.719028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc491e23-8c32-478a-a068-068292f4e3a9 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:19.724161 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ee494-3f8e-4bc2-bad0-290d3d86e85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:19.724938 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ee494-3f8e-4bc2-bad0-290d3d86e85e admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:19.725222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ee494-3f8e-4bc2-bad0-290d3d86e85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:19.725492 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ee494-3f8e-4bc2-bad0-290d3d86e85e admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:19.726142 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ee494-3f8e-4bc2-bad0-290d3d86e85e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:39:19.726435 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ee494-3f8e-4bc2-bad0-290d3d86e85e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:19.728071 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ee494-3f8e-4bc2-bad0-290d3d86e85e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:19.741471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1333/2652] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:39:19.745760 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43befd8-e70e-4a81-b239-8289d68c9c49 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:19.755677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43befd8-e70e-4a81-b239-8289d68c9c49 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:19.760612 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de591ec8-071c-4587-9d5f-6c04f5a49108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:19.761319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de591ec8-071c-4587-9d5f-6c04f5a49108 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:19.761713 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de591ec8-071c-4587-9d5f-6c04f5a49108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:19.762048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de591ec8-071c-4587-9d5f-6c04f5a49108 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:19.763106 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de591ec8-071c-4587-9d5f-6c04f5a49108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:19.765319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de591ec8-071c-4587-9d5f-6c04f5a49108 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:19.788837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:19.797070 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1320/2653] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:39:19 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:39:19.801586 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ee494-3f8e-4bc2-bad0-290d3d86e85e admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:19.814877 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ee494-3f8e-4bc2-bad0-290d3d86e85e admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:19.878042 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67031db-9b49-43aa-afd5-9d0c94771144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:19.878559 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67031db-9b49-43aa-afd5-9d0c94771144 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:19.878837 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67031db-9b49-43aa-afd5-9d0c94771144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:19.879108 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67031db-9b49-43aa-afd5-9d0c94771144 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:19.879760 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67031db-9b49-43aa-afd5-9d0c94771144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:19.881656 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67031db-9b49-43aa-afd5-9d0c94771144 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:19.905031 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1334/2654] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:39:19 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:39:19.909516 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de591ec8-071c-4587-9d5f-6c04f5a49108 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:19.920997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de591ec8-071c-4587-9d5f-6c04f5a49108 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:19.925749 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c144b-1902-4b86-8b15-e39fa563428a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:19.926347 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c144b-1902-4b86-8b15-e39fa563428a admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:19.926625 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c144b-1902-4b86-8b15-e39fa563428a admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:19.926902 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c144b-1902-4b86-8b15-e39fa563428a admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:19.927538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c144b-1902-4b86-8b15-e39fa563428a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:19.929171 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c144b-1902-4b86-8b15-e39fa563428a admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:19.939380 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1321/2655] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:39:19.943824 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67031db-9b49-43aa-afd5-9d0c94771144 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:19.954032 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67031db-9b49-43aa-afd5-9d0c94771144 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:19.958661 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027a249-ac74-45ba-a47c-cd6a951c33e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:19.959267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027a249-ac74-45ba-a47c-cd6a951c33e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:19.959545 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027a249-ac74-45ba-a47c-cd6a951c33e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:19.959847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027a249-ac74-45ba-a47c-cd6a951c33e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:19.960522 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027a249-ac74-45ba-a47c-cd6a951c33e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:19.962092 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027a249-ac74-45ba-a47c-cd6a951c33e1 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:19.973663 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1335/2656] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:39:19.977961 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c144b-1902-4b86-8b15-e39fa563428a admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:19.989562 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c144b-1902-4b86-8b15-e39fa563428a admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:19.996029 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be943e1-4df8-43a8-a19a-d2567bcd4de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:19.996029 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be943e1-4df8-43a8-a19a-d2567bcd4de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:19.996029 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be943e1-4df8-43a8-a19a-d2567bcd4de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:19.996029 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be943e1-4df8-43a8-a19a-d2567bcd4de1 admin admin] PATH_INFO: `/v3/projects/c4db1a2c015e47a2ae5a9854c2eba575/users/d79537d5674a42c68cf7abdbe99fde04/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:20.010614 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be943e1-4df8-43a8-a19a-d2567bcd4de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4db1a2c015e47a2ae5a9854c2eba575, user_id=d79537d5674a42c68cf7abdbe99fde04, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:20.014143 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be943e1-4df8-43a8-a19a-d2567bcd4de1 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:20.027111 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1322/2657] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:39:19 2022] PUT /identity/v3/projects/c4db1a2c015e47a2ae5a9854c2eba575/users/d79537d5674a42c68cf7abdbe99fde04/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:39:20.039451 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207f3e3-301d-4357-9583-c5ec3184717d None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:20.039766 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207f3e3-301d-4357-9583-c5ec3184717d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:20.040042 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207f3e3-301d-4357-9583-c5ec3184717d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:20.072418 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-7207f3e3-301d-4357-9583-c5ec3184717d None None] MFA Rules not processed for user `d79537d5674a42c68cf7abdbe99fde04`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:20.073767 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7207f3e3-301d-4357-9583-c5ec3184717d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:20.109894 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:20.148724 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1336/2658] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:20.153762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be943e1-4df8-43a8-a19a-d2567bcd4de1 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:20.216410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be943e1-4df8-43a8-a19a-d2567bcd4de1 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:20.221980 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc504a17-986b-4ce4-949b-a7615d5180c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:20.222583 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc504a17-986b-4ce4-949b-a7615d5180c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:20.222865 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc504a17-986b-4ce4-949b-a7615d5180c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:20.223139 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc504a17-986b-4ce4-949b-a7615d5180c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:20.223799 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc504a17-986b-4ce4-949b-a7615d5180c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:20.225691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc504a17-986b-4ce4-949b-a7615d5180c8 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:20.254009 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1323/2659] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:39:20 2022] POST /identity/v3/projects => generated 389 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:39:20.257619 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207f3e3-301d-4357-9583-c5ec3184717d None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:20.268848 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207f3e3-301d-4357-9583-c5ec3184717d None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:20.327125 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120bcb8-eb3b-4890-834b-cb2beb8eb848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:20.327818 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120bcb8-eb3b-4890-834b-cb2beb8eb848 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:20.328118 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120bcb8-eb3b-4890-834b-cb2beb8eb848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:20.328370 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120bcb8-eb3b-4890-834b-cb2beb8eb848 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:20.329022 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120bcb8-eb3b-4890-834b-cb2beb8eb848 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:20.331019 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120bcb8-eb3b-4890-834b-cb2beb8eb848 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:20.356306 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1337/2660] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:39:20 2022] POST /identity/v3/users => generated 301 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:39:20.360275 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc504a17-986b-4ce4-949b-a7615d5180c8 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:20.370680 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc504a17-986b-4ce4-949b-a7615d5180c8 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:20.375506 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae606b6-89b1-45ff-adb3-e4426e8fcbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:20.376135 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae606b6-89b1-45ff-adb3-e4426e8fcbfe admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:20.376431 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae606b6-89b1-45ff-adb3-e4426e8fcbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:20.376691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae606b6-89b1-45ff-adb3-e4426e8fcbfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:20.377328 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae606b6-89b1-45ff-adb3-e4426e8fcbfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:20.378950 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae606b6-89b1-45ff-adb3-e4426e8fcbfe admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:20.389491 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1324/2661] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:39:20.393701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120bcb8-eb3b-4890-834b-cb2beb8eb848 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:20.404302 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120bcb8-eb3b-4890-834b-cb2beb8eb848 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:20.408711 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d52cb-5f9b-4d74-a0f7-6e717cf81e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:20.409355 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d52cb-5f9b-4d74-a0f7-6e717cf81e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:20.409764 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d52cb-5f9b-4d74-a0f7-6e717cf81e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:20.410038 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d52cb-5f9b-4d74-a0f7-6e717cf81e8a admin admin] PATH_INFO: `/v3/projects/4e753fea116b4d25851de59fbdac42e9/users/6025197d3cb54651be64d426b318d64c/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:20.425253 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d52cb-5f9b-4d74-a0f7-6e717cf81e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e753fea116b4d25851de59fbdac42e9, user_id=6025197d3cb54651be64d426b318d64c, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:20.427897 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d52cb-5f9b-4d74-a0f7-6e717cf81e8a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:20.440255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1338/2662] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:39:20 2022] PUT /identity/v3/projects/4e753fea116b4d25851de59fbdac42e9/users/6025197d3cb54651be64d426b318d64c/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:20.444627 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae606b6-89b1-45ff-adb3-e4426e8fcbfe admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:20.455012 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae606b6-89b1-45ff-adb3-e4426e8fcbfe admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:20.513122 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d5e68-bd83-4021-b1ff-8efce052cff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:20.513758 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d5e68-bd83-4021-b1ff-8efce052cff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:20.514032 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d5e68-bd83-4021-b1ff-8efce052cff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:20.514296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d5e68-bd83-4021-b1ff-8efce052cff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:20.514928 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d5e68-bd83-4021-b1ff-8efce052cff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:20.516540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d5e68-bd83-4021-b1ff-8efce052cff5 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:20.528573 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1325/2663] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:39:20.531294 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d52cb-5f9b-4d74-a0f7-6e717cf81e8a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:20.541308 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d52cb-5f9b-4d74-a0f7-6e717cf81e8a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:20.549305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adedb1-9138-4abe-bca7-fe22564c31b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:20.550369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adedb1-9138-4abe-bca7-fe22564c31b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:20.550484 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adedb1-9138-4abe-bca7-fe22564c31b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:20.550939 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adedb1-9138-4abe-bca7-fe22564c31b4 admin admin] PATH_INFO: `/v3/projects/4e753fea116b4d25851de59fbdac42e9/users/6025197d3cb54651be64d426b318d64c/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:20.553375 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adedb1-9138-4abe-bca7-fe22564c31b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e753fea116b4d25851de59fbdac42e9, user_id=6025197d3cb54651be64d426b318d64c, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:20.556174 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adedb1-9138-4abe-bca7-fe22564c31b4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:20.567490 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1339/2664] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:39:20 2022] PUT /identity/v3/projects/4e753fea116b4d25851de59fbdac42e9/users/6025197d3cb54651be64d426b318d64c/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:20.578652 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da62a6-b763-4455-83a2-0457b74312cd None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:20.578975 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da62a6-b763-4455-83a2-0457b74312cd None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:20.579219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da62a6-b763-4455-83a2-0457b74312cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:20.612742 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-e1da62a6-b763-4455-83a2-0457b74312cd None None] MFA Rules not processed for user `6025197d3cb54651be64d426b318d64c`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:20.614028 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e1da62a6-b763-4455-83a2-0457b74312cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:20.637730 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:20.691273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1326/2665] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:20 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:20.702532 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adedb1-9138-4abe-bca7-fe22564c31b4 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:20.704271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-62adedb1-9138-4abe-bca7-fe22564c31b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:20.763448 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adedb1-9138-4abe-bca7-fe22564c31b4 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:20.767214 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26dc505-953d-47b2-8471-8a18727bd441 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:20.767858 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26dc505-953d-47b2-8471-8a18727bd441 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:20.768138 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26dc505-953d-47b2-8471-8a18727bd441 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:20.768411 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26dc505-953d-47b2-8471-8a18727bd441 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:20.778894 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26dc505-953d-47b2-8471-8a18727bd441 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:20.780368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26dc505-953d-47b2-8471-8a18727bd441 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:20.791348 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1340/2666] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:20 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:39:20.944084 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da62a6-b763-4455-83a2-0457b74312cd None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:21.014104 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da62a6-b763-4455-83a2-0457b74312cd None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:21.018692 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36187bc1-40b7-4e1c-bdd7-9a45455d1fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:21.019326 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36187bc1-40b7-4e1c-bdd7-9a45455d1fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:21.019614 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36187bc1-40b7-4e1c-bdd7-9a45455d1fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:21.019908 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36187bc1-40b7-4e1c-bdd7-9a45455d1fcb admin admin] PATH_INFO: `/v3/users/d79537d5674a42c68cf7abdbe99fde04` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:21.021031 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36187bc1-40b7-4e1c-bdd7-9a45455d1fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d79537d5674a42c68cf7abdbe99fde04)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:21.022931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36187bc1-40b7-4e1c-bdd7-9a45455d1fcb admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:21.073953 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-36187bc1-40b7-4e1c-bdd7-9a45455d1fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd79537d5674a42c68cf7abdbe99fde04'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:21.075808 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-36187bc1-40b7-4e1c-bdd7-9a45455d1fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd79537d5674a42c68cf7abdbe99fde04'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:21.092242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-36187bc1-40b7-4e1c-bdd7-9a45455d1fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd79537d5674a42c68cf7abdbe99fde04'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:21.102056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-36187bc1-40b7-4e1c-bdd7-9a45455d1fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd79537d5674a42c68cf7abdbe99fde04'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:21.110532 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-36187bc1-40b7-4e1c-bdd7-9a45455d1fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd79537d5674a42c68cf7abdbe99fde04'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:21.116999 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1327/2667] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:39:20 2022] DELETE /identity/v3/users/d79537d5674a42c68cf7abdbe99fde04 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:21.122265 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95f963-18d3-439c-9702-7918768a394b None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:21.122554 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95f963-18d3-439c-9702-7918768a394b None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:21.122820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95f963-18d3-439c-9702-7918768a394b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:21.142083 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-5a95f963-18d3-439c-9702-7918768a394b None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:21.143275 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5a95f963-18d3-439c-9702-7918768a394b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:21.163041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:21.206025 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1341/2668] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:21.217037 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36187bc1-40b7-4e1c-bdd7-9a45455d1fcb admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:21.218648 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-36187bc1-40b7-4e1c-bdd7-9a45455d1fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:21.263585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:21.280206 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36187bc1-40b7-4e1c-bdd7-9a45455d1fcb admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:21.283829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb850d5-6796-45ed-a840-6f4798c74419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:21.284430 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb850d5-6796-45ed-a840-6f4798c74419 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:21.284730 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb850d5-6796-45ed-a840-6f4798c74419 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:21.284999 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb850d5-6796-45ed-a840-6f4798c74419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:21.294880 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb850d5-6796-45ed-a840-6f4798c74419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:21.296376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb850d5-6796-45ed-a840-6f4798c74419 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:21.306081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1328/2669] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:39:21.588267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95f963-18d3-439c-9702-7918768a394b None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:21.589850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5a95f963-18d3-439c-9702-7918768a394b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:21.602586 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95f963-18d3-439c-9702-7918768a394b None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:21.608702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742c648-0216-4443-bdfe-c084bac41363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:21.609462 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742c648-0216-4443-bdfe-c084bac41363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:21.609734 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742c648-0216-4443-bdfe-c084bac41363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:21.610005 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742c648-0216-4443-bdfe-c084bac41363 admin admin] PATH_INFO: `/v3/projects/c4db1a2c015e47a2ae5a9854c2eba575` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:21.612060 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742c648-0216-4443-bdfe-c084bac41363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4db1a2c015e47a2ae5a9854c2eba575)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:21.613966 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742c648-0216-4443-bdfe-c084bac41363 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:21.678170 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c742c648-0216-4443-bdfe-c084bac41363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4db1a2c015e47a2ae5a9854c2eba575', 'request_id': 'req-c742c648-0216-4443-bdfe-c084bac41363'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:21.684775 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c742c648-0216-4443-bdfe-c084bac41363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4db1a2c015e47a2ae5a9854c2eba575', 'request_id': 'req-c742c648-0216-4443-bdfe-c084bac41363'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:21.691095 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c742c648-0216-4443-bdfe-c084bac41363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4db1a2c015e47a2ae5a9854c2eba575', 'request_id': 'req-c742c648-0216-4443-bdfe-c084bac41363'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:21.706902 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c742c648-0216-4443-bdfe-c084bac41363 admin admin] The token cache is being invalidate because project c4db1a2c015e47a2ae5a9854c2eba575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:39:21.707226 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c742c648-0216-4443-bdfe-c084bac41363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:21.707886 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c742c648-0216-4443-bdfe-c084bac41363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:21.709365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1342/2670] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:39:21 2022] DELETE /identity/v3/projects/c4db1a2c015e47a2ae5a9854c2eba575 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:39:21.713549 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb850d5-6796-45ed-a840-6f4798c74419 service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:21.723472 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb850d5-6796-45ed-a840-6f4798c74419 service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:21.779800 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299292b4-8a62-4e15-8f8e-1934b0fad8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:21.780433 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299292b4-8a62-4e15-8f8e-1934b0fad8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:21.780711 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299292b4-8a62-4e15-8f8e-1934b0fad8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:21.780982 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299292b4-8a62-4e15-8f8e-1934b0fad8a2 admin admin] PATH_INFO: `/v3/users/6025197d3cb54651be64d426b318d64c` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:21.782105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299292b4-8a62-4e15-8f8e-1934b0fad8a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6025197d3cb54651be64d426b318d64c)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:21.784045 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299292b4-8a62-4e15-8f8e-1934b0fad8a2 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:21.831360 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-299292b4-8a62-4e15-8f8e-1934b0fad8a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6025197d3cb54651be64d426b318d64c'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:21.832035 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-299292b4-8a62-4e15-8f8e-1934b0fad8a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6025197d3cb54651be64d426b318d64c'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:21.844377 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-299292b4-8a62-4e15-8f8e-1934b0fad8a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6025197d3cb54651be64d426b318d64c'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:21.852276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-299292b4-8a62-4e15-8f8e-1934b0fad8a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6025197d3cb54651be64d426b318d64c'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:21.861504 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-299292b4-8a62-4e15-8f8e-1934b0fad8a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6025197d3cb54651be64d426b318d64c'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:21.868900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1329/2671] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:39:21 2022] DELETE /identity/v3/users/6025197d3cb54651be64d426b318d64c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:22.203210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742c648-0216-4443-bdfe-c084bac41363 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:22.204710 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c742c648-0216-4443-bdfe-c084bac41363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:22.220596 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742c648-0216-4443-bdfe-c084bac41363 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:22.284344 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8a991-3cf1-4f61-bd37-43041e993b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:22.284978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8a991-3cf1-4f61-bd37-43041e993b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:22.285255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8a991-3cf1-4f61-bd37-43041e993b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:22.285640 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8a991-3cf1-4f61-bd37-43041e993b10 admin admin] PATH_INFO: `/v3/projects/4e753fea116b4d25851de59fbdac42e9` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:22.286789 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8a991-3cf1-4f61-bd37-43041e993b10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e753fea116b4d25851de59fbdac42e9)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:22.288730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8a991-3cf1-4f61-bd37-43041e993b10 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:22.335811 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-62e8a991-3cf1-4f61-bd37-43041e993b10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e753fea116b4d25851de59fbdac42e9', 'request_id': 'req-62e8a991-3cf1-4f61-bd37-43041e993b10'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:22.336962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:22.343762 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-62e8a991-3cf1-4f61-bd37-43041e993b10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e753fea116b4d25851de59fbdac42e9', 'request_id': 'req-62e8a991-3cf1-4f61-bd37-43041e993b10'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:22.350549 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-62e8a991-3cf1-4f61-bd37-43041e993b10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e753fea116b4d25851de59fbdac42e9', 'request_id': 'req-62e8a991-3cf1-4f61-bd37-43041e993b10'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:22.363816 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-62e8a991-3cf1-4f61-bd37-43041e993b10 admin admin] The token cache is being invalidate because project 4e753fea116b4d25851de59fbdac42e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:39:22.366681 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-62e8a991-3cf1-4f61-bd37-43041e993b10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:22.366681 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-62e8a991-3cf1-4f61-bd37-43041e993b10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:22.366681 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1343/2672] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:39:22 2022] DELETE /identity/v3/projects/4e753fea116b4d25851de59fbdac42e9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:39:22.372091 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1fc07-50ed-46e4-9af8-4ca3b200cfe3 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:22.372501 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1fc07-50ed-46e4-9af8-4ca3b200cfe3 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:22.372892 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1fc07-50ed-46e4-9af8-4ca3b200cfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:22.394379 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-58a1fc07-50ed-46e4-9af8-4ca3b200cfe3 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:22.395573 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-58a1fc07-50ed-46e4-9af8-4ca3b200cfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:22.454033 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1330/2673] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:22.461924 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939abae-b8df-40f8-b93c-8673a19d29f0 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:22.462229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939abae-b8df-40f8-b93c-8673a19d29f0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:22.462499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939abae-b8df-40f8-b93c-8673a19d29f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:22.482833 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-4939abae-b8df-40f8-b93c-8673a19d29f0 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:22.484017 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4939abae-b8df-40f8-b93c-8673a19d29f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:22.491935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1344/2674] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:22.496233 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1fc07-50ed-46e4-9af8-4ca3b200cfe3 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:22.501601 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:22.509238 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1fc07-50ed-46e4-9af8-4ca3b200cfe3 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:22.515312 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d581900-aec1-49f0-b875-163514b7f760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:22.515943 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d581900-aec1-49f0-b875-163514b7f760 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:22.516224 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d581900-aec1-49f0-b875-163514b7f760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:22.516497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d581900-aec1-49f0-b875-163514b7f760 admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:22.517167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d581900-aec1-49f0-b875-163514b7f760 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:39:22.517469 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d581900-aec1-49f0-b875-163514b7f760 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:22.519065 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d581900-aec1-49f0-b875-163514b7f760 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:22.531654 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1331/2675] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:39:22.536190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939abae-b8df-40f8-b93c-8673a19d29f0 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:22.545543 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939abae-b8df-40f8-b93c-8673a19d29f0 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:22.550695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85b43a-11d2-4890-9fec-904809e5b07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:22.551306 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85b43a-11d2-4890-9fec-904809e5b07f admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:22.551727 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85b43a-11d2-4890-9fec-904809e5b07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:22.552015 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85b43a-11d2-4890-9fec-904809e5b07f admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:22.552661 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85b43a-11d2-4890-9fec-904809e5b07f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:22.554625 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85b43a-11d2-4890-9fec-904809e5b07f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:22.583744 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1345/2676] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:39:22 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:39:22.587863 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d581900-aec1-49f0-b875-163514b7f760 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:22.598936 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d581900-aec1-49f0-b875-163514b7f760 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:22.677651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27fb92-1913-47ec-90ee-93985e24c9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:22.678270 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27fb92-1913-47ec-90ee-93985e24c9ac admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:22.678552 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27fb92-1913-47ec-90ee-93985e24c9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:22.678844 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27fb92-1913-47ec-90ee-93985e24c9ac admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:22.679469 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27fb92-1913-47ec-90ee-93985e24c9ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:22.681431 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27fb92-1913-47ec-90ee-93985e24c9ac admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:22.712347 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1332/2677] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:39:22 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:39:22.718691 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85b43a-11d2-4890-9fec-904809e5b07f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:22.730676 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85b43a-11d2-4890-9fec-904809e5b07f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:22.736920 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bff034-d4c0-4749-be8b-aa4bef1adc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:22.737459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bff034-d4c0-4749-be8b-aa4bef1adc6c admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:22.737736 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bff034-d4c0-4749-be8b-aa4bef1adc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:22.738041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bff034-d4c0-4749-be8b-aa4bef1adc6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:22.738756 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bff034-d4c0-4749-be8b-aa4bef1adc6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:22.741152 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bff034-d4c0-4749-be8b-aa4bef1adc6c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:22.752546 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1346/2678] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:39:22.756807 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27fb92-1913-47ec-90ee-93985e24c9ac admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:22.767493 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27fb92-1913-47ec-90ee-93985e24c9ac admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:22.772156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbacb3-b4b5-46e7-a218-aafe8fcb95ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:22.772757 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbacb3-b4b5-46e7-a218-aafe8fcb95ca admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:22.773032 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbacb3-b4b5-46e7-a218-aafe8fcb95ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:22.773298 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbacb3-b4b5-46e7-a218-aafe8fcb95ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:22.773930 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbacb3-b4b5-46e7-a218-aafe8fcb95ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:22.775498 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbacb3-b4b5-46e7-a218-aafe8fcb95ca admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:22.787308 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1333/2679] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:39:22.791633 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bff034-d4c0-4749-be8b-aa4bef1adc6c admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:22.803167 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bff034-d4c0-4749-be8b-aa4bef1adc6c admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:22.807930 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727b5f4-b3c0-49b3-a5d3-1761c513f283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:22.809122 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727b5f4-b3c0-49b3-a5d3-1761c513f283 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:22.809393 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727b5f4-b3c0-49b3-a5d3-1761c513f283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:22.809663 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727b5f4-b3c0-49b3-a5d3-1761c513f283 admin admin] PATH_INFO: `/v3/projects/697ca1e78c0b4a25845abc3e766a8a73/users/be5b646b39374536b67ee5140d813074/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:22.827299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727b5f4-b3c0-49b3-a5d3-1761c513f283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=697ca1e78c0b4a25845abc3e766a8a73, user_id=be5b646b39374536b67ee5140d813074, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:22.830009 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727b5f4-b3c0-49b3-a5d3-1761c513f283 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:22.843948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1347/2680] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:39:22 2022] PUT /identity/v3/projects/697ca1e78c0b4a25845abc3e766a8a73/users/be5b646b39374536b67ee5140d813074/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:39:22.849237 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc4b00-0aaf-4154-adf7-5c56943dc3a7 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:22.849517 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc4b00-0aaf-4154-adf7-5c56943dc3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:22.850341 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc4b00-0aaf-4154-adf7-5c56943dc3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:22.868761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-8dfc4b00-0aaf-4154-adf7-5c56943dc3a7 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:22.869958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-8dfc4b00-0aaf-4154-adf7-5c56943dc3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:22.939601 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1334/2681] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:22.949807 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727b5f4-b3c0-49b3-a5d3-1761c513f283 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:22.951692 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-3727b5f4-b3c0-49b3-a5d3-1761c513f283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:23.012113 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727b5f4-b3c0-49b3-a5d3-1761c513f283 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:23.016253 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17446079-a883-436b-9ae8-cef2e1b37092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:23.017129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17446079-a883-436b-9ae8-cef2e1b37092 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:23.017129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17446079-a883-436b-9ae8-cef2e1b37092 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:23.017389 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17446079-a883-436b-9ae8-cef2e1b37092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:23.029105 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17446079-a883-436b-9ae8-cef2e1b37092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:23.030684 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17446079-a883-436b-9ae8-cef2e1b37092 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:23.040962 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1348/2682] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:39:23.858871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646bdbf-1d2c-4d0f-a8a4-73fe50932b28 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:23.859437 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646bdbf-1d2c-4d0f-a8a4-73fe50932b28 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:23.859538 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646bdbf-1d2c-4d0f-a8a4-73fe50932b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:23.894460 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-b646bdbf-1d2c-4d0f-a8a4-73fe50932b28 None None] MFA Rules not processed for user `be5b646b39374536b67ee5140d813074`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:23.895673 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b646bdbf-1d2c-4d0f-a8a4-73fe50932b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:23.985520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:23.997635 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1335/2683] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:23.998531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17446079-a883-436b-9ae8-cef2e1b37092 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:24.008828 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17446079-a883-436b-9ae8-cef2e1b37092 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:24.014648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10d1f4-7c57-43e6-9db9-ae2616786789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:24.015273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10d1f4-7c57-43e6-9db9-ae2616786789 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:24.015541 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10d1f4-7c57-43e6-9db9-ae2616786789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:24.015839 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10d1f4-7c57-43e6-9db9-ae2616786789 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:24.016475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10d1f4-7c57-43e6-9db9-ae2616786789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:24.018449 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10d1f4-7c57-43e6-9db9-ae2616786789 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:24.049052 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1349/2684] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:39:23 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:39:24.053283 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646bdbf-1d2c-4d0f-a8a4-73fe50932b28 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:24.067688 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646bdbf-1d2c-4d0f-a8a4-73fe50932b28 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:24.158926 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721a4c2-63e9-4890-b2df-f3bf08339a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:24.159659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721a4c2-63e9-4890-b2df-f3bf08339a28 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:24.160002 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721a4c2-63e9-4890-b2df-f3bf08339a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:24.160351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721a4c2-63e9-4890-b2df-f3bf08339a28 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:24.161007 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721a4c2-63e9-4890-b2df-f3bf08339a28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:24.163762 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721a4c2-63e9-4890-b2df-f3bf08339a28 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:24.196487 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1336/2685] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:39:24 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:39:24.197702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10d1f4-7c57-43e6-9db9-ae2616786789 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:24.209803 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10d1f4-7c57-43e6-9db9-ae2616786789 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:24.215264 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e84bc8-3ced-492f-a489-f60a56e89227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:24.216593 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e84bc8-3ced-492f-a489-f60a56e89227 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:24.216876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e84bc8-3ced-492f-a489-f60a56e89227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:24.217146 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e84bc8-3ced-492f-a489-f60a56e89227 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:24.218785 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e84bc8-3ced-492f-a489-f60a56e89227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:24.220450 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e84bc8-3ced-492f-a489-f60a56e89227 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:24.234341 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1350/2686] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:39:24.239113 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721a4c2-63e9-4890-b2df-f3bf08339a28 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:24.257532 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721a4c2-63e9-4890-b2df-f3bf08339a28 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:24.276120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff67fab-af7f-49c7-a400-32ade7fcb68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:24.276819 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff67fab-af7f-49c7-a400-32ade7fcb68e admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:24.278135 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff67fab-af7f-49c7-a400-32ade7fcb68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:24.279036 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff67fab-af7f-49c7-a400-32ade7fcb68e admin admin] PATH_INFO: `/v3/projects/262642a073c541ee913ada87be4236fa/users/c3028bd635ae488fb124d1683521e1f5/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:24.313068 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff67fab-af7f-49c7-a400-32ade7fcb68e admin admin] RBAC: Authorizing `identity:create_grant(project_id=262642a073c541ee913ada87be4236fa, user_id=c3028bd635ae488fb124d1683521e1f5, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:24.315750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff67fab-af7f-49c7-a400-32ade7fcb68e admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:24.334360 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1337/2687] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:39:24 2022] PUT /identity/v3/projects/262642a073c541ee913ada87be4236fa/users/c3028bd635ae488fb124d1683521e1f5/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:24.341849 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e84bc8-3ced-492f-a489-f60a56e89227 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:24.357167 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e84bc8-3ced-492f-a489-f60a56e89227 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:24.426325 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:24.450061 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53933e2-fb82-4eda-94da-9d45c9fbe108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:24.450775 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53933e2-fb82-4eda-94da-9d45c9fbe108 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:24.451060 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53933e2-fb82-4eda-94da-9d45c9fbe108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:24.451325 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53933e2-fb82-4eda-94da-9d45c9fbe108 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:24.452011 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53933e2-fb82-4eda-94da-9d45c9fbe108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:24.453748 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53933e2-fb82-4eda-94da-9d45c9fbe108 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:24.464931 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1351/2688] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:39:24.469830 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff67fab-af7f-49c7-a400-32ade7fcb68e admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:24.483266 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff67fab-af7f-49c7-a400-32ade7fcb68e admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:24.490460 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fd289-5743-40c8-b4f0-d1b3cc371c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:24.492686 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fd289-5743-40c8-b4f0-d1b3cc371c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:24.492686 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fd289-5743-40c8-b4f0-d1b3cc371c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:24.492686 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fd289-5743-40c8-b4f0-d1b3cc371c70 admin admin] PATH_INFO: `/v3/projects/262642a073c541ee913ada87be4236fa/users/c3028bd635ae488fb124d1683521e1f5/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:24.494163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42fd289-5743-40c8-b4f0-d1b3cc371c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=262642a073c541ee913ada87be4236fa, user_id=c3028bd635ae488fb124d1683521e1f5, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:24.497730 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42fd289-5743-40c8-b4f0-d1b3cc371c70 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:24.516645 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1338/2689] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:39:24 2022] PUT /identity/v3/projects/262642a073c541ee913ada87be4236fa/users/c3028bd635ae488fb124d1683521e1f5/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:25.265439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2a49d-157f-42ce-88c6-419a5416929f None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:25.265995 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2a49d-157f-42ce-88c6-419a5416929f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:25.265995 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2a49d-157f-42ce-88c6-419a5416929f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:25.289756 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ebd2a49d-157f-42ce-88c6-419a5416929f None None] MFA Rules not processed for user `c5dc12a8bc2b406b8a148bf609d5d2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:25.290971 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ebd2a49d-157f-42ce-88c6-419a5416929f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:25.356031 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1352/2690] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Oct 4 14:39:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:25.375863 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fd289-5743-40c8-b4f0-d1b3cc371c70 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:25.377617 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f42fd289-5743-40c8-b4f0-d1b3cc371c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:25.454838 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fd289-5743-40c8-b4f0-d1b3cc371c70 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:25.460126 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ae760-9531-4eb7-9118-a535b2de8b19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4860d5958e724e568576a9067290a27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:25.460836 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ae760-9531-4eb7-9118-a535b2de8b19 service swift] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:25.461148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ae760-9531-4eb7-9118-a535b2de8b19 service swift] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:25.461423 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ae760-9531-4eb7-9118-a535b2de8b19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:25.470597 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ae760-9531-4eb7-9118-a535b2de8b19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:25.472702 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ae760-9531-4eb7-9118-a535b2de8b19 service swift] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:25.489770 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1339/2691] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Oct 4 14:39:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 14:39:25.521176 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c86be8-e6ff-4915-b9de-32e975989ba9 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:25.521478 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c86be8-e6ff-4915-b9de-32e975989ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:25.521751 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c86be8-e6ff-4915-b9de-32e975989ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:25.566778 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e9c86be8-e6ff-4915-b9de-32e975989ba9 None None] MFA Rules not processed for user `c3028bd635ae488fb124d1683521e1f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:25.567670 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e9c86be8-e6ff-4915-b9de-32e975989ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:25.727478 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1353/2692] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:25.804385 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8832b67-b14e-4ffb-a822-bedd01dc8df0 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:25.804657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8832b67-b14e-4ffb-a822-bedd01dc8df0 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:25.804926 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8832b67-b14e-4ffb-a822-bedd01dc8df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:25.827775 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-c8832b67-b14e-4ffb-a822-bedd01dc8df0 None None] MFA Rules not processed for user `be5b646b39374536b67ee5140d813074`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:25.829018 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-c8832b67-b14e-4ffb-a822-bedd01dc8df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:25.872351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:25.916480 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c86be8-e6ff-4915-b9de-32e975989ba9 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:25.916696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1340/2693] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:25.918476 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e9c86be8-e6ff-4915-b9de-32e975989ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:26.034819 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c86be8-e6ff-4915-b9de-32e975989ba9 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:26.044790 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6dd0a-a597-46bb-a750-39589d7f1664 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:26.046937 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6dd0a-a597-46bb-a750-39589d7f1664 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:26.052596 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6dd0a-a597-46bb-a750-39589d7f1664 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:26.053427 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6dd0a-a597-46bb-a750-39589d7f1664 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:26.075095 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:26.079474 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6dd0a-a597-46bb-a750-39589d7f1664 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:26.082256 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6dd0a-a597-46bb-a750-39589d7f1664 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:26.097570 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1354/2694] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:39:29.429276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8832b67-b14e-4ffb-a822-bedd01dc8df0 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:29.430931 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-c8832b67-b14e-4ffb-a822-bedd01dc8df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:29.504471 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8832b67-b14e-4ffb-a822-bedd01dc8df0 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:29.509385 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b494c2-12b5-4acb-87b7-eb3314b0617e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:29.510540 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b494c2-12b5-4acb-87b7-eb3314b0617e service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:29.511093 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b494c2-12b5-4acb-87b7-eb3314b0617e service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:29.511599 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b494c2-12b5-4acb-87b7-eb3314b0617e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:29.514630 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-76b494c2-12b5-4acb-87b7-eb3314b0617e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:29.529864 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b494c2-12b5-4acb-87b7-eb3314b0617e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:29.531358 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b494c2-12b5-4acb-87b7-eb3314b0617e service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:29.543216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1341/2695] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:39:29.682035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6dd0a-a597-46bb-a750-39589d7f1664 service nova] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:29.692977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6dd0a-a597-46bb-a750-39589d7f1664 service nova] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:29.696652 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917f29f-3278-4f51-a846-78884af735df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:29.697248 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917f29f-3278-4f51-a846-78884af735df service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:29.697525 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917f29f-3278-4f51-a846-78884af735df service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:29.697791 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917f29f-3278-4f51-a846-78884af735df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:29.699510 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e917f29f-3278-4f51-a846-78884af735df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:29.714529 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917f29f-3278-4f51-a846-78884af735df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:29.716065 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917f29f-3278-4f51-a846-78884af735df service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:29.728301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1355/2696] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:39:39.537756 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=33 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:39.722571 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=8 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:48.909808 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b494c2-12b5-4acb-87b7-eb3314b0617e service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:48.911226 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-76b494c2-12b5-4acb-87b7-eb3314b0617e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:48.983290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b494c2-12b5-4acb-87b7-eb3314b0617e service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:48.988232 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554841e8-26f4-47f8-929b-6c77f0dd1592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:48.988868 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554841e8-26f4-47f8-929b-6c77f0dd1592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:48.989145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554841e8-26f4-47f8-929b-6c77f0dd1592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:48.989412 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554841e8-26f4-47f8-929b-6c77f0dd1592 admin admin] PATH_INFO: `/v3/users/05f4de0e8b97416a9a7522e9070250d4` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:48.990542 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554841e8-26f4-47f8-929b-6c77f0dd1592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05f4de0e8b97416a9a7522e9070250d4)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:48.992480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554841e8-26f4-47f8-929b-6c77f0dd1592 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:49.046909 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-554841e8-26f4-47f8-929b-6c77f0dd1592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05f4de0e8b97416a9a7522e9070250d4'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:49.047573 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-554841e8-26f4-47f8-929b-6c77f0dd1592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05f4de0e8b97416a9a7522e9070250d4'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:49.061063 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-554841e8-26f4-47f8-929b-6c77f0dd1592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05f4de0e8b97416a9a7522e9070250d4'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:49.069505 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-554841e8-26f4-47f8-929b-6c77f0dd1592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05f4de0e8b97416a9a7522e9070250d4'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:49.078025 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-554841e8-26f4-47f8-929b-6c77f0dd1592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05f4de0e8b97416a9a7522e9070250d4'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:49.084639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1342/2697] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:39:48 2022] DELETE /identity/v3/users/05f4de0e8b97416a9a7522e9070250d4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:49.088806 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd1913-27fe-4857-9272-dfbd72dd854f None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:49.089308 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd1913-27fe-4857-9272-dfbd72dd854f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:49.089308 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd1913-27fe-4857-9272-dfbd72dd854f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:49.109353 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-6cbd1913-27fe-4857-9272-dfbd72dd854f None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:49.110538 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6cbd1913-27fe-4857-9272-dfbd72dd854f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:49.173017 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1356/2698] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:49.183141 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554841e8-26f4-47f8-929b-6c77f0dd1592 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:49.186827 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-554841e8-26f4-47f8-929b-6c77f0dd1592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:49.252234 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554841e8-26f4-47f8-929b-6c77f0dd1592 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:49.256137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57085877-ca14-4ee9-9473-19db049d0413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:49.256757 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57085877-ca14-4ee9-9473-19db049d0413 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:49.257039 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57085877-ca14-4ee9-9473-19db049d0413 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:49.257311 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57085877-ca14-4ee9-9473-19db049d0413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:49.267642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57085877-ca14-4ee9-9473-19db049d0413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:49.269112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57085877-ca14-4ee9-9473-19db049d0413 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:49.278990 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1343/2699] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:39:49.576223 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd1913-27fe-4857-9272-dfbd72dd854f None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:49.578283 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6cbd1913-27fe-4857-9272-dfbd72dd854f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:49.594617 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd1913-27fe-4857-9272-dfbd72dd854f None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:49.601055 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1004326-d486-4523-9cf1-79b0a160c8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:49.601705 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1004326-d486-4523-9cf1-79b0a160c8bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:49.601982 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1004326-d486-4523-9cf1-79b0a160c8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:49.602244 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1004326-d486-4523-9cf1-79b0a160c8bd admin admin] PATH_INFO: `/v3/projects/dc0bcfed7d1e49a9bf6ddee938ec7dec` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:49.603400 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1004326-d486-4523-9cf1-79b0a160c8bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc0bcfed7d1e49a9bf6ddee938ec7dec)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:49.605458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1004326-d486-4523-9cf1-79b0a160c8bd admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:49.656527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e1004326-d486-4523-9cf1-79b0a160c8bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc0bcfed7d1e49a9bf6ddee938ec7dec', 'request_id': 'req-e1004326-d486-4523-9cf1-79b0a160c8bd'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:49.667727 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e1004326-d486-4523-9cf1-79b0a160c8bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc0bcfed7d1e49a9bf6ddee938ec7dec', 'request_id': 'req-e1004326-d486-4523-9cf1-79b0a160c8bd'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:49.676069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e1004326-d486-4523-9cf1-79b0a160c8bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc0bcfed7d1e49a9bf6ddee938ec7dec', 'request_id': 'req-e1004326-d486-4523-9cf1-79b0a160c8bd'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:49.692753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e1004326-d486-4523-9cf1-79b0a160c8bd admin admin] The token cache is being invalidate because project dc0bcfed7d1e49a9bf6ddee938ec7dec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:39:49.693041 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e1004326-d486-4523-9cf1-79b0a160c8bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:49.693657 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-e1004326-d486-4523-9cf1-79b0a160c8bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:39:49.695131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1357/2700] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:39:49 2022] DELETE /identity/v3/projects/dc0bcfed7d1e49a9bf6ddee938ec7dec => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:49.757462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bf640-2dac-4d18-aca2-c24752e20eb2 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:49.757720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bf640-2dac-4d18-aca2-c24752e20eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:49.757997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bf640-2dac-4d18-aca2-c24752e20eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:49.777993 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-a86bf640-2dac-4d18-aca2-c24752e20eb2 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:49.779831 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a86bf640-2dac-4d18-aca2-c24752e20eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:49.799197 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:49.849660 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1344/2701] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:49.857804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0856d-4cdd-48a2-ad86-ed40f98ba567 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:49.858291 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0856d-4cdd-48a2-ad86-ed40f98ba567 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:49.858552 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0856d-4cdd-48a2-ad86-ed40f98ba567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:49.879235 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-00c0856d-4cdd-48a2-ad86-ed40f98ba567 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:49.880459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-00c0856d-4cdd-48a2-ad86-ed40f98ba567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:49.888389 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1358/2702] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:49.893210 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bf640-2dac-4d18-aca2-c24752e20eb2 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:49.905561 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bf640-2dac-4d18-aca2-c24752e20eb2 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:49.910126 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c0aeb-41f8-4abf-a81f-483f498d2d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:49.910767 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c0aeb-41f8-4abf-a81f-483f498d2d97 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:49.911003 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c0aeb-41f8-4abf-a81f-483f498d2d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:49.911271 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c0aeb-41f8-4abf-a81f-483f498d2d97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:49.911952 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c0aeb-41f8-4abf-a81f-483f498d2d97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:39:49.912250 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c0aeb-41f8-4abf-a81f-483f498d2d97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:49.913855 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c0aeb-41f8-4abf-a81f-483f498d2d97 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:49.926954 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1345/2703] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:39:49.931442 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0856d-4cdd-48a2-ad86-ed40f98ba567 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:49.940813 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0856d-4cdd-48a2-ad86-ed40f98ba567 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:49.945625 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05def2-85a9-4b42-8c3e-ef749cb0440d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:49.946220 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05def2-85a9-4b42-8c3e-ef749cb0440d admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:49.946493 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05def2-85a9-4b42-8c3e-ef749cb0440d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:49.946754 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05def2-85a9-4b42-8c3e-ef749cb0440d admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:49.947387 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05def2-85a9-4b42-8c3e-ef749cb0440d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:49.949308 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05def2-85a9-4b42-8c3e-ef749cb0440d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:49.992650 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1359/2704] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:39:49 2022] POST /identity/v3/projects => generated 363 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:39:49.997238 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c0aeb-41f8-4abf-a81f-483f498d2d97 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:50.007695 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c0aeb-41f8-4abf-a81f-483f498d2d97 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:50.068888 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19c4c1-8c99-44bf-a30c-000de6c0d122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:50.069503 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19c4c1-8c99-44bf-a30c-000de6c0d122 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:50.069787 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19c4c1-8c99-44bf-a30c-000de6c0d122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:50.070059 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19c4c1-8c99-44bf-a30c-000de6c0d122 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:50.070702 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19c4c1-8c99-44bf-a30c-000de6c0d122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:50.072653 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19c4c1-8c99-44bf-a30c-000de6c0d122 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:50.103315 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1346/2705] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:39:49 2022] POST /identity/v3/users => generated 282 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:39:50.108449 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05def2-85a9-4b42-8c3e-ef749cb0440d admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:50.120702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05def2-85a9-4b42-8c3e-ef749cb0440d admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:50.125589 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8aceb-02f4-4b00-beda-6aef7c14bbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:50.126223 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8aceb-02f4-4b00-beda-6aef7c14bbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:50.126496 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8aceb-02f4-4b00-beda-6aef7c14bbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:50.126765 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8aceb-02f4-4b00-beda-6aef7c14bbb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:50.127403 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8aceb-02f4-4b00-beda-6aef7c14bbb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:50.129007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8aceb-02f4-4b00-beda-6aef7c14bbb4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:50.140127 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1360/2706] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:39:50.144266 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19c4c1-8c99-44bf-a30c-000de6c0d122 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:50.156522 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19c4c1-8c99-44bf-a30c-000de6c0d122 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:50.161556 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d12fe-5a7e-4290-a0fa-cabe6155ce14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:50.162171 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d12fe-5a7e-4290-a0fa-cabe6155ce14 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:50.162453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d12fe-5a7e-4290-a0fa-cabe6155ce14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:50.162730 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d12fe-5a7e-4290-a0fa-cabe6155ce14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:50.163381 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d12fe-5a7e-4290-a0fa-cabe6155ce14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:50.165050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d12fe-5a7e-4290-a0fa-cabe6155ce14 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:50.177430 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1347/2707] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:39:50.181605 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8aceb-02f4-4b00-beda-6aef7c14bbb4 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:50.192172 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8aceb-02f4-4b00-beda-6aef7c14bbb4 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:50.197352 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf446601-04aa-45b3-84c7-2b5dce60e006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:50.198027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf446601-04aa-45b3-84c7-2b5dce60e006 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:50.198332 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf446601-04aa-45b3-84c7-2b5dce60e006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:50.198726 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf446601-04aa-45b3-84c7-2b5dce60e006 admin admin] PATH_INFO: `/v3/projects/8bc148636f524df994a6ca7a793a673e/users/e99cbf7640374152bff75993cdb8c042/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:50.217455 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf446601-04aa-45b3-84c7-2b5dce60e006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bc148636f524df994a6ca7a793a673e, user_id=e99cbf7640374152bff75993cdb8c042, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:50.220185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf446601-04aa-45b3-84c7-2b5dce60e006 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:50.241204 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1361/2708] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:39:50 2022] PUT /identity/v3/projects/8bc148636f524df994a6ca7a793a673e/users/e99cbf7640374152bff75993cdb8c042/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:39:50.252376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ff9f7-9e53-4a55-92f2-a1dbbd4655d6 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:50.255434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ff9f7-9e53-4a55-92f2-a1dbbd4655d6 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:50.255843 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ff9f7-9e53-4a55-92f2-a1dbbd4655d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:50.286823 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-b58ff9f7-9e53-4a55-92f2-a1dbbd4655d6 None None] MFA Rules not processed for user `e99cbf7640374152bff75993cdb8c042`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:50.288169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b58ff9f7-9e53-4a55-92f2-a1dbbd4655d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:50.358978 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1348/2709] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:39:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:50.370341 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf446601-04aa-45b3-84c7-2b5dce60e006 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:50.372952 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-cf446601-04aa-45b3-84c7-2b5dce60e006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:50.386883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:50.438523 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf446601-04aa-45b3-84c7-2b5dce60e006 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:50.442557 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ab8ac-1e88-4117-b6c2-d52ac692399d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:50.443169 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ab8ac-1e88-4117-b6c2-d52ac692399d service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:50.443449 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ab8ac-1e88-4117-b6c2-d52ac692399d service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:50.443739 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ab8ac-1e88-4117-b6c2-d52ac692399d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:50.460935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ab8ac-1e88-4117-b6c2-d52ac692399d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:50.462527 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ab8ac-1e88-4117-b6c2-d52ac692399d service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:50.473082 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1362/2710] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:39:52.297063 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477275af-5908-433a-b6ea-d21652298d07 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:52.297611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477275af-5908-433a-b6ea-d21652298d07 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:52.297611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477275af-5908-433a-b6ea-d21652298d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:52.318633 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-477275af-5908-433a-b6ea-d21652298d07 None None] MFA Rules not processed for user `c5dc12a8bc2b406b8a148bf609d5d2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:39:52.319893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-477275af-5908-433a-b6ea-d21652298d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:52.336501 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:52.393326 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1349/2711] 10.222.0.62 () {58 vars in 967 bytes} [Tue Oct 4 14:39:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:39:52.408724 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ab8ac-1e88-4117-b6c2-d52ac692399d service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:52.411121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4b4ab8ac-1e88-4117-b6c2-d52ac692399d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:52.500499 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ab8ac-1e88-4117-b6c2-d52ac692399d service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:52.507286 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f43cab-ce90-446c-b42e-1a3c3de0fff2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4860d5958e724e568576a9067290a27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:52.507958 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f43cab-ce90-446c-b42e-1a3c3de0fff2 service swift] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:52.508233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f43cab-ce90-446c-b42e-1a3c3de0fff2 service swift] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:52.508505 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f43cab-ce90-446c-b42e-1a3c3de0fff2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:52.519687 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f43cab-ce90-446c-b42e-1a3c3de0fff2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:52.521320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f43cab-ce90-446c-b42e-1a3c3de0fff2 service swift] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:52.537482 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1363/2712] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Oct 4 14:39:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 14:39:56.703403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477275af-5908-433a-b6ea-d21652298d07 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:56.704897 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-477275af-5908-433a-b6ea-d21652298d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:56.795695 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477275af-5908-433a-b6ea-d21652298d07 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:56.799397 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15675c57-334f-4f30-9f67-63bd1715a723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:56.800048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15675c57-334f-4f30-9f67-63bd1715a723 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:56.800326 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15675c57-334f-4f30-9f67-63bd1715a723 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:56.800596 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15675c57-334f-4f30-9f67-63bd1715a723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:56.802350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-15675c57-334f-4f30-9f67-63bd1715a723 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:56.813523 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15675c57-334f-4f30-9f67-63bd1715a723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:56.815658 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15675c57-334f-4f30-9f67-63bd1715a723 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:56.828969 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1350/2713] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:39:58.669106 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f43cab-ce90-446c-b42e-1a3c3de0fff2 service swift] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:39:58.671273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b1f43cab-ce90-446c-b42e-1a3c3de0fff2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:58.683430 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f43cab-ce90-446c-b42e-1a3c3de0fff2 service swift] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:39:58.687586 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcf035-e6ad-4c7b-be34-3bb64e9a5005 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:39:58.699935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcf035-e6ad-4c7b-be34-3bb64e9a5005 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:39:58.699935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcf035-e6ad-4c7b-be34-3bb64e9a5005 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:39:58.699935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcf035-e6ad-4c7b-be34-3bb64e9a5005 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:39:58.699935 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b9dcf035-e6ad-4c7b-be34-3bb64e9a5005 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:39:58.757154 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcf035-e6ad-4c7b-be34-3bb64e9a5005 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:39:58.758585 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcf035-e6ad-4c7b-be34-3bb64e9a5005 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:39:58.775856 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1364/2714] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:39:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:40:00.732496 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15675c57-334f-4f30-9f67-63bd1715a723 service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:00.734685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-15675c57-334f-4f30-9f67-63bd1715a723 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:00.814639 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15675c57-334f-4f30-9f67-63bd1715a723 service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:00.821789 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159248f-9980-48ab-b46c-6aedaf79589c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f98c07455a241398784d221df273aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:00.822420 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159248f-9980-48ab-b46c-6aedaf79589c service placement] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:00.822699 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159248f-9980-48ab-b46c-6aedaf79589c service placement] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:00.822974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159248f-9980-48ab-b46c-6aedaf79589c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:00.824944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-c159248f-9980-48ab-b46c-6aedaf79589c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:00.838101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159248f-9980-48ab-b46c-6aedaf79589c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:00.839698 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159248f-9980-48ab-b46c-6aedaf79589c service placement] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:00.850553 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1351/2715] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:40:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:40:08.764015 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=83 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:40:10.845822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=75 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:40:20.562252 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcf035-e6ad-4c7b-be34-3bb64e9a5005 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:20.565035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b9dcf035-e6ad-4c7b-be34-3bb64e9a5005 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:20.641277 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcf035-e6ad-4c7b-be34-3bb64e9a5005 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:20.645828 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aaf0e9-a89d-4f64-8682-8030e8c5f98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:20.646456 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aaf0e9-a89d-4f64-8682-8030e8c5f98a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:20.646735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aaf0e9-a89d-4f64-8682-8030e8c5f98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:20.647037 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aaf0e9-a89d-4f64-8682-8030e8c5f98a admin admin] PATH_INFO: `/v3/users/be5b646b39374536b67ee5140d813074` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:20.648195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aaf0e9-a89d-4f64-8682-8030e8c5f98a admin admin] RBAC: Authorizing `identity:delete_user(user_id=be5b646b39374536b67ee5140d813074)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:20.650099 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aaf0e9-a89d-4f64-8682-8030e8c5f98a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:20.702889 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-26aaf0e9-a89d-4f64-8682-8030e8c5f98a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be5b646b39374536b67ee5140d813074'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:20.703651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-26aaf0e9-a89d-4f64-8682-8030e8c5f98a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be5b646b39374536b67ee5140d813074'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:20.711079 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-26aaf0e9-a89d-4f64-8682-8030e8c5f98a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be5b646b39374536b67ee5140d813074'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:20.723030 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-26aaf0e9-a89d-4f64-8682-8030e8c5f98a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be5b646b39374536b67ee5140d813074'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:20.729770 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-26aaf0e9-a89d-4f64-8682-8030e8c5f98a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be5b646b39374536b67ee5140d813074'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:20.736313 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1365/2716] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:40:20 2022] DELETE /identity/v3/users/be5b646b39374536b67ee5140d813074 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:40:20.909568 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159248f-9980-48ab-b46c-6aedaf79589c service placement] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:20.920821 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159248f-9980-48ab-b46c-6aedaf79589c service placement] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:20.979323 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15de933-a4bd-40af-bcf3-fd4cbefaa69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:20.979984 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15de933-a4bd-40af-bcf3-fd4cbefaa69d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:20.980265 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15de933-a4bd-40af-bcf3-fd4cbefaa69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:20.980537 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15de933-a4bd-40af-bcf3-fd4cbefaa69d admin admin] PATH_INFO: `/v3/projects/697ca1e78c0b4a25845abc3e766a8a73` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:20.981638 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15de933-a4bd-40af-bcf3-fd4cbefaa69d admin admin] RBAC: Authorizing `identity:delete_project(project_id=697ca1e78c0b4a25845abc3e766a8a73)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:20.983558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15de933-a4bd-40af-bcf3-fd4cbefaa69d admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:21.030023 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-f15de933-a4bd-40af-bcf3-fd4cbefaa69d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '697ca1e78c0b4a25845abc3e766a8a73', 'request_id': 'req-f15de933-a4bd-40af-bcf3-fd4cbefaa69d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:21.037489 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-f15de933-a4bd-40af-bcf3-fd4cbefaa69d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '697ca1e78c0b4a25845abc3e766a8a73', 'request_id': 'req-f15de933-a4bd-40af-bcf3-fd4cbefaa69d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:21.045160 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-f15de933-a4bd-40af-bcf3-fd4cbefaa69d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '697ca1e78c0b4a25845abc3e766a8a73', 'request_id': 'req-f15de933-a4bd-40af-bcf3-fd4cbefaa69d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:21.061323 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-f15de933-a4bd-40af-bcf3-fd4cbefaa69d admin admin] The token cache is being invalidate because project 697ca1e78c0b4a25845abc3e766a8a73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:40:21.061616 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-f15de933-a4bd-40af-bcf3-fd4cbefaa69d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:21.062254 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-f15de933-a4bd-40af-bcf3-fd4cbefaa69d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:21.063803 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1352/2717] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:40:20 2022] DELETE /identity/v3/projects/697ca1e78c0b4a25845abc3e766a8a73 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:40:21.068249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aaf0e9-a89d-4f64-8682-8030e8c5f98a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:21.074196 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-26aaf0e9-a89d-4f64-8682-8030e8c5f98a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:21.087521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aaf0e9-a89d-4f64-8682-8030e8c5f98a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:21.145827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2353e-c416-459a-aad5-b05bc29c163b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:21.146461 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2353e-c416-459a-aad5-b05bc29c163b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:21.146740 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2353e-c416-459a-aad5-b05bc29c163b admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:21.147009 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2353e-c416-459a-aad5-b05bc29c163b admin admin] PATH_INFO: `/v3/users/c3028bd635ae488fb124d1683521e1f5` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:21.148176 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2353e-c416-459a-aad5-b05bc29c163b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3028bd635ae488fb124d1683521e1f5)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:21.150067 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2353e-c416-459a-aad5-b05bc29c163b admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:21.174485 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:40:21.200617 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d3f2353e-c416-459a-aad5-b05bc29c163b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3028bd635ae488fb124d1683521e1f5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:21.201261 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d3f2353e-c416-459a-aad5-b05bc29c163b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3028bd635ae488fb124d1683521e1f5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:21.208836 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d3f2353e-c416-459a-aad5-b05bc29c163b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3028bd635ae488fb124d1683521e1f5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:21.221191 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d3f2353e-c416-459a-aad5-b05bc29c163b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3028bd635ae488fb124d1683521e1f5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:21.228540 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d3f2353e-c416-459a-aad5-b05bc29c163b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3028bd635ae488fb124d1683521e1f5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:21.234995 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1366/2718] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:40:21 2022] DELETE /identity/v3/users/c3028bd635ae488fb124d1683521e1f5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:40:21.418160 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15de933-a4bd-40af-bcf3-fd4cbefaa69d admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:21.421051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f15de933-a4bd-40af-bcf3-fd4cbefaa69d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:21.436482 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15de933-a4bd-40af-bcf3-fd4cbefaa69d admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:21.495793 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5264093-ddba-4510-83c0-5b4062f393f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:21.496424 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5264093-ddba-4510-83c0-5b4062f393f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:21.496721 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5264093-ddba-4510-83c0-5b4062f393f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:21.496991 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5264093-ddba-4510-83c0-5b4062f393f6 admin admin] PATH_INFO: `/v3/projects/262642a073c541ee913ada87be4236fa` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:21.498094 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5264093-ddba-4510-83c0-5b4062f393f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=262642a073c541ee913ada87be4236fa)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:21.500475 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5264093-ddba-4510-83c0-5b4062f393f6 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:21.545163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:40:21.559605 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-f5264093-ddba-4510-83c0-5b4062f393f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '262642a073c541ee913ada87be4236fa', 'request_id': 'req-f5264093-ddba-4510-83c0-5b4062f393f6'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:21.565914 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-f5264093-ddba-4510-83c0-5b4062f393f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '262642a073c541ee913ada87be4236fa', 'request_id': 'req-f5264093-ddba-4510-83c0-5b4062f393f6'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:21.573894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-f5264093-ddba-4510-83c0-5b4062f393f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '262642a073c541ee913ada87be4236fa', 'request_id': 'req-f5264093-ddba-4510-83c0-5b4062f393f6'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:21.585516 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-f5264093-ddba-4510-83c0-5b4062f393f6 admin admin] The token cache is being invalidate because project 262642a073c541ee913ada87be4236fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:40:21.585863 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-f5264093-ddba-4510-83c0-5b4062f393f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:21.586440 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-f5264093-ddba-4510-83c0-5b4062f393f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:21.587957 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1353/2719] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:40:21 2022] DELETE /identity/v3/projects/262642a073c541ee913ada87be4236fa => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:40:21.592944 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336196f6-4a4d-4f61-ad6c-50274ef6ce21 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:21.593439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336196f6-4a4d-4f61-ad6c-50274ef6ce21 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:21.593541 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336196f6-4a4d-4f61-ad6c-50274ef6ce21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:21.614251 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-336196f6-4a4d-4f61-ad6c-50274ef6ce21 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:40:21.615481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-336196f6-4a4d-4f61-ad6c-50274ef6ce21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:21.674183 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1367/2720] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:40:21.682394 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a9184-e7ba-4691-90d6-92fb540a9e2a None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:21.682696 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a9184-e7ba-4691-90d6-92fb540a9e2a None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:21.682971 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a9184-e7ba-4691-90d6-92fb540a9e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:21.706092 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-7e8a9184-e7ba-4691-90d6-92fb540a9e2a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:40:21.707383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-7e8a9184-e7ba-4691-90d6-92fb540a9e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:21.715832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1354/2721] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:40:21.721217 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336196f6-4a4d-4f61-ad6c-50274ef6ce21 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:21.731607 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336196f6-4a4d-4f61-ad6c-50274ef6ce21 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:21.737012 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed471aa-53b3-4c7a-8c6d-29f40728e814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:21.737641 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed471aa-53b3-4c7a-8c6d-29f40728e814 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:21.737926 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed471aa-53b3-4c7a-8c6d-29f40728e814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:21.738245 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed471aa-53b3-4c7a-8c6d-29f40728e814 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:21.738980 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed471aa-53b3-4c7a-8c6d-29f40728e814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:40:21.739284 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed471aa-53b3-4c7a-8c6d-29f40728e814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:21.741018 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed471aa-53b3-4c7a-8c6d-29f40728e814 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:21.754305 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1368/2722] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:40:21.758815 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a9184-e7ba-4691-90d6-92fb540a9e2a None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:21.769074 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a9184-e7ba-4691-90d6-92fb540a9e2a None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:21.773665 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d57bf6-f6b3-4346-b9ea-99f03d09d118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:21.774274 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d57bf6-f6b3-4346-b9ea-99f03d09d118 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:21.774550 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d57bf6-f6b3-4346-b9ea-99f03d09d118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:21.774815 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d57bf6-f6b3-4346-b9ea-99f03d09d118 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:21.775440 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d57bf6-f6b3-4346-b9ea-99f03d09d118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:21.777452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d57bf6-f6b3-4346-b9ea-99f03d09d118 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:21.810407 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1355/2723] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:40:21 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:40:21.815175 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed471aa-53b3-4c7a-8c6d-29f40728e814 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:21.827857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed471aa-53b3-4c7a-8c6d-29f40728e814 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:21.886587 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256f8b6-f2e0-4ad5-8b7d-73c41edec0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:21.887193 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256f8b6-f2e0-4ad5-8b7d-73c41edec0cc admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:21.887473 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256f8b6-f2e0-4ad5-8b7d-73c41edec0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:21.887774 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256f8b6-f2e0-4ad5-8b7d-73c41edec0cc admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:21.888412 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256f8b6-f2e0-4ad5-8b7d-73c41edec0cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:21.890390 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256f8b6-f2e0-4ad5-8b7d-73c41edec0cc admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:21.912896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1369/2724] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:40:21 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:40:21.917452 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d57bf6-f6b3-4346-b9ea-99f03d09d118 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:21.927792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d57bf6-f6b3-4346-b9ea-99f03d09d118 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:21.932345 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff291dac-2515-45f4-956a-14920baac73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:21.932929 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff291dac-2515-45f4-956a-14920baac73f admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:21.933204 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff291dac-2515-45f4-956a-14920baac73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:21.933472 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff291dac-2515-45f4-956a-14920baac73f admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:21.934102 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff291dac-2515-45f4-956a-14920baac73f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:21.935673 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff291dac-2515-45f4-956a-14920baac73f admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:21.946242 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1356/2725] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:40:21.950333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256f8b6-f2e0-4ad5-8b7d-73c41edec0cc admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:21.961363 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256f8b6-f2e0-4ad5-8b7d-73c41edec0cc admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:21.966360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3aad33-ec2b-454f-a1a6-490e858c5d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:21.967007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3aad33-ec2b-454f-a1a6-490e858c5d30 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:21.967322 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3aad33-ec2b-454f-a1a6-490e858c5d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:21.967624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3aad33-ec2b-454f-a1a6-490e858c5d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:21.968304 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3aad33-ec2b-454f-a1a6-490e858c5d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:21.970233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3aad33-ec2b-454f-a1a6-490e858c5d30 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:21.981105 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1370/2726] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:40:21.985327 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff291dac-2515-45f4-956a-14920baac73f admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:21.995078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff291dac-2515-45f4-956a-14920baac73f admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:21.999605 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654aa1d-8d49-4c0a-a4b2-8a1af305b151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:22.000816 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654aa1d-8d49-4c0a-a4b2-8a1af305b151 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:22.001085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654aa1d-8d49-4c0a-a4b2-8a1af305b151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:22.001352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654aa1d-8d49-4c0a-a4b2-8a1af305b151 admin admin] PATH_INFO: `/v3/projects/656914cf63474056a0a7aab9ce62f39b/users/36b7f789b0d547e2b89d44fc4b82ff24/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:22.015359 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654aa1d-8d49-4c0a-a4b2-8a1af305b151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=656914cf63474056a0a7aab9ce62f39b, user_id=36b7f789b0d547e2b89d44fc4b82ff24, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:22.018688 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654aa1d-8d49-4c0a-a4b2-8a1af305b151 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:22.031564 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1357/2727] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:40:21 2022] PUT /identity/v3/projects/656914cf63474056a0a7aab9ce62f39b/users/36b7f789b0d547e2b89d44fc4b82ff24/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:40:22.042856 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf97968-21eb-4bd4-b3cc-81010224230a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:22.043143 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf97968-21eb-4bd4-b3cc-81010224230a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:22.043414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf97968-21eb-4bd4-b3cc-81010224230a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:22.051922 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:40:22.073277 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-1cf97968-21eb-4bd4-b3cc-81010224230a None None] MFA Rules not processed for user `36b7f789b0d547e2b89d44fc4b82ff24`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:40:22.074404 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1cf97968-21eb-4bd4-b3cc-81010224230a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:22.144056 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1371/2728] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:40:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:40:22.154784 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654aa1d-8d49-4c0a-a4b2-8a1af305b151 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:22.157018 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-2654aa1d-8d49-4c0a-a4b2-8a1af305b151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:22.214199 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654aa1d-8d49-4c0a-a4b2-8a1af305b151 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:22.217864 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3276f3b-759e-494f-ac91-5b7143590cd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:22.218466 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3276f3b-759e-494f-ac91-5b7143590cd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:22.218821 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3276f3b-759e-494f-ac91-5b7143590cd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:22.219156 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3276f3b-759e-494f-ac91-5b7143590cd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:22.227302 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3276f3b-759e-494f-ac91-5b7143590cd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:22.228757 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3276f3b-759e-494f-ac91-5b7143590cd2 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:22.238096 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1358/2729] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:40:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:40:25.278023 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf97968-21eb-4bd4-b3cc-81010224230a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:25.345124 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf97968-21eb-4bd4-b3cc-81010224230a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:25.351327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58476b-0d23-4dea-90c8-59fd8e030e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:25.352236 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58476b-0d23-4dea-90c8-59fd8e030e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:25.352519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58476b-0d23-4dea-90c8-59fd8e030e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:25.352792 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58476b-0d23-4dea-90c8-59fd8e030e6a admin admin] PATH_INFO: `/v3/users/36b7f789b0d547e2b89d44fc4b82ff24` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:25.354015 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58476b-0d23-4dea-90c8-59fd8e030e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=36b7f789b0d547e2b89d44fc4b82ff24)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:25.356726 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58476b-0d23-4dea-90c8-59fd8e030e6a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:25.417628 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-db58476b-0d23-4dea-90c8-59fd8e030e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36b7f789b0d547e2b89d44fc4b82ff24'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:25.418671 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-db58476b-0d23-4dea-90c8-59fd8e030e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36b7f789b0d547e2b89d44fc4b82ff24'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:25.429599 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-db58476b-0d23-4dea-90c8-59fd8e030e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36b7f789b0d547e2b89d44fc4b82ff24'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:25.447273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-db58476b-0d23-4dea-90c8-59fd8e030e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36b7f789b0d547e2b89d44fc4b82ff24'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:25.457994 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-db58476b-0d23-4dea-90c8-59fd8e030e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36b7f789b0d547e2b89d44fc4b82ff24'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:25.464885 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1372/2730] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:40:25 2022] DELETE /identity/v3/users/36b7f789b0d547e2b89d44fc4b82ff24 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:40:25.470270 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75d2bb-30a7-4b5e-a00d-e05b25a61dce None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:25.470785 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75d2bb-30a7-4b5e-a00d-e05b25a61dce None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:25.470785 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75d2bb-30a7-4b5e-a00d-e05b25a61dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:25.490319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-cc75d2bb-30a7-4b5e-a00d-e05b25a61dce None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:40:25.491602 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-cc75d2bb-30a7-4b5e-a00d-e05b25a61dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:25.546840 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:40:25.557520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1359/2731] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:40:25.567834 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58476b-0d23-4dea-90c8-59fd8e030e6a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:25.569226 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-db58476b-0d23-4dea-90c8-59fd8e030e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:25.584130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:40:25.629506 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58476b-0d23-4dea-90c8-59fd8e030e6a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:25.633145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5afd0d-c81f-469a-a442-190c01cb8308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:25.633753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5afd0d-c81f-469a-a442-190c01cb8308 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:25.634029 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5afd0d-c81f-469a-a442-190c01cb8308 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:25.634301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5afd0d-c81f-469a-a442-190c01cb8308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:25.644570 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5afd0d-c81f-469a-a442-190c01cb8308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:25.645936 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5afd0d-c81f-469a-a442-190c01cb8308 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:25.655402 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1373/2732] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:40:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:40:25.954347 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75d2bb-30a7-4b5e-a00d-e05b25a61dce None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:25.956253 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-cc75d2bb-30a7-4b5e-a00d-e05b25a61dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:25.971426 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75d2bb-30a7-4b5e-a00d-e05b25a61dce None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:25.976314 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990f093-df1c-43fc-a414-21fcdffa4e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:25.976963 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990f093-df1c-43fc-a414-21fcdffa4e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:25.977260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990f093-df1c-43fc-a414-21fcdffa4e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:25.977522 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990f093-df1c-43fc-a414-21fcdffa4e14 admin admin] PATH_INFO: `/v3/projects/656914cf63474056a0a7aab9ce62f39b` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:25.978722 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990f093-df1c-43fc-a414-21fcdffa4e14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=656914cf63474056a0a7aab9ce62f39b)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:25.981162 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990f093-df1c-43fc-a414-21fcdffa4e14 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:26.034386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-d990f093-df1c-43fc-a414-21fcdffa4e14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '656914cf63474056a0a7aab9ce62f39b', 'request_id': 'req-d990f093-df1c-43fc-a414-21fcdffa4e14'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:26.044348 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-d990f093-df1c-43fc-a414-21fcdffa4e14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '656914cf63474056a0a7aab9ce62f39b', 'request_id': 'req-d990f093-df1c-43fc-a414-21fcdffa4e14'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:26.053842 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-d990f093-df1c-43fc-a414-21fcdffa4e14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '656914cf63474056a0a7aab9ce62f39b', 'request_id': 'req-d990f093-df1c-43fc-a414-21fcdffa4e14'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:26.066654 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-d990f093-df1c-43fc-a414-21fcdffa4e14 admin admin] The token cache is being invalidate because project 656914cf63474056a0a7aab9ce62f39b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:40:26.067009 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-d990f093-df1c-43fc-a414-21fcdffa4e14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:26.068070 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-d990f093-df1c-43fc-a414-21fcdffa4e14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:26.069746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1360/2733] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:40:25 2022] DELETE /identity/v3/projects/656914cf63474056a0a7aab9ce62f39b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:40:26.074700 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70f67c-1958-4bf0-98bc-bcfb6cf77260 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:26.074987 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70f67c-1958-4bf0-98bc-bcfb6cf77260 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:26.075368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70f67c-1958-4bf0-98bc-bcfb6cf77260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:26.095851 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-1f70f67c-1958-4bf0-98bc-bcfb6cf77260 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:40:26.097121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1f70f67c-1958-4bf0-98bc-bcfb6cf77260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:26.162414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1374/2734] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:40:26.170792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d5f19-a80c-4312-918d-d871043e9b9a None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:26.171075 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d5f19-a80c-4312-918d-d871043e9b9a None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:26.171352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d5f19-a80c-4312-918d-d871043e9b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:26.194145 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-5d3d5f19-a80c-4312-918d-d871043e9b9a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:40:26.195349 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-5d3d5f19-a80c-4312-918d-d871043e9b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:26.205439 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1361/2735] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:40:26.210015 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70f67c-1958-4bf0-98bc-bcfb6cf77260 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:26.221713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70f67c-1958-4bf0-98bc-bcfb6cf77260 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:26.226697 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d657d27-240e-4138-a1b1-386ed036cd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:26.227343 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d657d27-240e-4138-a1b1-386ed036cd96 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:26.227619 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d657d27-240e-4138-a1b1-386ed036cd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:26.228021 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d657d27-240e-4138-a1b1-386ed036cd96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:26.228681 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d657d27-240e-4138-a1b1-386ed036cd96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:40:26.228985 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d657d27-240e-4138-a1b1-386ed036cd96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:26.230749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d657d27-240e-4138-a1b1-386ed036cd96 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:26.244769 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1375/2736] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:40:26.249286 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d5f19-a80c-4312-918d-d871043e9b9a None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:26.258769 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d5f19-a80c-4312-918d-d871043e9b9a None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:26.263411 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e28588-4c2d-4ed3-ac74-9e5839a31cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:26.264035 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e28588-4c2d-4ed3-ac74-9e5839a31cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:26.264316 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e28588-4c2d-4ed3-ac74-9e5839a31cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:26.264584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e28588-4c2d-4ed3-ac74-9e5839a31cf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:26.265219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e28588-4c2d-4ed3-ac74-9e5839a31cf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:26.267221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e28588-4c2d-4ed3-ac74-9e5839a31cf9 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:26.294853 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1362/2737] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:40:26 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:40:26.299404 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d657d27-240e-4138-a1b1-386ed036cd96 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:26.309625 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d657d27-240e-4138-a1b1-386ed036cd96 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:26.368874 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37527646-0c94-4313-b430-d82d732e7de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:26.369506 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37527646-0c94-4313-b430-d82d732e7de2 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:26.369782 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37527646-0c94-4313-b430-d82d732e7de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:26.370049 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37527646-0c94-4313-b430-d82d732e7de2 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:26.370678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37527646-0c94-4313-b430-d82d732e7de2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:26.372641 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37527646-0c94-4313-b430-d82d732e7de2 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:26.393509 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1376/2738] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:40:26 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:40:26.397675 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e28588-4c2d-4ed3-ac74-9e5839a31cf9 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:26.408525 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e28588-4c2d-4ed3-ac74-9e5839a31cf9 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:26.413086 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb479d-0123-4f73-a123-65f5d2b4a4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:26.413677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb479d-0123-4f73-a123-65f5d2b4a4ea admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:26.413951 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb479d-0123-4f73-a123-65f5d2b4a4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:26.414217 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb479d-0123-4f73-a123-65f5d2b4a4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:26.414845 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb479d-0123-4f73-a123-65f5d2b4a4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:26.416508 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb479d-0123-4f73-a123-65f5d2b4a4ea admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:26.431201 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1363/2739] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:40:26.435385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37527646-0c94-4313-b430-d82d732e7de2 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:26.445922 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37527646-0c94-4313-b430-d82d732e7de2 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:26.450667 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0d897-4468-498e-9e48-d76920c56152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:26.451273 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0d897-4468-498e-9e48-d76920c56152 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:26.451552 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0d897-4468-498e-9e48-d76920c56152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:26.451882 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0d897-4468-498e-9e48-d76920c56152 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:26.452522 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0d897-4468-498e-9e48-d76920c56152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:26.454093 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0d897-4468-498e-9e48-d76920c56152 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:26.464677 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1377/2740] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:40:26.469352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb479d-0123-4f73-a123-65f5d2b4a4ea admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:26.479462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb479d-0123-4f73-a123-65f5d2b4a4ea admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:26.484095 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92b9ce-18c3-4ee1-806a-7918c7604fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:26.485559 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92b9ce-18c3-4ee1-806a-7918c7604fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:26.485866 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92b9ce-18c3-4ee1-806a-7918c7604fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:26.486151 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92b9ce-18c3-4ee1-806a-7918c7604fa2 admin admin] PATH_INFO: `/v3/projects/a6a5aec9fd1f4311ae2165b7901a4c64/users/eba285273f7542a18b224e16f2bec063/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:26.501386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92b9ce-18c3-4ee1-806a-7918c7604fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a5aec9fd1f4311ae2165b7901a4c64, user_id=eba285273f7542a18b224e16f2bec063, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:26.504120 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92b9ce-18c3-4ee1-806a-7918c7604fa2 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:26.517825 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1364/2741] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:40:26 2022] PUT /identity/v3/projects/a6a5aec9fd1f4311ae2165b7901a4c64/users/eba285273f7542a18b224e16f2bec063/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:40:26.528598 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4e0d0-9b49-42ff-be35-57375e11c28c None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:26.528883 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4e0d0-9b49-42ff-be35-57375e11c28c None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:26.529157 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4e0d0-9b49-42ff-be35-57375e11c28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:26.560262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-55f4e0d0-9b49-42ff-be35-57375e11c28c None None] MFA Rules not processed for user `eba285273f7542a18b224e16f2bec063`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:40:26.561404 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-55f4e0d0-9b49-42ff-be35-57375e11c28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:26.572230 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:40:26.628284 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1378/2742] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:40:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:40:26.639265 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92b9ce-18c3-4ee1-806a-7918c7604fa2 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:26.641657 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-4b92b9ce-18c3-4ee1-806a-7918c7604fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:26.698861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92b9ce-18c3-4ee1-806a-7918c7604fa2 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:26.702562 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd08b96-a5ef-4085-9bc2-2be6b27e4f12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:26.703676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd08b96-a5ef-4085-9bc2-2be6b27e4f12 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:26.704008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd08b96-a5ef-4085-9bc2-2be6b27e4f12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:26.704253 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd08b96-a5ef-4085-9bc2-2be6b27e4f12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:26.712603 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd08b96-a5ef-4085-9bc2-2be6b27e4f12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:26.714032 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd08b96-a5ef-4085-9bc2-2be6b27e4f12 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:26.723560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1365/2743] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:40:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:40:26.749043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4e0d0-9b49-42ff-be35-57375e11c28c None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:26.814630 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4e0d0-9b49-42ff-be35-57375e11c28c None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:26.819898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776da37c-1fb9-4dd4-9c26-a17ca05020d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:26.820605 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776da37c-1fb9-4dd4-9c26-a17ca05020d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:26.820979 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776da37c-1fb9-4dd4-9c26-a17ca05020d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:26.821791 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776da37c-1fb9-4dd4-9c26-a17ca05020d2 admin admin] PATH_INFO: `/v3/users/eba285273f7542a18b224e16f2bec063` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:26.823130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776da37c-1fb9-4dd4-9c26-a17ca05020d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eba285273f7542a18b224e16f2bec063)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:26.825079 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776da37c-1fb9-4dd4-9c26-a17ca05020d2 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:26.873270 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-776da37c-1fb9-4dd4-9c26-a17ca05020d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eba285273f7542a18b224e16f2bec063'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:26.873926 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-776da37c-1fb9-4dd4-9c26-a17ca05020d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eba285273f7542a18b224e16f2bec063'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:26.881795 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-776da37c-1fb9-4dd4-9c26-a17ca05020d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eba285273f7542a18b224e16f2bec063'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:26.894872 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-776da37c-1fb9-4dd4-9c26-a17ca05020d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eba285273f7542a18b224e16f2bec063'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:26.901719 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-776da37c-1fb9-4dd4-9c26-a17ca05020d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eba285273f7542a18b224e16f2bec063'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:26.908367 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1379/2744] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:40:26 2022] DELETE /identity/v3/users/eba285273f7542a18b224e16f2bec063 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:40:26.912972 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904892ec-4fed-434e-8cc8-154b550bf547 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:26.913254 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904892ec-4fed-434e-8cc8-154b550bf547 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:26.913534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904892ec-4fed-434e-8cc8-154b550bf547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:26.934131 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-904892ec-4fed-434e-8cc8-154b550bf547 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:40:26.935333 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-904892ec-4fed-434e-8cc8-154b550bf547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:26.952647 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:40:27.000649 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1366/2745] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:40:27.010939 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776da37c-1fb9-4dd4-9c26-a17ca05020d2 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:27.012385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-776da37c-1fb9-4dd4-9c26-a17ca05020d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:27.050226 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:40:27.086664 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776da37c-1fb9-4dd4-9c26-a17ca05020d2 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:27.091151 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c52eb-1de2-4247-8f74-a0597963d14d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:27.091858 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c52eb-1de2-4247-8f74-a0597963d14d service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:27.092281 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c52eb-1de2-4247-8f74-a0597963d14d service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:27.092667 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c52eb-1de2-4247-8f74-a0597963d14d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:27.104063 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c52eb-1de2-4247-8f74-a0597963d14d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:27.105507 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c52eb-1de2-4247-8f74-a0597963d14d service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:27.117405 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1380/2746] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:40:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:40:27.444641 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904892ec-4fed-434e-8cc8-154b550bf547 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:27.446151 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-904892ec-4fed-434e-8cc8-154b550bf547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:27.460048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904892ec-4fed-434e-8cc8-154b550bf547 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:27.465269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1ca86-07e3-4f2e-827c-7ddc266b5266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:27.466007 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1ca86-07e3-4f2e-827c-7ddc266b5266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:27.466308 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1ca86-07e3-4f2e-827c-7ddc266b5266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:27.466578 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1ca86-07e3-4f2e-827c-7ddc266b5266 admin admin] PATH_INFO: `/v3/projects/a6a5aec9fd1f4311ae2165b7901a4c64` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:27.469261 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1ca86-07e3-4f2e-827c-7ddc266b5266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6a5aec9fd1f4311ae2165b7901a4c64)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:27.471250 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1ca86-07e3-4f2e-827c-7ddc266b5266 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:27.519630 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-2ea1ca86-07e3-4f2e-827c-7ddc266b5266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6a5aec9fd1f4311ae2165b7901a4c64', 'request_id': 'req-2ea1ca86-07e3-4f2e-827c-7ddc266b5266'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:27.526192 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-2ea1ca86-07e3-4f2e-827c-7ddc266b5266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6a5aec9fd1f4311ae2165b7901a4c64', 'request_id': 'req-2ea1ca86-07e3-4f2e-827c-7ddc266b5266'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:27.536297 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-2ea1ca86-07e3-4f2e-827c-7ddc266b5266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6a5aec9fd1f4311ae2165b7901a4c64', 'request_id': 'req-2ea1ca86-07e3-4f2e-827c-7ddc266b5266'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:27.548400 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-2ea1ca86-07e3-4f2e-827c-7ddc266b5266 admin admin] The token cache is being invalidate because project a6a5aec9fd1f4311ae2165b7901a4c64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:40:27.548692 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-2ea1ca86-07e3-4f2e-827c-7ddc266b5266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:27.549346 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-2ea1ca86-07e3-4f2e-827c-7ddc266b5266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:27.551267 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1367/2747] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:40:27 2022] DELETE /identity/v3/projects/a6a5aec9fd1f4311ae2165b7901a4c64 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:40:27.557466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4f6eb-ac92-475b-a558-349c9a8c1297 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:27.558109 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4f6eb-ac92-475b-a558-349c9a8c1297 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:27.558218 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4f6eb-ac92-475b-a558-349c9a8c1297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:27.584931 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-bea4f6eb-ac92-475b-a558-349c9a8c1297 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:40:27.586161 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bea4f6eb-ac92-475b-a558-349c9a8c1297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:27.647325 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1381/2748] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:40:27.656082 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cf650-464a-4ab5-a887-26916ed20f7a None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:27.657651 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cf650-464a-4ab5-a887-26916ed20f7a None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:27.657938 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cf650-464a-4ab5-a887-26916ed20f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:27.679900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-ed2cf650-464a-4ab5-a887-26916ed20f7a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:40:27.681122 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-ed2cf650-464a-4ab5-a887-26916ed20f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:27.689683 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1368/2749] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:40:27.694478 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4f6eb-ac92-475b-a558-349c9a8c1297 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:27.705069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4f6eb-ac92-475b-a558-349c9a8c1297 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:27.709777 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b90804-d78b-4931-a152-4449e1795ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:27.710393 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b90804-d78b-4931-a152-4449e1795ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:27.710669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b90804-d78b-4931-a152-4449e1795ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:27.710942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b90804-d78b-4931-a152-4449e1795ea8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:27.711588 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b90804-d78b-4931-a152-4449e1795ea8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:40:27.711928 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b90804-d78b-4931-a152-4449e1795ea8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:27.713503 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b90804-d78b-4931-a152-4449e1795ea8 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:27.726523 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1382/2750] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:40:27.730872 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2cf650-464a-4ab5-a887-26916ed20f7a None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:27.740425 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2cf650-464a-4ab5-a887-26916ed20f7a None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:27.745375 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfae2e9-35d6-4ad3-8ec6-e81b727c9c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:27.745977 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfae2e9-35d6-4ad3-8ec6-e81b727c9c38 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:27.746252 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfae2e9-35d6-4ad3-8ec6-e81b727c9c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:27.746517 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfae2e9-35d6-4ad3-8ec6-e81b727c9c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:27.747138 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfae2e9-35d6-4ad3-8ec6-e81b727c9c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:27.749059 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfae2e9-35d6-4ad3-8ec6-e81b727c9c38 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:27.777258 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1369/2751] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:40:27 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:40:27.781539 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b90804-d78b-4931-a152-4449e1795ea8 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:27.791556 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b90804-d78b-4931-a152-4449e1795ea8 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:27.853176 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501de7b7-7b06-462e-8a33-868740789b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:27.853798 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501de7b7-7b06-462e-8a33-868740789b5f admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:27.854079 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501de7b7-7b06-462e-8a33-868740789b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:27.854351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501de7b7-7b06-462e-8a33-868740789b5f admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:27.855003 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501de7b7-7b06-462e-8a33-868740789b5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:27.856969 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501de7b7-7b06-462e-8a33-868740789b5f admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:27.879861 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1383/2752] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:40:27 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:40:27.884189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfae2e9-35d6-4ad3-8ec6-e81b727c9c38 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:27.895301 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfae2e9-35d6-4ad3-8ec6-e81b727c9c38 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:27.902485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852a53c-0153-47cd-b397-660c171a5215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:27.903017 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852a53c-0153-47cd-b397-660c171a5215 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:27.903293 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852a53c-0153-47cd-b397-660c171a5215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:27.903556 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852a53c-0153-47cd-b397-660c171a5215 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:27.904229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852a53c-0153-47cd-b397-660c171a5215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:27.905816 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852a53c-0153-47cd-b397-660c171a5215 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:27.916198 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1370/2753] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:40:27.920190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501de7b7-7b06-462e-8a33-868740789b5f admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:27.938252 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501de7b7-7b06-462e-8a33-868740789b5f admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:27.943418 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b761f-72b3-4117-b012-0f25e836d136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:27.944057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b761f-72b3-4117-b012-0f25e836d136 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:27.944337 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b761f-72b3-4117-b012-0f25e836d136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:27.944613 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b761f-72b3-4117-b012-0f25e836d136 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:27.945253 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b761f-72b3-4117-b012-0f25e836d136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:27.946849 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b761f-72b3-4117-b012-0f25e836d136 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:27.959272 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1384/2754] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:40:27.963951 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852a53c-0153-47cd-b397-660c171a5215 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:27.977768 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852a53c-0153-47cd-b397-660c171a5215 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:27.985370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba00381-2198-4127-8424-678a88c5186e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:27.986395 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba00381-2198-4127-8424-678a88c5186e admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:27.986706 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba00381-2198-4127-8424-678a88c5186e admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:27.987014 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba00381-2198-4127-8424-678a88c5186e admin admin] PATH_INFO: `/v3/projects/7e7930bce5294466b4b7adae30168483/users/5d2d378db8ff43b6baeab83920a87cfa/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:28.004697 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba00381-2198-4127-8424-678a88c5186e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e7930bce5294466b4b7adae30168483, user_id=5d2d378db8ff43b6baeab83920a87cfa, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:28.007953 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba00381-2198-4127-8424-678a88c5186e admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:28.025279 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1371/2755] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:40:27 2022] PUT /identity/v3/projects/7e7930bce5294466b4b7adae30168483/users/5d2d378db8ff43b6baeab83920a87cfa/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:40:28.036433 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aba48-846d-44eb-94f6-2952d069e790 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:28.036715 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aba48-846d-44eb-94f6-2952d069e790 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:28.036983 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aba48-846d-44eb-94f6-2952d069e790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:28.069219 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-a27aba48-846d-44eb-94f6-2952d069e790 None None] MFA Rules not processed for user `5d2d378db8ff43b6baeab83920a87cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:40:28.070465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a27aba48-846d-44eb-94f6-2952d069e790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:28.109974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:40:28.150334 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1385/2756] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:40:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:40:28.161617 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba00381-2198-4127-8424-678a88c5186e admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:28.163631 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-aba00381-2198-4127-8424-678a88c5186e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:28.209682 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:40:28.224559 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba00381-2198-4127-8424-678a88c5186e admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:28.228252 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d86eb-f305-48b0-9b02-38c3e1e5c7c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:28.228868 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d86eb-f305-48b0-9b02-38c3e1e5c7c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:28.230038 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d86eb-f305-48b0-9b02-38c3e1e5c7c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:28.230312 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d86eb-f305-48b0-9b02-38c3e1e5c7c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:28.241174 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d86eb-f305-48b0-9b02-38c3e1e5c7c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:28.243115 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d86eb-f305-48b0-9b02-38c3e1e5c7c7 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:28.251373 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1372/2757] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:40:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:40:29.394090 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27aba48-846d-44eb-94f6-2952d069e790 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:29.395563 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a27aba48-846d-44eb-94f6-2952d069e790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:29.463603 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27aba48-846d-44eb-94f6-2952d069e790 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:29.468299 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5faee-69fd-4227-b2a3-9ef6f87bf8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:29.469524 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5faee-69fd-4227-b2a3-9ef6f87bf8e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:29.469783 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5faee-69fd-4227-b2a3-9ef6f87bf8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:29.470053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5faee-69fd-4227-b2a3-9ef6f87bf8e1 admin admin] PATH_INFO: `/v3/users/e99cbf7640374152bff75993cdb8c042` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:29.471203 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5faee-69fd-4227-b2a3-9ef6f87bf8e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e99cbf7640374152bff75993cdb8c042)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:29.473266 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5faee-69fd-4227-b2a3-9ef6f87bf8e1 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:29.522369 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-68e5faee-69fd-4227-b2a3-9ef6f87bf8e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e99cbf7640374152bff75993cdb8c042'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:29.523047 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-68e5faee-69fd-4227-b2a3-9ef6f87bf8e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e99cbf7640374152bff75993cdb8c042'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:29.537371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-68e5faee-69fd-4227-b2a3-9ef6f87bf8e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e99cbf7640374152bff75993cdb8c042'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:29.551489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-68e5faee-69fd-4227-b2a3-9ef6f87bf8e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e99cbf7640374152bff75993cdb8c042'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:29.560347 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-68e5faee-69fd-4227-b2a3-9ef6f87bf8e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e99cbf7640374152bff75993cdb8c042'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:29.568009 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1386/2758] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:40:29 2022] DELETE /identity/v3/users/e99cbf7640374152bff75993cdb8c042 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:40:29.572661 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c45255-0a8f-4d47-9f13-c27ac842349f None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:29.573245 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c45255-0a8f-4d47-9f13-c27ac842349f None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:29.573245 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c45255-0a8f-4d47-9f13-c27ac842349f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:29.593772 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-45c45255-0a8f-4d47-9f13-c27ac842349f None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:40:29.594988 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-45c45255-0a8f-4d47-9f13-c27ac842349f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:29.657072 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1373/2759] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:40:29.667019 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5faee-69fd-4227-b2a3-9ef6f87bf8e1 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:29.668702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-68e5faee-69fd-4227-b2a3-9ef6f87bf8e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:29.727456 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:40:29.732093 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5faee-69fd-4227-b2a3-9ef6f87bf8e1 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:29.737519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869e78e-b094-4101-8362-f5b60e9800d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:29.738411 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869e78e-b094-4101-8362-f5b60e9800d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:29.738956 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869e78e-b094-4101-8362-f5b60e9800d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:29.739222 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869e78e-b094-4101-8362-f5b60e9800d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:29.750578 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869e78e-b094-4101-8362-f5b60e9800d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:29.752134 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869e78e-b094-4101-8362-f5b60e9800d4 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:29.762648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1387/2760] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:40:30.094175 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c45255-0a8f-4d47-9f13-c27ac842349f None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:30.095690 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-45c45255-0a8f-4d47-9f13-c27ac842349f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:30.111759 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c45255-0a8f-4d47-9f13-c27ac842349f None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:30.118057 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9e0fe-fe93-4523-8f8e-525894f2f82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:30.118729 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9e0fe-fe93-4523-8f8e-525894f2f82d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:30.118924 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9e0fe-fe93-4523-8f8e-525894f2f82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:30.119199 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9e0fe-fe93-4523-8f8e-525894f2f82d admin admin] PATH_INFO: `/v3/projects/8bc148636f524df994a6ca7a793a673e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:30.120373 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9e0fe-fe93-4523-8f8e-525894f2f82d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bc148636f524df994a6ca7a793a673e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:30.122283 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9e0fe-fe93-4523-8f8e-525894f2f82d admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:30.173731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-21a9e0fe-fe93-4523-8f8e-525894f2f82d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bc148636f524df994a6ca7a793a673e', 'request_id': 'req-21a9e0fe-fe93-4523-8f8e-525894f2f82d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:30.180238 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-21a9e0fe-fe93-4523-8f8e-525894f2f82d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bc148636f524df994a6ca7a793a673e', 'request_id': 'req-21a9e0fe-fe93-4523-8f8e-525894f2f82d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:30.188111 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-21a9e0fe-fe93-4523-8f8e-525894f2f82d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bc148636f524df994a6ca7a793a673e', 'request_id': 'req-21a9e0fe-fe93-4523-8f8e-525894f2f82d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:30.198831 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-21a9e0fe-fe93-4523-8f8e-525894f2f82d admin admin] The token cache is being invalidate because project 8bc148636f524df994a6ca7a793a673e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:40:30.199112 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-21a9e0fe-fe93-4523-8f8e-525894f2f82d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:30.199787 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-21a9e0fe-fe93-4523-8f8e-525894f2f82d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:30.201268 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1374/2761] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:40:30 2022] DELETE /identity/v3/projects/8bc148636f524df994a6ca7a793a673e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:40:30.206567 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53709a83-59bb-4abb-9902-7f8bef7a3d9a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:30.206858 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53709a83-59bb-4abb-9902-7f8bef7a3d9a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:30.207155 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53709a83-59bb-4abb-9902-7f8bef7a3d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:30.228452 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-53709a83-59bb-4abb-9902-7f8bef7a3d9a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:40:30.229658 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-53709a83-59bb-4abb-9902-7f8bef7a3d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:30.290991 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1388/2762] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:40:30.299465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6df786-b15b-491b-8c98-799aa9c9fb1b None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:30.299780 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6df786-b15b-491b-8c98-799aa9c9fb1b None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:30.300054 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6df786-b15b-491b-8c98-799aa9c9fb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:30.321610 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-0c6df786-b15b-491b-8c98-799aa9c9fb1b None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:40:30.322846 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-0c6df786-b15b-491b-8c98-799aa9c9fb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:30.330888 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1375/2763] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:40:30.335423 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53709a83-59bb-4abb-9902-7f8bef7a3d9a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:30.345708 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53709a83-59bb-4abb-9902-7f8bef7a3d9a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:30.350425 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5bf26-228f-411a-b84d-e76b463d37dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:30.351045 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5bf26-228f-411a-b84d-e76b463d37dd admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:30.351314 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5bf26-228f-411a-b84d-e76b463d37dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:30.351582 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5bf26-228f-411a-b84d-e76b463d37dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:30.352255 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5bf26-228f-411a-b84d-e76b463d37dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:40:30.352551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5bf26-228f-411a-b84d-e76b463d37dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:30.354137 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5bf26-228f-411a-b84d-e76b463d37dd admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:30.368001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1389/2764] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:40:30.372721 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6df786-b15b-491b-8c98-799aa9c9fb1b None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:30.382826 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6df786-b15b-491b-8c98-799aa9c9fb1b None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:30.387647 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127cde20-9c2d-400a-b21e-ee62676d83df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:30.388304 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cde20-9c2d-400a-b21e-ee62676d83df admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:30.388583 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cde20-9c2d-400a-b21e-ee62676d83df admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:30.388854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cde20-9c2d-400a-b21e-ee62676d83df admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:30.389502 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127cde20-9c2d-400a-b21e-ee62676d83df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:30.392516 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127cde20-9c2d-400a-b21e-ee62676d83df admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:30.423393 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1376/2765] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:40:30 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:40:30.428053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5bf26-228f-411a-b84d-e76b463d37dd admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:30.438550 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5bf26-228f-411a-b84d-e76b463d37dd admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:30.503110 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a64df2-f190-4c18-8bea-6b51d9b56831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:30.503750 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a64df2-f190-4c18-8bea-6b51d9b56831 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:30.504051 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a64df2-f190-4c18-8bea-6b51d9b56831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:30.504339 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a64df2-f190-4c18-8bea-6b51d9b56831 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:30.504986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a64df2-f190-4c18-8bea-6b51d9b56831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:30.506911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a64df2-f190-4c18-8bea-6b51d9b56831 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:30.529489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1390/2766] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:40:30 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:40:30.534378 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127cde20-9c2d-400a-b21e-ee62676d83df admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:30.545354 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127cde20-9c2d-400a-b21e-ee62676d83df admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:30.550165 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555731a-9ab4-443e-8541-6307378477cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:30.550765 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555731a-9ab4-443e-8541-6307378477cf admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:30.551050 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555731a-9ab4-443e-8541-6307378477cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:30.551318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555731a-9ab4-443e-8541-6307378477cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:30.552011 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555731a-9ab4-443e-8541-6307378477cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:30.553617 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555731a-9ab4-443e-8541-6307378477cf admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:30.565483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1377/2767] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:40:30.569801 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a64df2-f190-4c18-8bea-6b51d9b56831 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:30.580824 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a64df2-f190-4c18-8bea-6b51d9b56831 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:30.585558 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b68c6-a1d3-4f82-a345-ee4e9a81056d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:30.586171 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b68c6-a1d3-4f82-a345-ee4e9a81056d admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:30.586448 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b68c6-a1d3-4f82-a345-ee4e9a81056d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:30.586737 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b68c6-a1d3-4f82-a345-ee4e9a81056d admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:30.587383 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b68c6-a1d3-4f82-a345-ee4e9a81056d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:30.589040 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b68c6-a1d3-4f82-a345-ee4e9a81056d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:30.600929 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1391/2768] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:40:30.605125 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555731a-9ab4-443e-8541-6307378477cf admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:30.615167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555731a-9ab4-443e-8541-6307378477cf admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:30.620276 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57309d2-4e13-46b6-beb8-055c6711192c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:30.620946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57309d2-4e13-46b6-beb8-055c6711192c admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:30.621211 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57309d2-4e13-46b6-beb8-055c6711192c admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:30.621485 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57309d2-4e13-46b6-beb8-055c6711192c admin admin] PATH_INFO: `/v3/projects/a30fde9ad26d43aa95a059709a384bbb/users/e64ad0ccec3d40e399e23563d4d7eb39/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:30.637986 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57309d2-4e13-46b6-beb8-055c6711192c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a30fde9ad26d43aa95a059709a384bbb, user_id=e64ad0ccec3d40e399e23563d4d7eb39, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:30.641257 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57309d2-4e13-46b6-beb8-055c6711192c admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:30.654448 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1378/2769] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:40:30 2022] PUT /identity/v3/projects/a30fde9ad26d43aa95a059709a384bbb/users/e64ad0ccec3d40e399e23563d4d7eb39/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:40:30.660536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc2484-33b0-48e6-aa19-0cf1c5319da1 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:30.660819 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc2484-33b0-48e6-aa19-0cf1c5319da1 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:30.661115 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc2484-33b0-48e6-aa19-0cf1c5319da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:30.684558 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-56dc2484-33b0-48e6-aa19-0cf1c5319da1 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:40:30.685886 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-56dc2484-33b0-48e6-aa19-0cf1c5319da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:30.740820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:40:30.753748 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1392/2770] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:40:30.763382 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57309d2-4e13-46b6-beb8-055c6711192c admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:30.765894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-c57309d2-4e13-46b6-beb8-055c6711192c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:30.773090 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:40:30.831585 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57309d2-4e13-46b6-beb8-055c6711192c admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:30.836278 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c937b4-579a-4891-ae0f-65d9b44847bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:30.836964 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c937b4-579a-4891-ae0f-65d9b44847bb service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:30.837245 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c937b4-579a-4891-ae0f-65d9b44847bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:30.837516 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c937b4-579a-4891-ae0f-65d9b44847bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:30.848461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c937b4-579a-4891-ae0f-65d9b44847bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:30.849929 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c937b4-579a-4891-ae0f-65d9b44847bb service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:30.860499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1379/2771] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:40:31.589943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4f53d-f74a-4dac-ab15-50e7fc6666eb None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:31.590422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4f53d-f74a-4dac-ab15-50e7fc6666eb None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:31.590517 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4f53d-f74a-4dac-ab15-50e7fc6666eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:31.630399 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-d5a4f53d-f74a-4dac-ab15-50e7fc6666eb None None] MFA Rules not processed for user `e64ad0ccec3d40e399e23563d4d7eb39`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:40:31.631465 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d5a4f53d-f74a-4dac-ab15-50e7fc6666eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:31.711747 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1393/2772] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:40:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:40:31.722501 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c937b4-579a-4891-ae0f-65d9b44847bb service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:31.724520 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-c5c937b4-579a-4891-ae0f-65d9b44847bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:31.787807 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c937b4-579a-4891-ae0f-65d9b44847bb service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:31.792061 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085d524-c3cc-4b9c-8579-b6bcfbcb3283 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:31.792691 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085d524-c3cc-4b9c-8579-b6bcfbcb3283 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:31.792966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085d524-c3cc-4b9c-8579-b6bcfbcb3283 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:31.793235 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085d524-c3cc-4b9c-8579-b6bcfbcb3283 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:31.802386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085d524-c3cc-4b9c-8579-b6bcfbcb3283 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:31.803854 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085d524-c3cc-4b9c-8579-b6bcfbcb3283 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:31.813847 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1380/2773] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:40:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:40:33.213796 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd35b8-857e-421d-8247-0fb9dcb37d4f None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:33.214389 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd35b8-857e-421d-8247-0fb9dcb37d4f None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:33.214495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd35b8-857e-421d-8247-0fb9dcb37d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:33.236306 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-bedd35b8-857e-421d-8247-0fb9dcb37d4f None None] MFA Rules not processed for user `e64ad0ccec3d40e399e23563d4d7eb39`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:40:33.237867 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bedd35b8-857e-421d-8247-0fb9dcb37d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:33.245411 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1394/2774] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:40:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:40:36.721281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085d524-c3cc-4b9c-8579-b6bcfbcb3283 service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:36.722751 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a085d524-c3cc-4b9c-8579-b6bcfbcb3283 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:36.800415 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085d524-c3cc-4b9c-8579-b6bcfbcb3283 service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:36.805819 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255b906-9bd3-48a6-b14f-71781f0e679b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:36.806421 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255b906-9bd3-48a6-b14f-71781f0e679b service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:36.806821 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255b906-9bd3-48a6-b14f-71781f0e679b service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:36.807094 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255b906-9bd3-48a6-b14f-71781f0e679b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:36.808930 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-1255b906-9bd3-48a6-b14f-71781f0e679b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:36.823100 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255b906-9bd3-48a6-b14f-71781f0e679b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:36.825166 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255b906-9bd3-48a6-b14f-71781f0e679b service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:36.837281 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1381/2775] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:40:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:40:38.545735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd35b8-857e-421d-8247-0fb9dcb37d4f None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:38.547268 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-bedd35b8-857e-421d-8247-0fb9dcb37d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:38.560735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd35b8-857e-421d-8247-0fb9dcb37d4f None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:38.565911 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00fd81-c499-441c-a324-b47b68091f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:38.566536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00fd81-c499-441c-a324-b47b68091f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:38.566813 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00fd81-c499-441c-a324-b47b68091f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:38.567084 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00fd81-c499-441c-a324-b47b68091f60 admin admin] PATH_INFO: `/v3/users/5d2d378db8ff43b6baeab83920a87cfa` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:38.568491 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00fd81-c499-441c-a324-b47b68091f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d2d378db8ff43b6baeab83920a87cfa)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:38.570375 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00fd81-c499-441c-a324-b47b68091f60 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:38.619785 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-7a00fd81-c499-441c-a324-b47b68091f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d2d378db8ff43b6baeab83920a87cfa'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:38.620463 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-7a00fd81-c499-441c-a324-b47b68091f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d2d378db8ff43b6baeab83920a87cfa'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:38.633579 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-7a00fd81-c499-441c-a324-b47b68091f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d2d378db8ff43b6baeab83920a87cfa'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:38.646308 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-7a00fd81-c499-441c-a324-b47b68091f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d2d378db8ff43b6baeab83920a87cfa'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:38.653107 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-7a00fd81-c499-441c-a324-b47b68091f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d2d378db8ff43b6baeab83920a87cfa'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:38.658943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1395/2776] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:40:38 2022] DELETE /identity/v3/users/5d2d378db8ff43b6baeab83920a87cfa => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:40:38.663700 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a767a9-6498-4e03-9a6a-69d0ca5b7d49 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:38.664369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a767a9-6498-4e03-9a6a-69d0ca5b7d49 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:38.664369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a767a9-6498-4e03-9a6a-69d0ca5b7d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:38.684335 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-e1a767a9-6498-4e03-9a6a-69d0ca5b7d49 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:40:38.685539 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e1a767a9-6498-4e03-9a6a-69d0ca5b7d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:38.716543 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=100 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:40:38.747191 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1382/2777] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:40:38.757753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00fd81-c499-441c-a324-b47b68091f60 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:38.759290 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7a00fd81-c499-441c-a324-b47b68091f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:38.823639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00fd81-c499-441c-a324-b47b68091f60 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:38.827165 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa12d3-4ec4-4031-86d8-c9c90905435c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:38.827847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa12d3-4ec4-4031-86d8-c9c90905435c service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:38.828127 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa12d3-4ec4-4031-86d8-c9c90905435c service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:38.828602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa12d3-4ec4-4031-86d8-c9c90905435c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:38.835601 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:40:38.838098 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa12d3-4ec4-4031-86d8-c9c90905435c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:38.839990 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa12d3-4ec4-4031-86d8-c9c90905435c service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:38.851288 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1396/2778] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:40:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:40:39.168149 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a767a9-6498-4e03-9a6a-69d0ca5b7d49 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:40:39.169584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-e1a767a9-6498-4e03-9a6a-69d0ca5b7d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:40:39.182918 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a767a9-6498-4e03-9a6a-69d0ca5b7d49 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:40:39.187685 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3966ae-e77a-40a1-a450-fbdabe9ca16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:40:39.188499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3966ae-e77a-40a1-a450-fbdabe9ca16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:40:39.188785 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3966ae-e77a-40a1-a450-fbdabe9ca16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:40:39.189053 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3966ae-e77a-40a1-a450-fbdabe9ca16d admin admin] PATH_INFO: `/v3/projects/7e7930bce5294466b4b7adae30168483` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:40:39.197541 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3966ae-e77a-40a1-a450-fbdabe9ca16d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e7930bce5294466b4b7adae30168483)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:40:39.199492 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3966ae-e77a-40a1-a450-fbdabe9ca16d admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:40:39.247873 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-7f3966ae-e77a-40a1-a450-fbdabe9ca16d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e7930bce5294466b4b7adae30168483', 'request_id': 'req-7f3966ae-e77a-40a1-a450-fbdabe9ca16d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:39.254104 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-7f3966ae-e77a-40a1-a450-fbdabe9ca16d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e7930bce5294466b4b7adae30168483', 'request_id': 'req-7f3966ae-e77a-40a1-a450-fbdabe9ca16d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:39.260976 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-7f3966ae-e77a-40a1-a450-fbdabe9ca16d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e7930bce5294466b4b7adae30168483', 'request_id': 'req-7f3966ae-e77a-40a1-a450-fbdabe9ca16d'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:39.272073 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-7f3966ae-e77a-40a1-a450-fbdabe9ca16d admin admin] The token cache is being invalidate because project 7e7930bce5294466b4b7adae30168483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:40:39.272358 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-7f3966ae-e77a-40a1-a450-fbdabe9ca16d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:39.272994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-7f3966ae-e77a-40a1-a450-fbdabe9ca16d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:40:39.274481 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1383/2779] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:40:39 2022] DELETE /identity/v3/projects/7e7930bce5294466b4b7adae30168483 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:40:48.851985 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=2 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:40:49.269162 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=38,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:41:11.111868 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7523cd-70ef-46e8-8b4a-b926f8bdb2c5 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:41:11.112496 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7523cd-70ef-46e8-8b4a-b926f8bdb2c5 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:41:11.112496 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7523cd-70ef-46e8-8b4a-b926f8bdb2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:41:11.134178 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-5a7523cd-70ef-46e8-8b4a-b926f8bdb2c5 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:41:11.135408 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5a7523cd-70ef-46e8-8b4a-b926f8bdb2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:41:11.203782 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1397/2780] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Oct 4 14:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:41:11.227642 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3966ae-e77a-40a1-a450-fbdabe9ca16d admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:41:11.229152 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-7f3966ae-e77a-40a1-a450-fbdabe9ca16d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:41:11.306463 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3966ae-e77a-40a1-a450-fbdabe9ca16d admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:41:11.311944 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae82787-9357-4f86-911c-b78a3eaf0433 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:41:11.312548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae82787-9357-4f86-911c-b78a3eaf0433 service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:41:11.312824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae82787-9357-4f86-911c-b78a3eaf0433 service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:41:11.313263 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae82787-9357-4f86-911c-b78a3eaf0433 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:41:11.322078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae82787-9357-4f86-911c-b78a3eaf0433 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:41:11.323695 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae82787-9357-4f86-911c-b78a3eaf0433 service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:41:11.334379 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1384/2781] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:41:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:41:13.163311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af018d-7006-4a11-8ba9-af935bb92261 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:41:13.163860 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af018d-7006-4a11-8ba9-af935bb92261 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:41:13.163860 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af018d-7006-4a11-8ba9-af935bb92261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:41:13.182452 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-07af018d-7006-4a11-8ba9-af935bb92261 None None] MFA Rules not processed for user `3f869ad16f0943ed97bfe91472f929e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:41:13.183631 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-07af018d-7006-4a11-8ba9-af935bb92261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:41:13.245454 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1398/2782] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:41:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:41:15.241236 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0479ebb-178c-49f2-87bd-f5205d7c1b4c None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:41:15.241761 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0479ebb-178c-49f2-87bd-f5205d7c1b4c None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:41:15.242008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0479ebb-178c-49f2-87bd-f5205d7c1b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:41:15.267511 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-f0479ebb-178c-49f2-87bd-f5205d7c1b4c None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:41:15.268880 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f0479ebb-178c-49f2-87bd-f5205d7c1b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:41:15.289101 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1385/2783] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Oct 4 14:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:41:15.311406 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af018d-7006-4a11-8ba9-af935bb92261 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:41:15.313974 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-07af018d-7006-4a11-8ba9-af935bb92261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:41:15.340462 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af018d-7006-4a11-8ba9-af935bb92261 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:41:15.347410 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18aee5-7554-4d6b-875d-f61208c4db01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:41:15.348084 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18aee5-7554-4d6b-875d-f61208c4db01 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:41:15.348362 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18aee5-7554-4d6b-875d-f61208c4db01 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:41:15.348637 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18aee5-7554-4d6b-875d-f61208c4db01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:41:15.365572 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18aee5-7554-4d6b-875d-f61208c4db01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:41:15.367188 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18aee5-7554-4d6b-875d-f61208c4db01 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:41:15.379051 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1399/2784] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:41:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:41:19.578575 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0411b-efb4-43c9-959f-5d501e6cad55 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:41:19.579621 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0411b-efb4-43c9-959f-5d501e6cad55 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:41:19.579621 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0411b-efb4-43c9-959f-5d501e6cad55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:41:19.600062 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-f3a0411b-efb4-43c9-959f-5d501e6cad55 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:41:19.601337 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f3a0411b-efb4-43c9-959f-5d501e6cad55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:41:19.610505 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1386/2785] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Oct 4 14:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:41:19.631602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18aee5-7554-4d6b-875d-f61208c4db01 service nova] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:41:19.643031 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18aee5-7554-4d6b-875d-f61208c4db01 service nova] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:41:19.648616 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc7e5b-3d19-4435-bd95-de2bdc571d7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:41:19.649213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc7e5b-3d19-4435-bd95-de2bdc571d7b service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:41:19.649486 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc7e5b-3d19-4435-bd95-de2bdc571d7b service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:41:19.649753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc7e5b-3d19-4435-bd95-de2bdc571d7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:41:19.659224 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc7e5b-3d19-4435-bd95-de2bdc571d7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:41:19.660963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc7e5b-3d19-4435-bd95-de2bdc571d7b service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:41:19.671340 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1400/2786] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:41:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:41:24.423770 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0411b-efb4-43c9-959f-5d501e6cad55 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:41:24.438499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0411b-efb4-43c9-959f-5d501e6cad55 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:41:24.444427 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eff4df-eb9b-45c9-a75b-eaf5ccec4734 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:41:24.445370 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eff4df-eb9b-45c9-a75b-eaf5ccec4734 service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:41:24.445860 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eff4df-eb9b-45c9-a75b-eaf5ccec4734 service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:41:24.446344 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eff4df-eb9b-45c9-a75b-eaf5ccec4734 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:41:24.448313 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-74eff4df-eb9b-45c9-a75b-eaf5ccec4734 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:41:24.462474 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eff4df-eb9b-45c9-a75b-eaf5ccec4734 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:41:24.464141 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eff4df-eb9b-45c9-a75b-eaf5ccec4734 service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:41:24.488167 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1387/2787] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:41:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:41:24.760185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c42cb-9a37-427f-9078-c35fca74d5a7 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:41:24.760680 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c42cb-9a37-427f-9078-c35fca74d5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:41:24.760782 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c42cb-9a37-427f-9078-c35fca74d5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:41:24.780712 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ee1c42cb-9a37-427f-9078-c35fca74d5a7 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:41:24.782520 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ee1c42cb-9a37-427f-9078-c35fca74d5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:41:24.790520 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1401/2788] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Oct 4 14:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:41:24.811834 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eff4df-eb9b-45c9-a75b-eaf5ccec4734 service nova] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:41:24.823348 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eff4df-eb9b-45c9-a75b-eaf5ccec4734 service nova] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:41:24.829746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84d878-261a-4221-adb4-41e8174ef943 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:41:24.830345 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84d878-261a-4221-adb4-41e8174ef943 service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:41:24.830647 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84d878-261a-4221-adb4-41e8174ef943 service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:41:24.830919 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84d878-261a-4221-adb4-41e8174ef943 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:41:24.839047 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84d878-261a-4221-adb4-41e8174ef943 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:41:24.840649 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84d878-261a-4221-adb4-41e8174ef943 service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:41:24.850442 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1388/2789] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:41:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:41:30.009949 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dfb6a-f3c1-440a-bec5-641f91406fb0 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:41:30.010466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dfb6a-f3c1-440a-bec5-641f91406fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:41:30.010466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dfb6a-f3c1-440a-bec5-641f91406fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:41:30.032782 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-235dfb6a-f3c1-440a-bec5-641f91406fb0 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:41:30.034263 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-235dfb6a-f3c1-440a-bec5-641f91406fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:41:30.042903 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1402/2790] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Oct 4 14:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:41:30.064824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84d878-261a-4221-adb4-41e8174ef943 service nova] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:41:30.077312 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84d878-261a-4221-adb4-41e8174ef943 service nova] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:41:30.085664 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bd02e-559c-4c93-acad-8795396e3be9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:41:30.087046 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bd02e-559c-4c93-acad-8795396e3be9 service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:41:30.087512 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bd02e-559c-4c93-acad-8795396e3be9 service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:41:30.087992 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bd02e-559c-4c93-acad-8795396e3be9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:41:30.100718 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392bd02e-559c-4c93-acad-8795396e3be9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:41:30.103199 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392bd02e-559c-4c93-acad-8795396e3be9 service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:41:30.117311 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1389/2791] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:41:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:41:35.243594 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959e255-035d-44a3-9402-f1b083513924 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:41:35.244250 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959e255-035d-44a3-9402-f1b083513924 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:41:35.244250 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959e255-035d-44a3-9402-f1b083513924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:41:35.269602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-6959e255-035d-44a3-9402-f1b083513924 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:41:35.270835 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6959e255-035d-44a3-9402-f1b083513924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:41:35.279185 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1403/2792] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Oct 4 14:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:41:35.301348 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bd02e-559c-4c93-acad-8795396e3be9 service nova] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:41:35.313449 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bd02e-559c-4c93-acad-8795396e3be9 service nova] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:41:35.319165 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70710730-dae3-48df-a162-b3c126fe5b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:41:35.319785 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70710730-dae3-48df-a162-b3c126fe5b2d service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:41:35.320062 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70710730-dae3-48df-a162-b3c126fe5b2d service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:41:35.320329 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70710730-dae3-48df-a162-b3c126fe5b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:41:35.329870 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70710730-dae3-48df-a162-b3c126fe5b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:41:35.331464 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70710730-dae3-48df-a162-b3c126fe5b2d service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:41:35.342051 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1390/2793] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:41:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:41:45.262379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=73 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:41:45.337320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=64 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:41:51.626211 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3804ca2-7361-4938-be28-7add18e944ee None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:41:51.626948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3804ca2-7361-4938-be28-7add18e944ee None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:41:51.626948 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3804ca2-7361-4938-be28-7add18e944ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:41:51.649198 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-d3804ca2-7361-4938-be28-7add18e944ee None None] MFA Rules not processed for user `e64ad0ccec3d40e399e23563d4d7eb39`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:41:51.650580 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d3804ca2-7361-4938-be28-7add18e944ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:41:51.734335 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1404/2794] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:41:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:41:52.005335 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70710730-dae3-48df-a162-b3c126fe5b2d service nova] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:41:52.007135 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-70710730-dae3-48df-a162-b3c126fe5b2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:41:52.081388 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70710730-dae3-48df-a162-b3c126fe5b2d service nova] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:41:52.085311 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680be03-03f9-451d-97bb-f1c3c1e350c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:41:52.085975 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680be03-03f9-451d-97bb-f1c3c1e350c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:41:52.086257 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680be03-03f9-451d-97bb-f1c3c1e350c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:41:52.086527 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680be03-03f9-451d-97bb-f1c3c1e350c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:41:52.088378 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-0680be03-03f9-451d-97bb-f1c3c1e350c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:41:52.099780 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680be03-03f9-451d-97bb-f1c3c1e350c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:41:52.101265 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680be03-03f9-451d-97bb-f1c3c1e350c5 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:41:52.112006 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1391/2795] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:41:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:42:01.726758 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=25 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:42:02.106349 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=26 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:42:06.074126 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a063aea-c4ec-44c7-b38b-5113825a5993 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:42:06.074713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a063aea-c4ec-44c7-b38b-5113825a5993 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:42:06.074713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a063aea-c4ec-44c7-b38b-5113825a5993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:42:06.096092 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-8a063aea-c4ec-44c7-b38b-5113825a5993 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:42:06.097364 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8a063aea-c4ec-44c7-b38b-5113825a5993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:42:06.105145 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1405/2796] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Oct 4 14:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:42:06.125911 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680be03-03f9-451d-97bb-f1c3c1e350c5 service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:42:06.139123 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680be03-03f9-451d-97bb-f1c3c1e350c5 service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:42:06.145357 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9a48f-0706-4578-9ba4-538239996b93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:42:06.145953 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9a48f-0706-4578-9ba4-538239996b93 service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:42:06.146228 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9a48f-0706-4578-9ba4-538239996b93 service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:42:06.146505 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9a48f-0706-4578-9ba4-538239996b93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:42:06.154709 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9a48f-0706-4578-9ba4-538239996b93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:42:06.156544 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9a48f-0706-4578-9ba4-538239996b93 service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:42:06.166028 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1392/2797] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:42:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:42:09.985263 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a063aea-c4ec-44c7-b38b-5113825a5993 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:42:09.986701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-8a063aea-c4ec-44c7-b38b-5113825a5993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:42:09.999869 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a063aea-c4ec-44c7-b38b-5113825a5993 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:42:10.004086 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e56a3-6d21-4946-a105-37d5761932f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:42:10.004699 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e56a3-6d21-4946-a105-37d5761932f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:42:10.004996 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e56a3-6d21-4946-a105-37d5761932f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:42:10.005269 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e56a3-6d21-4946-a105-37d5761932f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:42:10.006978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f80e56a3-6d21-4946-a105-37d5761932f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:42:10.068143 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e56a3-6d21-4946-a105-37d5761932f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:42:10.075844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e56a3-6d21-4946-a105-37d5761932f7 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:42:10.080195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1406/2798] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:42:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:42:10.379859 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cc75f-2167-41a0-a629-fee98acc4357 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:42:10.380412 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cc75f-2167-41a0-a629-fee98acc4357 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:42:10.380412 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cc75f-2167-41a0-a629-fee98acc4357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:42:10.401429 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-be9cc75f-2167-41a0-a629-fee98acc4357 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:42:10.402646 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-be9cc75f-2167-41a0-a629-fee98acc4357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:42:10.411267 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1393/2799] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Oct 4 14:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:42:10.432868 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e56a3-6d21-4946-a105-37d5761932f7 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:42:10.447006 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e56a3-6d21-4946-a105-37d5761932f7 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:42:10.452937 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9f7a6-43bd-4fb8-a873-bcb74dcf6d86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:42:10.453552 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9f7a6-43bd-4fb8-a873-bcb74dcf6d86 service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:42:10.453835 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9f7a6-43bd-4fb8-a873-bcb74dcf6d86 service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:42:10.454106 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9f7a6-43bd-4fb8-a873-bcb74dcf6d86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:42:10.463137 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9f7a6-43bd-4fb8-a873-bcb74dcf6d86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:42:10.465184 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9f7a6-43bd-4fb8-a873-bcb74dcf6d86 service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:42:10.476665 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1407/2800] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:42:11.224474 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9cc75f-2167-41a0-a629-fee98acc4357 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:42:11.240582 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9cc75f-2167-41a0-a629-fee98acc4357 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:42:11.251329 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef88d3-9a61-4c7a-a2ff-85165be8850d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:42:11.251987 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef88d3-9a61-4c7a-a2ff-85165be8850d service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:42:11.252264 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef88d3-9a61-4c7a-a2ff-85165be8850d service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:42:11.252552 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef88d3-9a61-4c7a-a2ff-85165be8850d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:42:11.254319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-24ef88d3-9a61-4c7a-a2ff-85165be8850d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:42:11.268754 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef88d3-9a61-4c7a-a2ff-85165be8850d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:42:11.270388 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef88d3-9a61-4c7a-a2ff-85165be8850d service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:42:11.283474 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1394/2801] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:42:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:42:14.536953 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c7aba-2da4-4158-a9a6-62e2fd4fe162 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:42:14.537519 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c7aba-2da4-4158-a9a6-62e2fd4fe162 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:42:14.537667 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c7aba-2da4-4158-a9a6-62e2fd4fe162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:42:14.560959 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-783c7aba-2da4-4158-a9a6-62e2fd4fe162 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:42:14.563090 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-783c7aba-2da4-4158-a9a6-62e2fd4fe162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:42:14.578706 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1408/2802] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Oct 4 14:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:42:14.602548 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef88d3-9a61-4c7a-a2ff-85165be8850d service nova] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:42:14.614089 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef88d3-9a61-4c7a-a2ff-85165be8850d service nova] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:42:14.619675 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa637ee-ea3c-4657-952a-e2e970874a18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:42:14.620326 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa637ee-ea3c-4657-952a-e2e970874a18 service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:42:14.620602 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa637ee-ea3c-4657-952a-e2e970874a18 service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:42:14.620935 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa637ee-ea3c-4657-952a-e2e970874a18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:42:14.630118 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa637ee-ea3c-4657-952a-e2e970874a18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:42:14.632454 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa637ee-ea3c-4657-952a-e2e970874a18 service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:42:14.647839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1395/2803] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:42:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:42:17.592186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c7aba-2da4-4158-a9a6-62e2fd4fe162 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:42:17.603031 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c7aba-2da4-4158-a9a6-62e2fd4fe162 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:42:17.606727 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30897e32-aa43-4aaf-8ae3-b5d5b12fb9b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:42:17.607316 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30897e32-aa43-4aaf-8ae3-b5d5b12fb9b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:42:17.607589 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30897e32-aa43-4aaf-8ae3-b5d5b12fb9b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:42:17.607964 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30897e32-aa43-4aaf-8ae3-b5d5b12fb9b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:42:17.609949 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-30897e32-aa43-4aaf-8ae3-b5d5b12fb9b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:42:17.622430 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30897e32-aa43-4aaf-8ae3-b5d5b12fb9b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:42:17.623997 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30897e32-aa43-4aaf-8ae3-b5d5b12fb9b3 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:42:17.634342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1409/2804] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:42:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:42:18.735460 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f4084-d037-406a-a51c-920009f13349 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:42:18.735994 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f4084-d037-406a-a51c-920009f13349 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:42:18.736116 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f4084-d037-406a-a51c-920009f13349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:42:18.756188 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-a99f4084-d037-406a-a51c-920009f13349 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:42:18.757398 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a99f4084-d037-406a-a51c-920009f13349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:42:18.765735 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1396/2805] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Oct 4 14:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:42:18.800881 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30897e32-aa43-4aaf-8ae3-b5d5b12fb9b3 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:42:18.813344 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30897e32-aa43-4aaf-8ae3-b5d5b12fb9b3 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:42:18.819072 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddb21b-ac0c-4501-b75a-3b0080ac961c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:42:18.819675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddb21b-ac0c-4501-b75a-3b0080ac961c service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:42:18.819977 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddb21b-ac0c-4501-b75a-3b0080ac961c service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:42:18.820242 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddb21b-ac0c-4501-b75a-3b0080ac961c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:42:18.829021 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddb21b-ac0c-4501-b75a-3b0080ac961c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:42:18.830683 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddb21b-ac0c-4501-b75a-3b0080ac961c service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:42:18.840633 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1410/2806] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:42:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 14:42:20.732078 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f4084-d037-406a-a51c-920009f13349 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:42:20.734434 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a99f4084-d037-406a-a51c-920009f13349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:42:20.814955 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f4084-d037-406a-a51c-920009f13349 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:42:20.820645 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751c09f-74e6-439d-8415-90180f39afaf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f98c07455a241398784d221df273aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:42:20.821421 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751c09f-74e6-439d-8415-90180f39afaf service placement] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:42:20.821702 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751c09f-74e6-439d-8415-90180f39afaf service placement] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:42:20.821982 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751c09f-74e6-439d-8415-90180f39afaf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:42:20.823912 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-3751c09f-74e6-439d-8415-90180f39afaf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:42:20.836497 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751c09f-74e6-439d-8415-90180f39afaf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:42:20.838140 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751c09f-74e6-439d-8415-90180f39afaf service placement] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:42:20.849739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1397/2807] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:42:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:42:22.985365 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cdd4c-1ee1-4445-8cef-12af50e10273 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:42:22.986268 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cdd4c-1ee1-4445-8cef-12af50e10273 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:42:22.986268 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cdd4c-1ee1-4445-8cef-12af50e10273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:42:23.008085 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-f69cdd4c-1ee1-4445-8cef-12af50e10273 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:42:23.009332 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f69cdd4c-1ee1-4445-8cef-12af50e10273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:42:23.018941 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1411/2808] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Oct 4 14:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:42:23.043482 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751c09f-74e6-439d-8415-90180f39afaf service placement] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:42:23.065841 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751c09f-74e6-439d-8415-90180f39afaf service placement] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:42:23.080829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7fc42-d4c4-43e9-91a6-241500d897e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:42:23.081482 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7fc42-d4c4-43e9-91a6-241500d897e3 service nova] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:42:23.081751 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7fc42-d4c4-43e9-91a6-241500d897e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:42:23.082195 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7fc42-d4c4-43e9-91a6-241500d897e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:42:23.092632 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7fc42-d4c4-43e9-91a6-241500d897e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:42:23.094273 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7fc42-d4c4-43e9-91a6-241500d897e3 service nova] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:42:23.105460 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1398/2809] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:42:24.381763 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69cdd4c-1ee1-4445-8cef-12af50e10273 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:42:24.383351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-f69cdd4c-1ee1-4445-8cef-12af50e10273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:42:24.402684 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69cdd4c-1ee1-4445-8cef-12af50e10273 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:42:24.409599 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573d6d4-b7ab-4906-999d-daec4b015e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:42:24.410267 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573d6d4-b7ab-4906-999d-daec4b015e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:42:24.410560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573d6d4-b7ab-4906-999d-daec4b015e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:42:24.410822 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573d6d4-b7ab-4906-999d-daec4b015e8e admin admin] PATH_INFO: `/v3/users/c83e6cc7f5b34c799123989e086527f4` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:42:24.412142 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573d6d4-b7ab-4906-999d-daec4b015e8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c83e6cc7f5b34c799123989e086527f4)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:42:24.414111 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573d6d4-b7ab-4906-999d-daec4b015e8e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:42:24.480553 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d573d6d4-b7ab-4906-999d-daec4b015e8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c83e6cc7f5b34c799123989e086527f4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:24.481357 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d573d6d4-b7ab-4906-999d-daec4b015e8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c83e6cc7f5b34c799123989e086527f4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:24.491067 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d573d6d4-b7ab-4906-999d-daec4b015e8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c83e6cc7f5b34c799123989e086527f4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:24.506135 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d573d6d4-b7ab-4906-999d-daec4b015e8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c83e6cc7f5b34c799123989e086527f4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:24.516301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d573d6d4-b7ab-4906-999d-daec4b015e8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c83e6cc7f5b34c799123989e086527f4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:24.523775 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1412/2810] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:42:24 2022] DELETE /identity/v3/users/c83e6cc7f5b34c799123989e086527f4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:42:24.751440 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7fc42-d4c4-43e9-91a6-241500d897e3 service nova] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:42:24.761849 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7fc42-d4c4-43e9-91a6-241500d897e3 service nova] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:42:24.825565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25165be9-d6b7-4e5f-9e7a-da1fda4a54b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:42:24.826210 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25165be9-d6b7-4e5f-9e7a-da1fda4a54b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:42:24.826556 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25165be9-d6b7-4e5f-9e7a-da1fda4a54b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:42:24.827435 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25165be9-d6b7-4e5f-9e7a-da1fda4a54b5 admin admin] PATH_INFO: `/v3/projects/f787012cb64d49f8b646f052ca8d6ab4` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:42:24.828600 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25165be9-d6b7-4e5f-9e7a-da1fda4a54b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f787012cb64d49f8b646f052ca8d6ab4)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:42:24.831053 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25165be9-d6b7-4e5f-9e7a-da1fda4a54b5 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:42:24.866234 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:42:24.887159 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-25165be9-d6b7-4e5f-9e7a-da1fda4a54b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f787012cb64d49f8b646f052ca8d6ab4', 'request_id': 'req-25165be9-d6b7-4e5f-9e7a-da1fda4a54b5'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:24.894453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-25165be9-d6b7-4e5f-9e7a-da1fda4a54b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f787012cb64d49f8b646f052ca8d6ab4', 'request_id': 'req-25165be9-d6b7-4e5f-9e7a-da1fda4a54b5'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:24.903333 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-25165be9-d6b7-4e5f-9e7a-da1fda4a54b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f787012cb64d49f8b646f052ca8d6ab4', 'request_id': 'req-25165be9-d6b7-4e5f-9e7a-da1fda4a54b5'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:24.914949 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-25165be9-d6b7-4e5f-9e7a-da1fda4a54b5 admin admin] The token cache is being invalidate because project f787012cb64d49f8b646f052ca8d6ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:42:24.915139 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-25165be9-d6b7-4e5f-9e7a-da1fda4a54b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:24.915831 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-25165be9-d6b7-4e5f-9e7a-da1fda4a54b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:24.917320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1399/2811] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:42:24 2022] DELETE /identity/v3/projects/f787012cb64d49f8b646f052ca8d6ab4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:42:24.922112 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573d6d4-b7ab-4906-999d-daec4b015e8e admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:42:24.924444 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-d573d6d4-b7ab-4906-999d-daec4b015e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:42:24.939382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573d6d4-b7ab-4906-999d-daec4b015e8e admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:42:24.948319 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:42:25.002893 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee632c4-9ca1-4e27-adc9-5d7c7ab5a42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:42:25.003531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee632c4-9ca1-4e27-adc9-5d7c7ab5a42d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:42:25.003836 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee632c4-9ca1-4e27-adc9-5d7c7ab5a42d admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:42:25.004105 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee632c4-9ca1-4e27-adc9-5d7c7ab5a42d admin admin] PATH_INFO: `/v3/users/40935ba1e898453298465966ff9460b5` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:42:25.006626 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee632c4-9ca1-4e27-adc9-5d7c7ab5a42d admin admin] RBAC: Authorizing `identity:delete_user(user_id=40935ba1e898453298465966ff9460b5)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:42:25.007193 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee632c4-9ca1-4e27-adc9-5d7c7ab5a42d admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:42:25.065391 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-eee632c4-9ca1-4e27-adc9-5d7c7ab5a42d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40935ba1e898453298465966ff9460b5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:25.066084 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-eee632c4-9ca1-4e27-adc9-5d7c7ab5a42d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40935ba1e898453298465966ff9460b5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:25.079636 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-eee632c4-9ca1-4e27-adc9-5d7c7ab5a42d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40935ba1e898453298465966ff9460b5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:25.092855 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-eee632c4-9ca1-4e27-adc9-5d7c7ab5a42d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40935ba1e898453298465966ff9460b5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:25.100064 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-eee632c4-9ca1-4e27-adc9-5d7c7ab5a42d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40935ba1e898453298465966ff9460b5'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:25.106136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1413/2812] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:42:24 2022] DELETE /identity/v3/users/40935ba1e898453298465966ff9460b5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:42:25.325223 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25165be9-d6b7-4e5f-9e7a-da1fda4a54b5 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:42:25.327894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-25165be9-d6b7-4e5f-9e7a-da1fda4a54b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:42:25.344636 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25165be9-d6b7-4e5f-9e7a-da1fda4a54b5 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:42:25.413154 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0163e33-e3e8-42a6-9f39-0bb10d2308ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:42:25.413913 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0163e33-e3e8-42a6-9f39-0bb10d2308ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:42:25.414199 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0163e33-e3e8-42a6-9f39-0bb10d2308ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:42:25.414480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0163e33-e3e8-42a6-9f39-0bb10d2308ca admin admin] PATH_INFO: `/v3/projects/aa970411ccef4af68d33f9842b34b838` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:42:25.415811 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0163e33-e3e8-42a6-9f39-0bb10d2308ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa970411ccef4af68d33f9842b34b838)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:42:25.417829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0163e33-e3e8-42a6-9f39-0bb10d2308ca admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:42:25.474216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a0163e33-e3e8-42a6-9f39-0bb10d2308ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa970411ccef4af68d33f9842b34b838', 'request_id': 'req-a0163e33-e3e8-42a6-9f39-0bb10d2308ca'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:25.480744 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a0163e33-e3e8-42a6-9f39-0bb10d2308ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa970411ccef4af68d33f9842b34b838', 'request_id': 'req-a0163e33-e3e8-42a6-9f39-0bb10d2308ca'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:25.489779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a0163e33-e3e8-42a6-9f39-0bb10d2308ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa970411ccef4af68d33f9842b34b838', 'request_id': 'req-a0163e33-e3e8-42a6-9f39-0bb10d2308ca'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:25.502303 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a0163e33-e3e8-42a6-9f39-0bb10d2308ca admin admin] The token cache is being invalidate because project aa970411ccef4af68d33f9842b34b838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:42:25.502918 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a0163e33-e3e8-42a6-9f39-0bb10d2308ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:25.503935 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-a0163e33-e3e8-42a6-9f39-0bb10d2308ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:25.505451 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1400/2813] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:42:25 2022] DELETE /identity/v3/projects/aa970411ccef4af68d33f9842b34b838 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:42:35.102589 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=48,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:42:35.498096 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:DELETE=13,keystone:SELECT=65,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:42:44.793266 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee632c4-9ca1-4e27-adc9-5d7c7ab5a42d admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:42:44.795100 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-eee632c4-9ca1-4e27-adc9-5d7c7ab5a42d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:42:44.878381 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee632c4-9ca1-4e27-adc9-5d7c7ab5a42d admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:42:44.949291 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26fa4b-f842-42a6-94ff-95cc733a01ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '151e7b9c7a7b46d58dc2f563d05775e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:42:44.949915 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26fa4b-f842-42a6-94ff-95cc733a01ce service nova] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:42:44.950189 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26fa4b-f842-42a6-94ff-95cc733a01ce service nova] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:42:44.950458 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26fa4b-f842-42a6-94ff-95cc733a01ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:42:44.953095 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-9f26fa4b-f842-42a6-94ff-95cc733a01ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:42:45.019733 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26fa4b-f842-42a6-94ff-95cc733a01ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:42:45.021331 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26fa4b-f842-42a6-94ff-95cc733a01ce service nova] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:42:45.031175 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1414/2814] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:42:44 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:42:54.296483 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0163e33-e3e8-42a6-9f39-0bb10d2308ca admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:42:54.299152 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a0163e33-e3e8-42a6-9f39-0bb10d2308ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:42:54.377671 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0163e33-e3e8-42a6-9f39-0bb10d2308ca admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:42:54.382571 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971dbc5-6515-4b6b-a551-9c358fe75654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:42:54.383221 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971dbc5-6515-4b6b-a551-9c358fe75654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:42:54.383509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971dbc5-6515-4b6b-a551-9c358fe75654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:42:54.383807 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971dbc5-6515-4b6b-a551-9c358fe75654 admin admin] PATH_INFO: `/v3/users/e64ad0ccec3d40e399e23563d4d7eb39` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:42:54.384984 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971dbc5-6515-4b6b-a551-9c358fe75654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e64ad0ccec3d40e399e23563d4d7eb39)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:42:54.386980 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971dbc5-6515-4b6b-a551-9c358fe75654 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:42:54.446469 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-5971dbc5-6515-4b6b-a551-9c358fe75654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e64ad0ccec3d40e399e23563d4d7eb39'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:54.447272 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-5971dbc5-6515-4b6b-a551-9c358fe75654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e64ad0ccec3d40e399e23563d4d7eb39'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:54.463894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-5971dbc5-6515-4b6b-a551-9c358fe75654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e64ad0ccec3d40e399e23563d4d7eb39'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:54.473330 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-5971dbc5-6515-4b6b-a551-9c358fe75654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e64ad0ccec3d40e399e23563d4d7eb39'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:54.482524 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-5971dbc5-6515-4b6b-a551-9c358fe75654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e64ad0ccec3d40e399e23563d4d7eb39'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:54.488897 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1401/2815] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:42:54 2022] DELETE /identity/v3/users/e64ad0ccec3d40e399e23563d4d7eb39 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:42:54.701241 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26fa4b-f842-42a6-94ff-95cc733a01ce service nova] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:42:54.722844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26fa4b-f842-42a6-94ff-95cc733a01ce service nova] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:42:54.769675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=100 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:42:54.805171 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d73909-3fb6-479f-af3a-e1f6fe46cc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:42:54.806149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d73909-3fb6-479f-af3a-e1f6fe46cc47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:42:54.806685 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d73909-3fb6-479f-af3a-e1f6fe46cc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:42:54.807190 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d73909-3fb6-479f-af3a-e1f6fe46cc47 admin admin] PATH_INFO: `/v3/projects/a30fde9ad26d43aa95a059709a384bbb` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:42:54.809311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d73909-3fb6-479f-af3a-e1f6fe46cc47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a30fde9ad26d43aa95a059709a384bbb)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:42:54.813693 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d73909-3fb6-479f-af3a-e1f6fe46cc47 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:42:54.897749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-67d73909-3fb6-479f-af3a-e1f6fe46cc47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a30fde9ad26d43aa95a059709a384bbb', 'request_id': 'req-67d73909-3fb6-479f-af3a-e1f6fe46cc47'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:54.905829 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-67d73909-3fb6-479f-af3a-e1f6fe46cc47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a30fde9ad26d43aa95a059709a384bbb', 'request_id': 'req-67d73909-3fb6-479f-af3a-e1f6fe46cc47'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:54.913360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-67d73909-3fb6-479f-af3a-e1f6fe46cc47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a30fde9ad26d43aa95a059709a384bbb', 'request_id': 'req-67d73909-3fb6-479f-af3a-e1f6fe46cc47'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:54.929538 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-67d73909-3fb6-479f-af3a-e1f6fe46cc47 admin admin] The token cache is being invalidate because project a30fde9ad26d43aa95a059709a384bbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:42:54.929848 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-67d73909-3fb6-479f-af3a-e1f6fe46cc47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:54.930532 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-67d73909-3fb6-479f-af3a-e1f6fe46cc47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:42:54.932166 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1415/2816] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:42:54 2022] DELETE /identity/v3/projects/a30fde9ad26d43aa95a059709a384bbb => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:43:04.485318 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:43:04.725518 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31961f90-1610-47b2-9618-04b54f7d5ded None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:43:04.725803 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31961f90-1610-47b2-9618-04b54f7d5ded None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:43:04.726079 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31961f90-1610-47b2-9618-04b54f7d5ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:43:04.776768 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-31961f90-1610-47b2-9618-04b54f7d5ded None None] MFA Rules not processed for user `c5dc12a8bc2b406b8a148bf609d5d2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:43:04.777902 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-31961f90-1610-47b2-9618-04b54f7d5ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:43:04.850404 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1402/2817] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Oct 4 14:43:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:43:04.900712 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d73909-3fb6-479f-af3a-e1f6fe46cc47 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:43:04.902127 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-67d73909-3fb6-479f-af3a-e1f6fe46cc47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:43:05.004865 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d73909-3fb6-479f-af3a-e1f6fe46cc47 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:43:05.010606 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e82778-5577-4f92-a5e9-e382d9408564 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4860d5958e724e568576a9067290a27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:43:05.011223 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e82778-5577-4f92-a5e9-e382d9408564 service swift] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:43:05.011503 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e82778-5577-4f92-a5e9-e382d9408564 service swift] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:43:05.011800 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e82778-5577-4f92-a5e9-e382d9408564 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:43:05.021233 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e82778-5577-4f92-a5e9-e382d9408564 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:43:05.022827 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e82778-5577-4f92-a5e9-e382d9408564 service swift] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:43:05.031753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1416/2818] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Oct 4 14:43:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 14:43:14.846857 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=40 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:43:15.028115 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:43:22.829814 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb719d05-9dc1-43dc-a3ff-06071583017c None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:43:22.830405 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb719d05-9dc1-43dc-a3ff-06071583017c None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:43:22.830764 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb719d05-9dc1-43dc-a3ff-06071583017c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:43:22.854710 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-cb719d05-9dc1-43dc-a3ff-06071583017c None None] MFA Rules not processed for user `c5dc12a8bc2b406b8a148bf609d5d2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:43:22.855953 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-cb719d05-9dc1-43dc-a3ff-06071583017c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:43:22.863654 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1403/2819] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Oct 4 14:43:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:43:22.876140 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e82778-5577-4f92-a5e9-e382d9408564 service swift] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:43:22.886928 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e82778-5577-4f92-a5e9-e382d9408564 service swift] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:43:22.893232 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135b340-a69a-4f1b-91b9-2913d4b781ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4860d5958e724e568576a9067290a27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:43:22.893843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135b340-a69a-4f1b-91b9-2913d4b781ea service swift] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:43:22.894121 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135b340-a69a-4f1b-91b9-2913d4b781ea service swift] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:43:22.894388 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135b340-a69a-4f1b-91b9-2913d4b781ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:43:22.903257 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135b340-a69a-4f1b-91b9-2913d4b781ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:43:22.905728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135b340-a69a-4f1b-91b9-2913d4b781ea service swift] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:43:22.914059 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1417/2820] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Oct 4 14:43:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 14:43:32.849729 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:43:32.910751 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=6 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:43:38.359892 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb719d05-9dc1-43dc-a3ff-06071583017c None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:43:38.361315 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-cb719d05-9dc1-43dc-a3ff-06071583017c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:43:38.429560 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb719d05-9dc1-43dc-a3ff-06071583017c None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:43:38.434992 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c09826-da8e-466a-a1eb-77c8f0c7e2c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f98c07455a241398784d221df273aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:43:38.435599 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c09826-da8e-466a-a1eb-77c8f0c7e2c9 service placement] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:43:38.435897 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c09826-da8e-466a-a1eb-77c8f0c7e2c9 service placement] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:43:38.436164 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c09826-da8e-466a-a1eb-77c8f0c7e2c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:43:38.437917 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-47c09826-da8e-466a-a1eb-77c8f0c7e2c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:43:38.449863 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c09826-da8e-466a-a1eb-77c8f0c7e2c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:43:38.452227 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c09826-da8e-466a-a1eb-77c8f0c7e2c9 service placement] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:43:38.462270 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1404/2821] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:43:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:43:41.140174 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d870f9e-7dc3-4ddc-9db6-73f22c4748cc None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:43:41.140702 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d870f9e-7dc3-4ddc-9db6-73f22c4748cc None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:43:41.140812 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d870f9e-7dc3-4ddc-9db6-73f22c4748cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:43:41.161323 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-1d870f9e-7dc3-4ddc-9db6-73f22c4748cc None None] MFA Rules not processed for user `c5dc12a8bc2b406b8a148bf609d5d2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:43:41.162540 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1d870f9e-7dc3-4ddc-9db6-73f22c4748cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:43:41.170050 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1418/2822] 10.222.0.62 () {58 vars in 967 bytes} [Tue Oct 4 14:43:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:43:41.187859 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c09826-da8e-466a-a1eb-77c8f0c7e2c9 service placement] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:43:41.201037 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c09826-da8e-466a-a1eb-77c8f0c7e2c9 service placement] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:43:41.207076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d1bb2-c5a7-497d-a7c8-9db5a7cfef60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4860d5958e724e568576a9067290a27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:43:41.207686 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d1bb2-c5a7-497d-a7c8-9db5a7cfef60 service swift] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:43:41.207996 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d1bb2-c5a7-497d-a7c8-9db5a7cfef60 service swift] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:43:41.208261 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d1bb2-c5a7-497d-a7c8-9db5a7cfef60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:43:41.218019 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d1bb2-c5a7-497d-a7c8-9db5a7cfef60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:43:41.219658 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d1bb2-c5a7-497d-a7c8-9db5a7cfef60 service swift] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:43:41.228976 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1405/2823] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Oct 4 14:43:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 14:43:51.155436 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:43:51.225194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=38 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:44:30.970111 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d870f9e-7dc3-4ddc-9db6-73f22c4748cc None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:30.971491 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1d870f9e-7dc3-4ddc-9db6-73f22c4748cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:44:31.027662 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d870f9e-7dc3-4ddc-9db6-73f22c4748cc None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:31.031314 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7766a-2fbd-4172-b55e-f84ea799a29b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:31.031941 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7766a-2fbd-4172-b55e-f84ea799a29b service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:31.032214 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7766a-2fbd-4172-b55e-f84ea799a29b service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:31.032480 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7766a-2fbd-4172-b55e-f84ea799a29b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:31.034163 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-a3b7766a-2fbd-4172-b55e-f84ea799a29b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:44:31.115582 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7766a-2fbd-4172-b55e-f84ea799a29b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:31.117068 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7766a-2fbd-4172-b55e-f84ea799a29b service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:31.130260 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1419/2824] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:44:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:44:32.344340 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d1bb2-c5a7-497d-a7c8-9db5a7cfef60 service swift] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:32.354110 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d1bb2-c5a7-497d-a7c8-9db5a7cfef60 service swift] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:32.357796 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f729a-db01-4861-b972-418108e17683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:32.358466 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f729a-db01-4861-b972-418108e17683 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:32.358744 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f729a-db01-4861-b972-418108e17683 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:32.359015 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f729a-db01-4861-b972-418108e17683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:32.360753 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-a73f729a-db01-4861-b972-418108e17683 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:44:32.376676 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f729a-db01-4861-b972-418108e17683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:32.378110 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f729a-db01-4861-b972-418108e17683 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:32.390677 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1406/2825] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:44:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:44:37.860895 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7766a-2fbd-4172-b55e-f84ea799a29b service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:37.869854 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7766a-2fbd-4172-b55e-f84ea799a29b service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:37.873646 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32bb78d-13e0-4631-b61d-bf131c630de8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:37.874308 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32bb78d-13e0-4631-b61d-bf131c630de8 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:37.874582 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32bb78d-13e0-4631-b61d-bf131c630de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:37.874847 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32bb78d-13e0-4631-b61d-bf131c630de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:37.876723 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b32bb78d-13e0-4631-b61d-bf131c630de8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:44:37.944133 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32bb78d-13e0-4631-b61d-bf131c630de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:37.945838 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32bb78d-13e0-4631-b61d-bf131c630de8 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:37.956552 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1420/2826] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:44:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:44:41.047693 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f729a-db01-4861-b972-418108e17683 service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:41.064662 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f729a-db01-4861-b972-418108e17683 service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:41.071592 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef102fe-0442-4b75-bb25-02fc54236bd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f98c07455a241398784d221df273aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:41.072473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef102fe-0442-4b75-bb25-02fc54236bd4 service placement] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:41.072811 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef102fe-0442-4b75-bb25-02fc54236bd4 service placement] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:41.073190 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef102fe-0442-4b75-bb25-02fc54236bd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:41.075365 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-2ef102fe-0442-4b75-bb25-02fc54236bd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:44:41.088539 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef102fe-0442-4b75-bb25-02fc54236bd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:41.090374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef102fe-0442-4b75-bb25-02fc54236bd4 service placement] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:41.103466 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1407/2827] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:44:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:44:41.119270 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32bb78d-13e0-4631-b61d-bf131c630de8 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:41.121312 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b32bb78d-13e0-4631-b61d-bf131c630de8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:44:41.142727 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32bb78d-13e0-4631-b61d-bf131c630de8 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:41.147951 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b27c29-d5cd-48e7-b9c0-96943325e982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:41.148842 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b27c29-d5cd-48e7-b9c0-96943325e982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:41.149186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b27c29-d5cd-48e7-b9c0-96943325e982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:41.149523 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b27c29-d5cd-48e7-b9c0-96943325e982 admin admin] PATH_INFO: `/v3/users/3f869ad16f0943ed97bfe91472f929e7` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:41.150842 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b27c29-d5cd-48e7-b9c0-96943325e982 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f869ad16f0943ed97bfe91472f929e7)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:41.153753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b27c29-d5cd-48e7-b9c0-96943325e982 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:41.203113 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:44:41.222412 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d8b27c29-d5cd-48e7-b9c0-96943325e982 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f869ad16f0943ed97bfe91472f929e7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:41.223086 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d8b27c29-d5cd-48e7-b9c0-96943325e982 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f869ad16f0943ed97bfe91472f929e7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:41.231490 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d8b27c29-d5cd-48e7-b9c0-96943325e982 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f869ad16f0943ed97bfe91472f929e7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:41.252271 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d8b27c29-d5cd-48e7-b9c0-96943325e982 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f869ad16f0943ed97bfe91472f929e7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:41.260237 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d8b27c29-d5cd-48e7-b9c0-96943325e982 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f869ad16f0943ed97bfe91472f929e7'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:41.268093 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1421/2828] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:44:41 2022] DELETE /identity/v3/users/3f869ad16f0943ed97bfe91472f929e7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:44:41.473070 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef102fe-0442-4b75-bb25-02fc54236bd4 service placement] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:41.485910 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef102fe-0442-4b75-bb25-02fc54236bd4 service placement] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:41.551081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e70672-3fef-4f6b-adc8-4725f52e5469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:41.551771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e70672-3fef-4f6b-adc8-4725f52e5469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:41.552053 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e70672-3fef-4f6b-adc8-4725f52e5469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:41.552324 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e70672-3fef-4f6b-adc8-4725f52e5469 admin admin] PATH_INFO: `/v3/projects/a05e3803e64141afb06ecc7cab9478b5` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:41.553565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e70672-3fef-4f6b-adc8-4725f52e5469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a05e3803e64141afb06ecc7cab9478b5)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:41.555374 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e70672-3fef-4f6b-adc8-4725f52e5469 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:41.602466 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-10e70672-3fef-4f6b-adc8-4725f52e5469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a05e3803e64141afb06ecc7cab9478b5', 'request_id': 'req-10e70672-3fef-4f6b-adc8-4725f52e5469'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:41.609259 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-10e70672-3fef-4f6b-adc8-4725f52e5469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a05e3803e64141afb06ecc7cab9478b5', 'request_id': 'req-10e70672-3fef-4f6b-adc8-4725f52e5469'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:41.616275 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-10e70672-3fef-4f6b-adc8-4725f52e5469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a05e3803e64141afb06ecc7cab9478b5', 'request_id': 'req-10e70672-3fef-4f6b-adc8-4725f52e5469'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:41.627151 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-10e70672-3fef-4f6b-adc8-4725f52e5469 admin admin] The token cache is being invalidate because project a05e3803e64141afb06ecc7cab9478b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:44:41.627430 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-10e70672-3fef-4f6b-adc8-4725f52e5469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:41.628076 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-10e70672-3fef-4f6b-adc8-4725f52e5469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:41.629576 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1408/2829] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:44:41 2022] DELETE /identity/v3/projects/a05e3803e64141afb06ecc7cab9478b5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:44:41.634574 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8f50d-f60d-41e9-b3b4-bcfb47fd751d None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:41.634857 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8f50d-f60d-41e9-b3b4-bcfb47fd751d None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:41.635129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8f50d-f60d-41e9-b3b4-bcfb47fd751d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:41.654903 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-5fe8f50d-f60d-41e9-b3b4-bcfb47fd751d None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:44:41.656131 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5fe8f50d-f60d-41e9-b3b4-bcfb47fd751d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:44:41.726892 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1422/2830] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:44:41.735974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d1239-ae78-417f-87fd-50777bb1b701 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:41.736326 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d1239-ae78-417f-87fd-50777bb1b701 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:41.736600 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d1239-ae78-417f-87fd-50777bb1b701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:41.757576 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-bb0d1239-ae78-417f-87fd-50777bb1b701 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:44:41.758739 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-bb0d1239-ae78-417f-87fd-50777bb1b701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:44:41.766839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1409/2831] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:44:41.771261 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8f50d-f60d-41e9-b3b4-bcfb47fd751d None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:41.781232 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8f50d-f60d-41e9-b3b4-bcfb47fd751d None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:41.785871 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490855a3-cc9c-4b4e-ad83-b9fc22e5fbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:41.786469 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490855a3-cc9c-4b4e-ad83-b9fc22e5fbca admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:41.786749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490855a3-cc9c-4b4e-ad83-b9fc22e5fbca admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:41.787019 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490855a3-cc9c-4b4e-ad83-b9fc22e5fbca admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:41.787666 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490855a3-cc9c-4b4e-ad83-b9fc22e5fbca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:44:41.787995 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490855a3-cc9c-4b4e-ad83-b9fc22e5fbca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:41.789611 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490855a3-cc9c-4b4e-ad83-b9fc22e5fbca admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:41.801957 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1423/2832] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:44:41.806413 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d1239-ae78-417f-87fd-50777bb1b701 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:41.816863 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d1239-ae78-417f-87fd-50777bb1b701 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:41.823000 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d82ca-dc84-4596-8b0f-fa2bb808f9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:41.823809 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d82ca-dc84-4596-8b0f-fa2bb808f9ef admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:41.824094 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d82ca-dc84-4596-8b0f-fa2bb808f9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:41.824376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d82ca-dc84-4596-8b0f-fa2bb808f9ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:41.825015 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d82ca-dc84-4596-8b0f-fa2bb808f9ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:41.827022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d82ca-dc84-4596-8b0f-fa2bb808f9ef admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:41.856063 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1410/2833] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:44:41 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:44:41.861179 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490855a3-cc9c-4b4e-ad83-b9fc22e5fbca admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:41.871266 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490855a3-cc9c-4b4e-ad83-b9fc22e5fbca admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:41.932282 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae95612-2fd5-4e50-9e8d-1e691f0e99e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:41.932893 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae95612-2fd5-4e50-9e8d-1e691f0e99e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:41.933173 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae95612-2fd5-4e50-9e8d-1e691f0e99e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:41.933447 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae95612-2fd5-4e50-9e8d-1e691f0e99e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:41.934077 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae95612-2fd5-4e50-9e8d-1e691f0e99e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:41.936613 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae95612-2fd5-4e50-9e8d-1e691f0e99e4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:41.959123 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1424/2834] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:44:41 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:44:41.962832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d82ca-dc84-4596-8b0f-fa2bb808f9ef admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:41.973860 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d82ca-dc84-4596-8b0f-fa2bb808f9ef admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:41.978721 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1a7c8-7268-4dce-b220-8d1dfec319c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:41.979320 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1a7c8-7268-4dce-b220-8d1dfec319c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:41.979597 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1a7c8-7268-4dce-b220-8d1dfec319c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:41.979902 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1a7c8-7268-4dce-b220-8d1dfec319c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:41.980545 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1a7c8-7268-4dce-b220-8d1dfec319c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:41.982820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1a7c8-7268-4dce-b220-8d1dfec319c4 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:41.992725 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1411/2835] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:44:41.996722 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae95612-2fd5-4e50-9e8d-1e691f0e99e4 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:42.006571 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae95612-2fd5-4e50-9e8d-1e691f0e99e4 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:42.011211 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89547d53-09d0-4766-9761-e655b10ab2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:42.011832 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89547d53-09d0-4766-9761-e655b10ab2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:42.012110 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89547d53-09d0-4766-9761-e655b10ab2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:42.012376 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89547d53-09d0-4766-9761-e655b10ab2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:42.013011 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89547d53-09d0-4766-9761-e655b10ab2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:42.014730 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89547d53-09d0-4766-9761-e655b10ab2f7 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:42.026438 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1425/2836] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:44:42.031443 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1a7c8-7268-4dce-b220-8d1dfec319c4 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:42.045587 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1a7c8-7268-4dce-b220-8d1dfec319c4 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:42.050377 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a371b9d-89db-48b7-8a3b-e7c3216efc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:42.051024 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a371b9d-89db-48b7-8a3b-e7c3216efc2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:42.051297 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a371b9d-89db-48b7-8a3b-e7c3216efc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:42.051568 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a371b9d-89db-48b7-8a3b-e7c3216efc2f admin admin] PATH_INFO: `/v3/projects/e423ddbfd41b4179ac6b9060f5f457cf/users/4d20b7ef0c274b138ec639068b43243d/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:42.066351 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a371b9d-89db-48b7-8a3b-e7c3216efc2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e423ddbfd41b4179ac6b9060f5f457cf, user_id=4d20b7ef0c274b138ec639068b43243d, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:42.069073 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a371b9d-89db-48b7-8a3b-e7c3216efc2f admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:42.079151 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:44:42.084384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1412/2837] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:44:42 2022] PUT /identity/v3/projects/e423ddbfd41b4179ac6b9060f5f457cf/users/4d20b7ef0c274b138ec639068b43243d/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:44:42.096945 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b647fb-3add-4233-8959-ce760e894f03 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:42.097227 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b647fb-3add-4233-8959-ce760e894f03 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:42.097502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b647fb-3add-4233-8959-ce760e894f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:42.124464 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:44:42.127746 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-22b647fb-3add-4233-8959-ce760e894f03 None None] MFA Rules not processed for user `4d20b7ef0c274b138ec639068b43243d`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:44:42.129474 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-22b647fb-3add-4233-8959-ce760e894f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:44:42.193990 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1426/2838] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:44:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:44:42.198946 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a371b9d-89db-48b7-8a3b-e7c3216efc2f admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:42.264535 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a371b9d-89db-48b7-8a3b-e7c3216efc2f admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:42.269194 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd896c6-f4f1-4c5e-9368-f928a95982cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:42.269799 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd896c6-f4f1-4c5e-9368-f928a95982cf admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:42.270077 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd896c6-f4f1-4c5e-9368-f928a95982cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:42.270345 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd896c6-f4f1-4c5e-9368-f928a95982cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:42.270985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd896c6-f4f1-4c5e-9368-f928a95982cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:42.272902 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd896c6-f4f1-4c5e-9368-f928a95982cf admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:42.304929 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1413/2839] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:44:42 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:44:42.309658 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b647fb-3add-4233-8959-ce760e894f03 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:42.322849 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b647fb-3add-4233-8959-ce760e894f03 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:42.384771 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4147ea-b904-496f-9e04-52a0aabf89bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:42.385297 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4147ea-b904-496f-9e04-52a0aabf89bd admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:42.385577 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4147ea-b904-496f-9e04-52a0aabf89bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:42.385849 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4147ea-b904-496f-9e04-52a0aabf89bd admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:42.386481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4147ea-b904-496f-9e04-52a0aabf89bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:42.389414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4147ea-b904-496f-9e04-52a0aabf89bd admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:42.411723 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1427/2840] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:44:42 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:44:42.416185 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd896c6-f4f1-4c5e-9368-f928a95982cf admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:42.426750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd896c6-f4f1-4c5e-9368-f928a95982cf admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:42.431910 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b26f87-58ed-4b85-9ae5-69ac8e05e0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:42.432515 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b26f87-58ed-4b85-9ae5-69ac8e05e0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:42.432793 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b26f87-58ed-4b85-9ae5-69ac8e05e0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:42.433073 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b26f87-58ed-4b85-9ae5-69ac8e05e0b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:42.433708 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b26f87-58ed-4b85-9ae5-69ac8e05e0b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:42.435296 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b26f87-58ed-4b85-9ae5-69ac8e05e0b4 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:42.446319 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1414/2841] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:44:42.451186 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4147ea-b904-496f-9e04-52a0aabf89bd admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:42.461464 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4147ea-b904-496f-9e04-52a0aabf89bd admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:42.466139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7755ca-4885-44d4-9aae-210731a43ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:42.467585 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7755ca-4885-44d4-9aae-210731a43ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:42.468006 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7755ca-4885-44d4-9aae-210731a43ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:42.468171 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7755ca-4885-44d4-9aae-210731a43ab6 admin admin] PATH_INFO: `/v3/projects/547d7926de4c41de8ba38a3d414d3922/users/aba73cc0dea947ec985e4a05be8b367d/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:42.483916 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7755ca-4885-44d4-9aae-210731a43ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=547d7926de4c41de8ba38a3d414d3922, user_id=aba73cc0dea947ec985e4a05be8b367d, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:42.486555 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7755ca-4885-44d4-9aae-210731a43ab6 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:42.500567 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1428/2842] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:44:42 2022] PUT /identity/v3/projects/547d7926de4c41de8ba38a3d414d3922/users/aba73cc0dea947ec985e4a05be8b367d/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:44:42.504714 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b26f87-58ed-4b85-9ae5-69ac8e05e0b4 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:42.516252 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b26f87-58ed-4b85-9ae5-69ac8e05e0b4 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:42.575534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbb344-3343-4c56-b2bf-60d842191099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:42.576289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbb344-3343-4c56-b2bf-60d842191099 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:42.576671 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbb344-3343-4c56-b2bf-60d842191099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:42.576974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbb344-3343-4c56-b2bf-60d842191099 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:42.577616 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbb344-3343-4c56-b2bf-60d842191099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:42.579211 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbb344-3343-4c56-b2bf-60d842191099 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:42.591628 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1415/2843] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:44:42.596414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7755ca-4885-44d4-9aae-210731a43ab6 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:42.607422 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7755ca-4885-44d4-9aae-210731a43ab6 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:42.612728 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f75be-5b34-4771-9a0b-26c620e254e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:42.613395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f75be-5b34-4771-9a0b-26c620e254e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:42.613675 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f75be-5b34-4771-9a0b-26c620e254e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:42.613951 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f75be-5b34-4771-9a0b-26c620e254e6 admin admin] PATH_INFO: `/v3/projects/547d7926de4c41de8ba38a3d414d3922/users/aba73cc0dea947ec985e4a05be8b367d/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:42.615891 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f75be-5b34-4771-9a0b-26c620e254e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=547d7926de4c41de8ba38a3d414d3922, user_id=aba73cc0dea947ec985e4a05be8b367d, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:42.618551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f75be-5b34-4771-9a0b-26c620e254e6 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:42.630529 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1429/2844] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:44:42 2022] PUT /identity/v3/projects/547d7926de4c41de8ba38a3d414d3922/users/aba73cc0dea947ec985e4a05be8b367d/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:44:42.641822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e8b2e-b3d0-4bc9-b646-463caa38b972 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:42.642026 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e8b2e-b3d0-4bc9-b646-463caa38b972 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:42.642367 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e8b2e-b3d0-4bc9-b646-463caa38b972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:42.672133 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-c60e8b2e-b3d0-4bc9-b646-463caa38b972 None None] MFA Rules not processed for user `aba73cc0dea947ec985e4a05be8b367d`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:44:42.673365 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-c60e8b2e-b3d0-4bc9-b646-463caa38b972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:44:42.735040 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:44:42.745450 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1416/2845] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:44:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:44:42.757892 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f75be-5b34-4771-9a0b-26c620e254e6 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:42.759633 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-787f75be-5b34-4771-9a0b-26c620e254e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:44:42.821630 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f75be-5b34-4771-9a0b-26c620e254e6 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:42.825263 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e78c7b-4511-4262-af53-c4e83ed6041d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:42.826481 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e78c7b-4511-4262-af53-c4e83ed6041d service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:42.826762 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e78c7b-4511-4262-af53-c4e83ed6041d service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:42.827022 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e78c7b-4511-4262-af53-c4e83ed6041d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:42.837069 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e78c7b-4511-4262-af53-c4e83ed6041d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:42.838508 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e78c7b-4511-4262-af53-c4e83ed6041d service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:42.843197 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:44:42.851420 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1430/2846] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:44:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:44:42.939532 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e8b2e-b3d0-4bc9-b646-463caa38b972 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:42.950506 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e8b2e-b3d0-4bc9-b646-463caa38b972 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:42.954966 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea975e3a-95de-4020-b797-0b8688cb44df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:42.955580 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea975e3a-95de-4020-b797-0b8688cb44df service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:42.955906 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea975e3a-95de-4020-b797-0b8688cb44df service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:42.956169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea975e3a-95de-4020-b797-0b8688cb44df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:43.021792 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea975e3a-95de-4020-b797-0b8688cb44df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:43.023263 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea975e3a-95de-4020-b797-0b8688cb44df service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:43.032731 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1417/2847] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:44:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:44:50.235252 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e78c7b-4511-4262-af53-c4e83ed6041d service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:50.319893 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e78c7b-4511-4262-af53-c4e83ed6041d service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:50.324625 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d2bd9-c61b-4ef4-b5dd-52763938bede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:50.325320 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d2bd9-c61b-4ef4-b5dd-52763938bede admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:50.325751 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d2bd9-c61b-4ef4-b5dd-52763938bede admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:50.326180 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d2bd9-c61b-4ef4-b5dd-52763938bede admin admin] PATH_INFO: `/v3/users/4d20b7ef0c274b138ec639068b43243d` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:50.327620 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d2bd9-c61b-4ef4-b5dd-52763938bede admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d20b7ef0c274b138ec639068b43243d)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:50.329953 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d2bd9-c61b-4ef4-b5dd-52763938bede admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:50.386677 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b83d2bd9-c61b-4ef4-b5dd-52763938bede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d20b7ef0c274b138ec639068b43243d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:50.387367 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b83d2bd9-c61b-4ef4-b5dd-52763938bede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d20b7ef0c274b138ec639068b43243d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:50.397327 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b83d2bd9-c61b-4ef4-b5dd-52763938bede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d20b7ef0c274b138ec639068b43243d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:50.413713 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b83d2bd9-c61b-4ef4-b5dd-52763938bede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d20b7ef0c274b138ec639068b43243d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:50.425942 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b83d2bd9-c61b-4ef4-b5dd-52763938bede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d20b7ef0c274b138ec639068b43243d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:50.435419 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1431/2848] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:44:50 2022] DELETE /identity/v3/users/4d20b7ef0c274b138ec639068b43243d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:44:50.440449 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dc9c4-75eb-4945-8b3d-4bafe9fac6a1 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:50.440958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dc9c4-75eb-4945-8b3d-4bafe9fac6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:50.440958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dc9c4-75eb-4945-8b3d-4bafe9fac6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:50.461958 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-d68dc9c4-75eb-4945-8b3d-4bafe9fac6a1 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:44:50.463184 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d68dc9c4-75eb-4945-8b3d-4bafe9fac6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:44:50.524567 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1418/2849] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:44:50.534578 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d2bd9-c61b-4ef4-b5dd-52763938bede admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:50.536050 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b83d2bd9-c61b-4ef4-b5dd-52763938bede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:44:50.599622 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d2bd9-c61b-4ef4-b5dd-52763938bede admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:50.603174 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ac08e-b912-4200-b3b6-41838e2e4557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:50.603809 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ac08e-b912-4200-b3b6-41838e2e4557 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:50.604084 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ac08e-b912-4200-b3b6-41838e2e4557 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:50.604351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ac08e-b912-4200-b3b6-41838e2e4557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:50.614176 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ac08e-b912-4200-b3b6-41838e2e4557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:50.615602 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ac08e-b912-4200-b3b6-41838e2e4557 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:50.626754 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1432/2850] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:44:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:44:50.992756 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68dc9c4-75eb-4945-8b3d-4bafe9fac6a1 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:50.996670 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-d68dc9c4-75eb-4945-8b3d-4bafe9fac6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:44:51.015004 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68dc9c4-75eb-4945-8b3d-4bafe9fac6a1 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:51.020311 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f909e7-38ee-40fa-bbb0-00951ea66616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:51.021081 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f909e7-38ee-40fa-bbb0-00951ea66616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:51.021361 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f909e7-38ee-40fa-bbb0-00951ea66616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:51.021643 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f909e7-38ee-40fa-bbb0-00951ea66616 admin admin] PATH_INFO: `/v3/projects/e423ddbfd41b4179ac6b9060f5f457cf` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:51.022888 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f909e7-38ee-40fa-bbb0-00951ea66616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e423ddbfd41b4179ac6b9060f5f457cf)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:51.025627 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f909e7-38ee-40fa-bbb0-00951ea66616 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:51.079206 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-29f909e7-38ee-40fa-bbb0-00951ea66616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e423ddbfd41b4179ac6b9060f5f457cf', 'request_id': 'req-29f909e7-38ee-40fa-bbb0-00951ea66616'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:51.085824 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-29f909e7-38ee-40fa-bbb0-00951ea66616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e423ddbfd41b4179ac6b9060f5f457cf', 'request_id': 'req-29f909e7-38ee-40fa-bbb0-00951ea66616'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:51.095187 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-29f909e7-38ee-40fa-bbb0-00951ea66616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e423ddbfd41b4179ac6b9060f5f457cf', 'request_id': 'req-29f909e7-38ee-40fa-bbb0-00951ea66616'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:51.107773 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-29f909e7-38ee-40fa-bbb0-00951ea66616 admin admin] The token cache is being invalidate because project e423ddbfd41b4179ac6b9060f5f457cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:44:51.108072 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-29f909e7-38ee-40fa-bbb0-00951ea66616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:51.108748 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-29f909e7-38ee-40fa-bbb0-00951ea66616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:51.110270 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1419/2851] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:44:50 2022] DELETE /identity/v3/projects/e423ddbfd41b4179ac6b9060f5f457cf => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:44:51.114388 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ac08e-b912-4200-b3b6-41838e2e4557 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:51.132074 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ac08e-b912-4200-b3b6-41838e2e4557 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:51.150006 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:44:51.199374 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcae72-12cc-444b-988f-08f0c57e0f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:51.200244 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcae72-12cc-444b-988f-08f0c57e0f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:51.201018 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcae72-12cc-444b-988f-08f0c57e0f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:51.201295 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcae72-12cc-444b-988f-08f0c57e0f03 admin admin] PATH_INFO: `/v3/users/aba73cc0dea947ec985e4a05be8b367d` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:51.202671 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dcae72-12cc-444b-988f-08f0c57e0f03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba73cc0dea947ec985e4a05be8b367d)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:51.208425 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dcae72-12cc-444b-988f-08f0c57e0f03 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:51.266241 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d7dcae72-12cc-444b-988f-08f0c57e0f03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba73cc0dea947ec985e4a05be8b367d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:51.267136 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d7dcae72-12cc-444b-988f-08f0c57e0f03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba73cc0dea947ec985e4a05be8b367d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:51.280112 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d7dcae72-12cc-444b-988f-08f0c57e0f03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba73cc0dea947ec985e4a05be8b367d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:51.293678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d7dcae72-12cc-444b-988f-08f0c57e0f03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba73cc0dea947ec985e4a05be8b367d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:51.302446 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-d7dcae72-12cc-444b-988f-08f0c57e0f03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba73cc0dea947ec985e4a05be8b367d'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:51.308941 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1433/2852] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:44:51 2022] DELETE /identity/v3/users/aba73cc0dea947ec985e4a05be8b367d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:44:51.608537 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f909e7-38ee-40fa-bbb0-00951ea66616 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:51.610917 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-29f909e7-38ee-40fa-bbb0-00951ea66616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:44:51.630435 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f909e7-38ee-40fa-bbb0-00951ea66616 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:51.651646 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:44:51.708655 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d2b7b-882d-4c1a-9933-9b70a4fe3e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:51.709203 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d2b7b-882d-4c1a-9933-9b70a4fe3e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:51.709481 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d2b7b-882d-4c1a-9933-9b70a4fe3e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:51.709755 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d2b7b-882d-4c1a-9933-9b70a4fe3e99 admin admin] PATH_INFO: `/v3/projects/547d7926de4c41de8ba38a3d414d3922` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:51.710899 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d2b7b-882d-4c1a-9933-9b70a4fe3e99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=547d7926de4c41de8ba38a3d414d3922)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:51.712897 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d2b7b-882d-4c1a-9933-9b70a4fe3e99 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:51.763857 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-3f2d2b7b-882d-4c1a-9933-9b70a4fe3e99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '547d7926de4c41de8ba38a3d414d3922', 'request_id': 'req-3f2d2b7b-882d-4c1a-9933-9b70a4fe3e99'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:51.770858 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-3f2d2b7b-882d-4c1a-9933-9b70a4fe3e99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '547d7926de4c41de8ba38a3d414d3922', 'request_id': 'req-3f2d2b7b-882d-4c1a-9933-9b70a4fe3e99'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:51.780091 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-3f2d2b7b-882d-4c1a-9933-9b70a4fe3e99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '547d7926de4c41de8ba38a3d414d3922', 'request_id': 'req-3f2d2b7b-882d-4c1a-9933-9b70a4fe3e99'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:51.793333 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-3f2d2b7b-882d-4c1a-9933-9b70a4fe3e99 admin admin] The token cache is being invalidate because project 547d7926de4c41de8ba38a3d414d3922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:44:51.793684 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-3f2d2b7b-882d-4c1a-9933-9b70a4fe3e99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:51.795049 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-3f2d2b7b-882d-4c1a-9933-9b70a4fe3e99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:44:51.796794 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1420/2853] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:44:51 2022] DELETE /identity/v3/projects/547d7926de4c41de8ba38a3d414d3922 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:44:51.801693 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3f6ae-4f7d-436e-937c-ae101ba2fd8a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:51.801998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3f6ae-4f7d-436e-937c-ae101ba2fd8a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:51.802332 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3f6ae-4f7d-436e-937c-ae101ba2fd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:51.823280 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-e5b3f6ae-4f7d-436e-937c-ae101ba2fd8a None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:44:51.824549 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-e5b3f6ae-4f7d-436e-937c-ae101ba2fd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:44:51.890239 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1434/2854] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:44:51.899579 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377f343-123b-41fb-ac7b-f00e983ed93c None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:51.899886 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377f343-123b-41fb-ac7b-f00e983ed93c None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:51.900169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377f343-123b-41fb-ac7b-f00e983ed93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:51.922056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-4377f343-123b-41fb-ac7b-f00e983ed93c None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:44:51.923297 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-4377f343-123b-41fb-ac7b-f00e983ed93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:44:51.932304 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1421/2855] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:44:51.937061 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3f6ae-4f7d-436e-937c-ae101ba2fd8a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:51.948179 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3f6ae-4f7d-436e-937c-ae101ba2fd8a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:51.953706 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919557f3-5ae4-4fab-a181-6428b4f2ce05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:51.954309 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919557f3-5ae4-4fab-a181-6428b4f2ce05 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:51.954583 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919557f3-5ae4-4fab-a181-6428b4f2ce05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:51.954877 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919557f3-5ae4-4fab-a181-6428b4f2ce05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:51.955520 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919557f3-5ae4-4fab-a181-6428b4f2ce05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:44:51.955839 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919557f3-5ae4-4fab-a181-6428b4f2ce05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:51.957413 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919557f3-5ae4-4fab-a181-6428b4f2ce05 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:51.970820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1435/2856] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:44:51.975119 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377f343-123b-41fb-ac7b-f00e983ed93c None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:51.984734 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377f343-123b-41fb-ac7b-f00e983ed93c None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:51.989509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68334920-1f2f-4370-97b8-6333b7ee847e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:51.990105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68334920-1f2f-4370-97b8-6333b7ee847e admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:51.990386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68334920-1f2f-4370-97b8-6333b7ee847e admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:51.990646 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68334920-1f2f-4370-97b8-6333b7ee847e admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:51.991268 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68334920-1f2f-4370-97b8-6333b7ee847e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:51.993198 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68334920-1f2f-4370-97b8-6333b7ee847e admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:52.023376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1422/2857] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:44:51 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:44:52.027995 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919557f3-5ae4-4fab-a181-6428b4f2ce05 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:52.040873 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919557f3-5ae4-4fab-a181-6428b4f2ce05 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:52.066910 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:44:52.104351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81453b4b-db6f-48da-bd34-d050f2280a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:52.105025 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81453b4b-db6f-48da-bd34-d050f2280a99 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:52.105250 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81453b4b-db6f-48da-bd34-d050f2280a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:52.105522 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81453b4b-db6f-48da-bd34-d050f2280a99 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:52.106171 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81453b4b-db6f-48da-bd34-d050f2280a99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:52.108210 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81453b4b-db6f-48da-bd34-d050f2280a99 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:52.130156 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1436/2858] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:44:52 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:44:52.135110 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68334920-1f2f-4370-97b8-6333b7ee847e admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:52.146216 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68334920-1f2f-4370-97b8-6333b7ee847e admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:52.151462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ccb2a8-5435-4bc3-ac9b-6ee1c8b0d751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:52.152125 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ccb2a8-5435-4bc3-ac9b-6ee1c8b0d751 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:52.152403 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ccb2a8-5435-4bc3-ac9b-6ee1c8b0d751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:52.152702 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ccb2a8-5435-4bc3-ac9b-6ee1c8b0d751 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:52.153352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ccb2a8-5435-4bc3-ac9b-6ee1c8b0d751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:52.155795 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ccb2a8-5435-4bc3-ac9b-6ee1c8b0d751 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:52.166234 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1423/2859] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:44:52.170470 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81453b4b-db6f-48da-bd34-d050f2280a99 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:52.189148 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81453b4b-db6f-48da-bd34-d050f2280a99 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:52.193928 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee927553-4377-4701-b339-bfc288fc47fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:52.194816 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee927553-4377-4701-b339-bfc288fc47fa admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:52.195102 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee927553-4377-4701-b339-bfc288fc47fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:52.195371 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee927553-4377-4701-b339-bfc288fc47fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:52.196046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee927553-4377-4701-b339-bfc288fc47fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:52.197654 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee927553-4377-4701-b339-bfc288fc47fa admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:52.210328 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1437/2860] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:44:52.215246 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ccb2a8-5435-4bc3-ac9b-6ee1c8b0d751 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:52.233641 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ccb2a8-5435-4bc3-ac9b-6ee1c8b0d751 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:52.241037 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733a86f-e7ff-466f-ad27-118da43b7522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:52.242161 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733a86f-e7ff-466f-ad27-118da43b7522 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:52.242643 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733a86f-e7ff-466f-ad27-118da43b7522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:52.243121 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733a86f-e7ff-466f-ad27-118da43b7522 admin admin] PATH_INFO: `/v3/projects/bbebaf1e67e54eb2ad558added9575e6/users/666ebd7066c24426b5f13680b99183ef/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:52.261400 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733a86f-e7ff-466f-ad27-118da43b7522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbebaf1e67e54eb2ad558added9575e6, user_id=666ebd7066c24426b5f13680b99183ef, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:52.264913 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733a86f-e7ff-466f-ad27-118da43b7522 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:52.283875 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1424/2861] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:44:52 2022] PUT /identity/v3/projects/bbebaf1e67e54eb2ad558added9575e6/users/666ebd7066c24426b5f13680b99183ef/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:44:52.294357 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba7740-b15a-4667-a817-479b7e80e004 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:52.295090 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba7740-b15a-4667-a817-479b7e80e004 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:52.295090 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba7740-b15a-4667-a817-479b7e80e004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:52.324888 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-0fba7740-b15a-4667-a817-479b7e80e004 None None] MFA Rules not processed for user `666ebd7066c24426b5f13680b99183ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:44:52.326744 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0fba7740-b15a-4667-a817-479b7e80e004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:44:52.396321 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1438/2862] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:44:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:44:52.401195 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733a86f-e7ff-466f-ad27-118da43b7522 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:52.448494 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:44:52.467376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733a86f-e7ff-466f-ad27-118da43b7522 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:52.472584 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc24bac-7e09-497f-8bad-e63b61051cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:52.473191 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc24bac-7e09-497f-8bad-e63b61051cfd admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:52.473468 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc24bac-7e09-497f-8bad-e63b61051cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:52.473737 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc24bac-7e09-497f-8bad-e63b61051cfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:52.474372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc24bac-7e09-497f-8bad-e63b61051cfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:52.476307 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc24bac-7e09-497f-8bad-e63b61051cfd admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:52.506368 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1425/2863] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:44:52 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:44:52.510459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba7740-b15a-4667-a817-479b7e80e004 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:52.522978 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba7740-b15a-4667-a817-479b7e80e004 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:52.585200 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c12509-9eff-46f7-8c84-c40a732457e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:52.585825 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c12509-9eff-46f7-8c84-c40a732457e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:52.586105 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c12509-9eff-46f7-8c84-c40a732457e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:52.586379 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c12509-9eff-46f7-8c84-c40a732457e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:52.587023 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c12509-9eff-46f7-8c84-c40a732457e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:52.589312 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c12509-9eff-46f7-8c84-c40a732457e7 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:52.613538 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1439/2864] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:44:52 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:44:52.617930 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc24bac-7e09-497f-8bad-e63b61051cfd admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:52.629480 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc24bac-7e09-497f-8bad-e63b61051cfd admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:52.634419 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885dbb3-a9c3-4335-a7d3-21936230f2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:52.635038 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885dbb3-a9c3-4335-a7d3-21936230f2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:52.635314 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885dbb3-a9c3-4335-a7d3-21936230f2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:52.635582 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885dbb3-a9c3-4335-a7d3-21936230f2d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:52.636251 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1885dbb3-a9c3-4335-a7d3-21936230f2d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:52.638565 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1885dbb3-a9c3-4335-a7d3-21936230f2d7 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:52.654133 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1426/2865] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 14:44:52.658494 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c12509-9eff-46f7-8c84-c40a732457e7 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:52.669899 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c12509-9eff-46f7-8c84-c40a732457e7 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:52.675488 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc9253-0f99-499e-bb6a-1e42521d92dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:52.676129 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc9253-0f99-499e-bb6a-1e42521d92dd admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:52.676402 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc9253-0f99-499e-bb6a-1e42521d92dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:52.676667 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc9253-0f99-499e-bb6a-1e42521d92dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:52.677301 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc9253-0f99-499e-bb6a-1e42521d92dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:52.678893 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc9253-0f99-499e-bb6a-1e42521d92dd admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:52.690325 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1440/2866] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:44:52.695093 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885dbb3-a9c3-4335-a7d3-21936230f2d7 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:52.706157 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885dbb3-a9c3-4335-a7d3-21936230f2d7 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:52.710879 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ea833-8ca7-40d0-921c-18a6b42a2f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:52.711659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ea833-8ca7-40d0-921c-18a6b42a2f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:52.711971 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ea833-8ca7-40d0-921c-18a6b42a2f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:52.712248 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ea833-8ca7-40d0-921c-18a6b42a2f1d admin admin] PATH_INFO: `/v3/projects/ee76f9966a314230925e30313107d2e8/users/ea2a1faf5ad64cab9e936a810b86fa61/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:52.728629 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ea833-8ca7-40d0-921c-18a6b42a2f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee76f9966a314230925e30313107d2e8, user_id=ea2a1faf5ad64cab9e936a810b86fa61, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:52.732701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ea833-8ca7-40d0-921c-18a6b42a2f1d admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:52.746482 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1427/2867] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:44:52 2022] PUT /identity/v3/projects/ee76f9966a314230925e30313107d2e8/users/ea2a1faf5ad64cab9e936a810b86fa61/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:44:52.757549 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072293c-ecde-4c24-ae5a-10df267b8dc1 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:52.757772 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072293c-ecde-4c24-ae5a-10df267b8dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:52.758037 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072293c-ecde-4c24-ae5a-10df267b8dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:52.784418 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:44:52.787895 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-c072293c-ecde-4c24-ae5a-10df267b8dc1 None None] MFA Rules not processed for user `ea2a1faf5ad64cab9e936a810b86fa61`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:44:52.789849 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c072293c-ecde-4c24-ae5a-10df267b8dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:44:52.859262 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1441/2868] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:44:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:44:52.865189 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ea833-8ca7-40d0-921c-18a6b42a2f1d admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:52.935659 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ea833-8ca7-40d0-921c-18a6b42a2f1d admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:52.940735 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1688f6-7474-4788-a731-c3cf9571c0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:52.941353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1688f6-7474-4788-a731-c3cf9571c0e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:52.941629 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1688f6-7474-4788-a731-c3cf9571c0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:52.941903 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1688f6-7474-4788-a731-c3cf9571c0e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:52.942534 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1688f6-7474-4788-a731-c3cf9571c0e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:52.944476 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1688f6-7474-4788-a731-c3cf9571c0e9 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:52.972380 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1428/2869] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:44:52 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:44:52.976324 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072293c-ecde-4c24-ae5a-10df267b8dc1 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:52.988015 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072293c-ecde-4c24-ae5a-10df267b8dc1 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:53.048229 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7232a-2671-4690-a913-663a9ade405a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:53.048763 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7232a-2671-4690-a913-663a9ade405a admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:53.049039 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7232a-2671-4690-a913-663a9ade405a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:53.049304 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7232a-2671-4690-a913-663a9ade405a admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:53.049937 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7232a-2671-4690-a913-663a9ade405a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:53.051888 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7232a-2671-4690-a913-663a9ade405a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:53.075368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1442/2870] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:44:52 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:44:53.079536 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1688f6-7474-4788-a731-c3cf9571c0e9 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:53.090231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1688f6-7474-4788-a731-c3cf9571c0e9 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:53.095807 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c7d42-1514-41d2-852a-9980c9124079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:53.096444 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c7d42-1514-41d2-852a-9980c9124079 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:53.096775 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c7d42-1514-41d2-852a-9980c9124079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:53.097022 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c7d42-1514-41d2-852a-9980c9124079 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:53.097694 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c7d42-1514-41d2-852a-9980c9124079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:53.099271 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c7d42-1514-41d2-852a-9980c9124079 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:53.110905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1429/2871] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:44:53.115278 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7232a-2671-4690-a913-663a9ade405a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:53.126138 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7232a-2671-4690-a913-663a9ade405a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:53.130865 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d83e82-a984-4c53-9c89-2921f7aee817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:53.131529 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d83e82-a984-4c53-9c89-2921f7aee817 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:53.131843 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d83e82-a984-4c53-9c89-2921f7aee817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:53.132111 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d83e82-a984-4c53-9c89-2921f7aee817 admin admin] PATH_INFO: `/v3/projects/eeececfb0e1f47dbb58f2217d134b040/users/9704ec44845d4cc9acf704fa79281371/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:53.154295 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d83e82-a984-4c53-9c89-2921f7aee817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeececfb0e1f47dbb58f2217d134b040, user_id=9704ec44845d4cc9acf704fa79281371, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:53.157292 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d83e82-a984-4c53-9c89-2921f7aee817 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:53.172274 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1443/2872] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:44:53 2022] PUT /identity/v3/projects/eeececfb0e1f47dbb58f2217d134b040/users/9704ec44845d4cc9acf704fa79281371/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:44:53.176326 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c7d42-1514-41d2-852a-9980c9124079 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:53.186599 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c7d42-1514-41d2-852a-9980c9124079 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:53.250353 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6f1c3-40e1-4e14-9d9e-bf389b367b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:53.250971 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6f1c3-40e1-4e14-9d9e-bf389b367b12 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:53.251250 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6f1c3-40e1-4e14-9d9e-bf389b367b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:53.252644 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6f1c3-40e1-4e14-9d9e-bf389b367b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:53.252644 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6f1c3-40e1-4e14-9d9e-bf389b367b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:53.253778 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6f1c3-40e1-4e14-9d9e-bf389b367b12 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:53.266902 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1430/2873] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:44:53.270555 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d83e82-a984-4c53-9c89-2921f7aee817 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:53.283311 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d83e82-a984-4c53-9c89-2921f7aee817 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:53.288296 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d204a-e157-4e2e-91a8-d769ebb7a861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:53.288964 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d204a-e157-4e2e-91a8-d769ebb7a861 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:53.289245 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d204a-e157-4e2e-91a8-d769ebb7a861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:53.289520 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d204a-e157-4e2e-91a8-d769ebb7a861 admin admin] PATH_INFO: `/v3/projects/eeececfb0e1f47dbb58f2217d134b040/users/9704ec44845d4cc9acf704fa79281371/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:53.291498 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d204a-e157-4e2e-91a8-d769ebb7a861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeececfb0e1f47dbb58f2217d134b040, user_id=9704ec44845d4cc9acf704fa79281371, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:53.294814 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d204a-e157-4e2e-91a8-d769ebb7a861 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:53.306720 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1444/2874] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:44:53 2022] PUT /identity/v3/projects/eeececfb0e1f47dbb58f2217d134b040/users/9704ec44845d4cc9acf704fa79281371/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:44:53.380229 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208c646-0f48-4176-a85d-a594e9369646 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:53.380510 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208c646-0f48-4176-a85d-a594e9369646 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:53.380788 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208c646-0f48-4176-a85d-a594e9369646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:53.390481 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:44:53.414613 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-f208c646-0f48-4176-a85d-a594e9369646 None None] MFA Rules not processed for user `9704ec44845d4cc9acf704fa79281371`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:44:53.415963 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f208c646-0f48-4176-a85d-a594e9369646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:44:53.494763 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1431/2875] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:44:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:44:53.505875 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d204a-e157-4e2e-91a8-d769ebb7a861 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:53.507548 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-494d204a-e157-4e2e-91a8-d769ebb7a861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:44:53.568543 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d204a-e157-4e2e-91a8-d769ebb7a861 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:53.572543 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a781e12-0135-4058-b197-7641fe61efda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:53.573151 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a781e12-0135-4058-b197-7641fe61efda service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:53.573424 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a781e12-0135-4058-b197-7641fe61efda service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:53.573687 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a781e12-0135-4058-b197-7641fe61efda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:53.583621 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a781e12-0135-4058-b197-7641fe61efda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:53.585181 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a781e12-0135-4058-b197-7641fe61efda service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:53.589192 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:44:53.598187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1445/2876] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:44:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:44:54.152771 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208c646-0f48-4176-a85d-a594e9369646 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:54.155104 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f208c646-0f48-4176-a85d-a594e9369646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:44:54.170750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208c646-0f48-4176-a85d-a594e9369646 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:54.175205 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd98700-b847-4c97-8f95-5d3cdf38f049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:54.175905 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd98700-b847-4c97-8f95-5d3cdf38f049 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:54.176185 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd98700-b847-4c97-8f95-5d3cdf38f049 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:54.176928 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd98700-b847-4c97-8f95-5d3cdf38f049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:54.246031 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd98700-b847-4c97-8f95-5d3cdf38f049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:54.247527 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd98700-b847-4c97-8f95-5d3cdf38f049 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:54.257107 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1432/2877] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:44:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:44:58.474318 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a781e12-0135-4058-b197-7641fe61efda service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:44:58.486629 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a781e12-0135-4058-b197-7641fe61efda service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:44:58.492896 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767950c1-58be-488c-b07b-52e6c43ce6f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:44:58.493925 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767950c1-58be-488c-b07b-52e6c43ce6f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:44:58.494416 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767950c1-58be-488c-b07b-52e6c43ce6f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:44:58.494888 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767950c1-58be-488c-b07b-52e6c43ce6f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:44:58.571094 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767950c1-58be-488c-b07b-52e6c43ce6f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:44:58.572583 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767950c1-58be-488c-b07b-52e6c43ce6f6 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:44:58.583398 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1446/2878] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:44:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:45:01.115137 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd98700-b847-4c97-8f95-5d3cdf38f049 service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:01.187188 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd98700-b847-4c97-8f95-5d3cdf38f049 service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:01.193797 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47c5ed-bf61-426f-a3a6-02e68cb2996b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:01.194990 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47c5ed-bf61-426f-a3a6-02e68cb2996b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:01.195465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47c5ed-bf61-426f-a3a6-02e68cb2996b admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:01.195898 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47c5ed-bf61-426f-a3a6-02e68cb2996b admin admin] PATH_INFO: `/v3/users/666ebd7066c24426b5f13680b99183ef` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:01.197857 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de47c5ed-bf61-426f-a3a6-02e68cb2996b admin admin] RBAC: Authorizing `identity:delete_user(user_id=666ebd7066c24426b5f13680b99183ef)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:01.200818 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de47c5ed-bf61-426f-a3a6-02e68cb2996b admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:01.240477 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:45:01.258519 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-de47c5ed-bf61-426f-a3a6-02e68cb2996b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '666ebd7066c24426b5f13680b99183ef'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:01.259186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-de47c5ed-bf61-426f-a3a6-02e68cb2996b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '666ebd7066c24426b5f13680b99183ef'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:01.275504 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-de47c5ed-bf61-426f-a3a6-02e68cb2996b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '666ebd7066c24426b5f13680b99183ef'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:01.285813 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-de47c5ed-bf61-426f-a3a6-02e68cb2996b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '666ebd7066c24426b5f13680b99183ef'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:01.295515 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-de47c5ed-bf61-426f-a3a6-02e68cb2996b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '666ebd7066c24426b5f13680b99183ef'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:01.302090 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1433/2879] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:45:01 2022] DELETE /identity/v3/users/666ebd7066c24426b5f13680b99183ef => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:45:01.306725 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c88cb-fb0f-4b79-9d15-b61177fda3bd None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:01.307252 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c88cb-fb0f-4b79-9d15-b61177fda3bd None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:01.307376 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c88cb-fb0f-4b79-9d15-b61177fda3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:01.331952 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-937c88cb-fb0f-4b79-9d15-b61177fda3bd None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:45:01.333640 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-937c88cb-fb0f-4b79-9d15-b61177fda3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:01.412973 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1447/2880] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:45:01.424675 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47c5ed-bf61-426f-a3a6-02e68cb2996b admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:01.426305 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-de47c5ed-bf61-426f-a3a6-02e68cb2996b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:01.498231 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47c5ed-bf61-426f-a3a6-02e68cb2996b admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:01.502140 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7a400-c1a2-4b28-90b8-9feddebcf614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:01.502766 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7a400-c1a2-4b28-90b8-9feddebcf614 service neutron] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:01.503043 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7a400-c1a2-4b28-90b8-9feddebcf614 service neutron] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:01.503314 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7a400-c1a2-4b28-90b8-9feddebcf614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:01.514513 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7a400-c1a2-4b28-90b8-9feddebcf614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:01.516028 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7a400-c1a2-4b28-90b8-9feddebcf614 service neutron] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:01.526765 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1434/2881] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:45:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:45:01.849936 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c88cb-fb0f-4b79-9d15-b61177fda3bd None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:01.851528 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-937c88cb-fb0f-4b79-9d15-b61177fda3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:01.865409 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c88cb-fb0f-4b79-9d15-b61177fda3bd None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:01.870536 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf3f6e-3e6e-4437-8c64-4fa33a8fda89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:01.871187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf3f6e-3e6e-4437-8c64-4fa33a8fda89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:01.871463 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf3f6e-3e6e-4437-8c64-4fa33a8fda89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:01.871756 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf3f6e-3e6e-4437-8c64-4fa33a8fda89 admin admin] PATH_INFO: `/v3/projects/bbebaf1e67e54eb2ad558added9575e6` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:01.873616 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf3f6e-3e6e-4437-8c64-4fa33a8fda89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbebaf1e67e54eb2ad558added9575e6)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:01.875537 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf3f6e-3e6e-4437-8c64-4fa33a8fda89 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:01.934018 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c7cf3f6e-3e6e-4437-8c64-4fa33a8fda89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbebaf1e67e54eb2ad558added9575e6', 'request_id': 'req-c7cf3f6e-3e6e-4437-8c64-4fa33a8fda89'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:01.940765 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c7cf3f6e-3e6e-4437-8c64-4fa33a8fda89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbebaf1e67e54eb2ad558added9575e6', 'request_id': 'req-c7cf3f6e-3e6e-4437-8c64-4fa33a8fda89'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:01.947755 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c7cf3f6e-3e6e-4437-8c64-4fa33a8fda89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbebaf1e67e54eb2ad558added9575e6', 'request_id': 'req-c7cf3f6e-3e6e-4437-8c64-4fa33a8fda89'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:01.963738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c7cf3f6e-3e6e-4437-8c64-4fa33a8fda89 admin admin] The token cache is being invalidate because project bbebaf1e67e54eb2ad558added9575e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:45:01.964035 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c7cf3f6e-3e6e-4437-8c64-4fa33a8fda89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:01.964830 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-c7cf3f6e-3e6e-4437-8c64-4fa33a8fda89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:01.967158 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1448/2882] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:45:01 2022] DELETE /identity/v3/projects/bbebaf1e67e54eb2ad558added9575e6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:45:01.971282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7a400-c1a2-4b28-90b8-9feddebcf614 service neutron] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:01.981367 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7a400-c1a2-4b28-90b8-9feddebcf614 service neutron] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:02.043640 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46597445-9b3e-462a-b395-4de4311dd846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:02.044862 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46597445-9b3e-462a-b395-4de4311dd846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:02.045147 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46597445-9b3e-462a-b395-4de4311dd846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:02.045453 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46597445-9b3e-462a-b395-4de4311dd846 admin admin] PATH_INFO: `/v3/users/ea2a1faf5ad64cab9e936a810b86fa61` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:02.046675 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46597445-9b3e-462a-b395-4de4311dd846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea2a1faf5ad64cab9e936a810b86fa61)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:02.048670 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46597445-9b3e-462a-b395-4de4311dd846 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:02.105813 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-46597445-9b3e-462a-b395-4de4311dd846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea2a1faf5ad64cab9e936a810b86fa61'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:02.106811 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-46597445-9b3e-462a-b395-4de4311dd846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea2a1faf5ad64cab9e936a810b86fa61'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:02.113470 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:45:02.125611 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-46597445-9b3e-462a-b395-4de4311dd846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea2a1faf5ad64cab9e936a810b86fa61'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:02.134598 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-46597445-9b3e-462a-b395-4de4311dd846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea2a1faf5ad64cab9e936a810b86fa61'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:02.143720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-46597445-9b3e-462a-b395-4de4311dd846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea2a1faf5ad64cab9e936a810b86fa61'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:02.150362 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1435/2883] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:45:01 2022] DELETE /identity/v3/users/ea2a1faf5ad64cab9e936a810b86fa61 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:45:02.512161 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf3f6e-3e6e-4437-8c64-4fa33a8fda89 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:02.515174 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-c7cf3f6e-3e6e-4437-8c64-4fa33a8fda89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:02.535296 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf3f6e-3e6e-4437-8c64-4fa33a8fda89 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:02.564747 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:45:02.614164 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1a568-f252-49f8-8e39-b52dc20d17a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:02.614729 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1a568-f252-49f8-8e39-b52dc20d17a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:02.615009 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1a568-f252-49f8-8e39-b52dc20d17a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:02.615279 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1a568-f252-49f8-8e39-b52dc20d17a0 admin admin] PATH_INFO: `/v3/projects/ee76f9966a314230925e30313107d2e8` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:02.616522 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1a568-f252-49f8-8e39-b52dc20d17a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee76f9966a314230925e30313107d2e8)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:02.618454 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1a568-f252-49f8-8e39-b52dc20d17a0 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:02.695957 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4bb1a568-f252-49f8-8e39-b52dc20d17a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee76f9966a314230925e30313107d2e8', 'request_id': 'req-4bb1a568-f252-49f8-8e39-b52dc20d17a0'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:02.702489 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4bb1a568-f252-49f8-8e39-b52dc20d17a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee76f9966a314230925e30313107d2e8', 'request_id': 'req-4bb1a568-f252-49f8-8e39-b52dc20d17a0'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:02.709982 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4bb1a568-f252-49f8-8e39-b52dc20d17a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee76f9966a314230925e30313107d2e8', 'request_id': 'req-4bb1a568-f252-49f8-8e39-b52dc20d17a0'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:02.725521 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4bb1a568-f252-49f8-8e39-b52dc20d17a0 admin admin] The token cache is being invalidate because project ee76f9966a314230925e30313107d2e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:45:02.725839 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4bb1a568-f252-49f8-8e39-b52dc20d17a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:02.726463 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-4bb1a568-f252-49f8-8e39-b52dc20d17a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:02.728090 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1449/2884] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:45:02 2022] DELETE /identity/v3/projects/ee76f9966a314230925e30313107d2e8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:45:02.732525 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46597445-9b3e-462a-b395-4de4311dd846 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:02.734336 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-46597445-9b3e-462a-b395-4de4311dd846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:02.748735 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46597445-9b3e-462a-b395-4de4311dd846 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:02.812350 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbe90b-f7a3-48bc-b8f9-82ffef47af55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:02.812997 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbe90b-f7a3-48bc-b8f9-82ffef47af55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:02.813274 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbe90b-f7a3-48bc-b8f9-82ffef47af55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:02.813545 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbe90b-f7a3-48bc-b8f9-82ffef47af55 admin admin] PATH_INFO: `/v3/users/9704ec44845d4cc9acf704fa79281371` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:02.814695 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dbe90b-f7a3-48bc-b8f9-82ffef47af55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9704ec44845d4cc9acf704fa79281371)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:02.816763 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dbe90b-f7a3-48bc-b8f9-82ffef47af55 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:02.875886 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-99dbe90b-f7a3-48bc-b8f9-82ffef47af55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9704ec44845d4cc9acf704fa79281371'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:02.876588 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-99dbe90b-f7a3-48bc-b8f9-82ffef47af55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9704ec44845d4cc9acf704fa79281371'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:02.890519 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-99dbe90b-f7a3-48bc-b8f9-82ffef47af55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9704ec44845d4cc9acf704fa79281371'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:02.897837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-99dbe90b-f7a3-48bc-b8f9-82ffef47af55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9704ec44845d4cc9acf704fa79281371'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:02.906349 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-99dbe90b-f7a3-48bc-b8f9-82ffef47af55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9704ec44845d4cc9acf704fa79281371'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:02.912764 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1436/2885] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:45:02 2022] DELETE /identity/v3/users/9704ec44845d4cc9acf704fa79281371 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:45:03.224312 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1a568-f252-49f8-8e39-b52dc20d17a0 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:03.225858 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-4bb1a568-f252-49f8-8e39-b52dc20d17a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:03.243467 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1a568-f252-49f8-8e39-b52dc20d17a0 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:03.312048 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4568778-c37f-433a-ae60-beea563c1a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:03.312704 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4568778-c37f-433a-ae60-beea563c1a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:03.312986 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4568778-c37f-433a-ae60-beea563c1a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:03.313259 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4568778-c37f-433a-ae60-beea563c1a75 admin admin] PATH_INFO: `/v3/projects/eeececfb0e1f47dbb58f2217d134b040` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:03.314416 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4568778-c37f-433a-ae60-beea563c1a75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeececfb0e1f47dbb58f2217d134b040)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:03.316382 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4568778-c37f-433a-ae60-beea563c1a75 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:03.374677 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f4568778-c37f-433a-ae60-beea563c1a75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeececfb0e1f47dbb58f2217d134b040', 'request_id': 'req-f4568778-c37f-433a-ae60-beea563c1a75'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:03.378629 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:45:03.383566 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f4568778-c37f-433a-ae60-beea563c1a75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeececfb0e1f47dbb58f2217d134b040', 'request_id': 'req-f4568778-c37f-433a-ae60-beea563c1a75'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:03.397193 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f4568778-c37f-433a-ae60-beea563c1a75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeececfb0e1f47dbb58f2217d134b040', 'request_id': 'req-f4568778-c37f-433a-ae60-beea563c1a75'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:03.412735 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f4568778-c37f-433a-ae60-beea563c1a75 admin admin] The token cache is being invalidate because project eeececfb0e1f47dbb58f2217d134b040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:45:03.413149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f4568778-c37f-433a-ae60-beea563c1a75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:03.413873 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-f4568778-c37f-433a-ae60-beea563c1a75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:03.415674 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1450/2886] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:45:03 2022] DELETE /identity/v3/projects/eeececfb0e1f47dbb58f2217d134b040 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:45:03.422986 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e23bd4-ea5c-4e5f-bebc-1eb7f03ce83f None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:03.423535 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e23bd4-ea5c-4e5f-bebc-1eb7f03ce83f None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:03.423535 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e23bd4-ea5c-4e5f-bebc-1eb7f03ce83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:03.444315 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-c7e23bd4-ea5c-4e5f-bebc-1eb7f03ce83f None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:45:03.445851 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-c7e23bd4-ea5c-4e5f-bebc-1eb7f03ce83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:03.492499 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:45:03.510388 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1437/2887] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:45:03.519526 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacce71a-71d4-44d7-a771-27899339f228 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:03.520149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacce71a-71d4-44d7-a771-27899339f228 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:03.520149 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacce71a-71d4-44d7-a771-27899339f228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:03.541943 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-aacce71a-71d4-44d7-a771-27899339f228 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:45:03.543175 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-aacce71a-71d4-44d7-a771-27899339f228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:03.552169 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1451/2888] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:45:03.556743 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e23bd4-ea5c-4e5f-bebc-1eb7f03ce83f None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:03.567220 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e23bd4-ea5c-4e5f-bebc-1eb7f03ce83f None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:03.572315 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec3a42-cd4c-427c-b22b-2c7bebb0924b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:03.572945 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec3a42-cd4c-427c-b22b-2c7bebb0924b admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:03.573226 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec3a42-cd4c-427c-b22b-2c7bebb0924b admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:03.573498 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec3a42-cd4c-427c-b22b-2c7bebb0924b admin admin] PATH_INFO: `/v3/domains` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:03.574163 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec3a42-cd4c-427c-b22b-2c7bebb0924b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:45:03.574471 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec3a42-cd4c-427c-b22b-2c7bebb0924b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:03.577095 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec3a42-cd4c-427c-b22b-2c7bebb0924b admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:03.590442 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1438/2889] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:45:03.596816 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacce71a-71d4-44d7-a771-27899339f228 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:03.607516 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacce71a-71d4-44d7-a771-27899339f228 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:03.612472 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb03b84-ef28-446b-92af-34b2de35069c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:03.613100 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb03b84-ef28-446b-92af-34b2de35069c admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:03.613377 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb03b84-ef28-446b-92af-34b2de35069c admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:03.613647 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb03b84-ef28-446b-92af-34b2de35069c admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:03.614288 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb03b84-ef28-446b-92af-34b2de35069c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:03.616247 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb03b84-ef28-446b-92af-34b2de35069c admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:03.649345 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1452/2890] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:45:03 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:45:03.655238 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec3a42-cd4c-427c-b22b-2c7bebb0924b admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:03.666148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec3a42-cd4c-427c-b22b-2c7bebb0924b admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:03.734186 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22166a71-0a02-4028-b00d-55d3c41fc2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:03.734954 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22166a71-0a02-4028-b00d-55d3c41fc2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:03.735331 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22166a71-0a02-4028-b00d-55d3c41fc2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:03.735701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22166a71-0a02-4028-b00d-55d3c41fc2f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:03.736477 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22166a71-0a02-4028-b00d-55d3c41fc2f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:03.738820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22166a71-0a02-4028-b00d-55d3c41fc2f4 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:03.765625 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1439/2891] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:45:03 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:45:03.769859 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb03b84-ef28-446b-92af-34b2de35069c admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:03.780844 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb03b84-ef28-446b-92af-34b2de35069c admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:03.786742 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277faaa-32b7-4c4c-a862-2ea6b1e39d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:03.787370 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277faaa-32b7-4c4c-a862-2ea6b1e39d57 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:03.787647 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277faaa-32b7-4c4c-a862-2ea6b1e39d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:03.787963 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277faaa-32b7-4c4c-a862-2ea6b1e39d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:03.788627 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277faaa-32b7-4c4c-a862-2ea6b1e39d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:03.790254 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277faaa-32b7-4c4c-a862-2ea6b1e39d57 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:03.801438 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1453/2892] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:45:03.808240 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22166a71-0a02-4028-b00d-55d3c41fc2f4 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:03.821323 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22166a71-0a02-4028-b00d-55d3c41fc2f4 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:03.829207 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062dad19-3af3-4593-8b9e-d58fbee3cff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:03.829894 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dad19-3af3-4593-8b9e-d58fbee3cff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:03.830266 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dad19-3af3-4593-8b9e-d58fbee3cff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:03.830605 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dad19-3af3-4593-8b9e-d58fbee3cff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:03.831311 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062dad19-3af3-4593-8b9e-d58fbee3cff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:03.833136 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062dad19-3af3-4593-8b9e-d58fbee3cff4 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:03.852085 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1440/2893] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:45:03.857779 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277faaa-32b7-4c4c-a862-2ea6b1e39d57 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:03.869192 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277faaa-32b7-4c4c-a862-2ea6b1e39d57 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:03.875119 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a505e6-5713-4984-a9b0-c70cb2722f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:03.875833 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a505e6-5713-4984-a9b0-c70cb2722f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:03.876114 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a505e6-5713-4984-a9b0-c70cb2722f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:03.876383 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a505e6-5713-4984-a9b0-c70cb2722f25 admin admin] PATH_INFO: `/v3/projects/33d43db2933d45df8725e316ad411fb4/users/fd365f0e8fcf4b08b93b714f2c7bbcc4/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:03.893433 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a505e6-5713-4984-a9b0-c70cb2722f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33d43db2933d45df8725e316ad411fb4, user_id=fd365f0e8fcf4b08b93b714f2c7bbcc4, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:03.896142 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a505e6-5713-4984-a9b0-c70cb2722f25 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:03.913471 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1454/2894] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:45:03 2022] PUT /identity/v3/projects/33d43db2933d45df8725e316ad411fb4/users/fd365f0e8fcf4b08b93b714f2c7bbcc4/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:45:03.933895 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a89e4-f517-48a2-bc54-bb8c1c6cd45f None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:03.934970 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a89e4-f517-48a2-bc54-bb8c1c6cd45f None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:03.935424 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a89e4-f517-48a2-bc54-bb8c1c6cd45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:03.970234 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-c36a89e4-f517-48a2-bc54-bb8c1c6cd45f None None] MFA Rules not processed for user `fd365f0e8fcf4b08b93b714f2c7bbcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:45:03.971477 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-c36a89e4-f517-48a2-bc54-bb8c1c6cd45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:04.049832 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1441/2895] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:45:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:45:04.055240 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a505e6-5713-4984-a9b0-c70cb2722f25 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:04.132868 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a505e6-5713-4984-a9b0-c70cb2722f25 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:04.137726 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47608052-c307-4393-a34d-ee59ad1f6f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:04.138381 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47608052-c307-4393-a34d-ee59ad1f6f43 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:04.138631 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47608052-c307-4393-a34d-ee59ad1f6f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:04.138902 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47608052-c307-4393-a34d-ee59ad1f6f43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:04.139541 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47608052-c307-4393-a34d-ee59ad1f6f43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:04.141520 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47608052-c307-4393-a34d-ee59ad1f6f43 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:04.172235 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1455/2896] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:45:04 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:45:04.176613 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a89e4-f517-48a2-bc54-bb8c1c6cd45f None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:04.189740 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a89e4-f517-48a2-bc54-bb8c1c6cd45f None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:04.239386 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:45:04.259564 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0747514-1173-4578-b722-75e220aa57dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:04.260373 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0747514-1173-4578-b722-75e220aa57dd admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:04.260764 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0747514-1173-4578-b722-75e220aa57dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:04.261148 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0747514-1173-4578-b722-75e220aa57dd admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:04.261880 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0747514-1173-4578-b722-75e220aa57dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:04.264398 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0747514-1173-4578-b722-75e220aa57dd admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:04.295326 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1442/2897] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:45:04 2022] POST /identity/v3/users => generated 291 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:45:04.300072 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47608052-c307-4393-a34d-ee59ad1f6f43 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:04.315225 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47608052-c307-4393-a34d-ee59ad1f6f43 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:04.320655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23caacd6-e930-4699-8eb8-e781841bdba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:04.321334 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caacd6-e930-4699-8eb8-e781841bdba8 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:04.321695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caacd6-e930-4699-8eb8-e781841bdba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:04.322048 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caacd6-e930-4699-8eb8-e781841bdba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:04.322751 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23caacd6-e930-4699-8eb8-e781841bdba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:04.324591 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23caacd6-e930-4699-8eb8-e781841bdba8 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:04.338479 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1456/2898] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:45:04.343624 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0747514-1173-4578-b722-75e220aa57dd admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:04.355439 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0747514-1173-4578-b722-75e220aa57dd admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:04.361024 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3d86b-15e0-4731-8c94-b915e552326a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:04.361647 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3d86b-15e0-4731-8c94-b915e552326a admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:04.361927 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3d86b-15e0-4731-8c94-b915e552326a admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:04.362196 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3d86b-15e0-4731-8c94-b915e552326a admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:04.362868 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3d86b-15e0-4731-8c94-b915e552326a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:04.364661 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3d86b-15e0-4731-8c94-b915e552326a admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:04.376737 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1443/2899] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:45:04.383228 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23caacd6-e930-4699-8eb8-e781841bdba8 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:04.396653 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23caacd6-e930-4699-8eb8-e781841bdba8 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:04.410104 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b23c3-71d3-4686-bf63-1d2baa9caf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:04.410794 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b23c3-71d3-4686-bf63-1d2baa9caf08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:04.411068 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b23c3-71d3-4686-bf63-1d2baa9caf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:04.411333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b23c3-71d3-4686-bf63-1d2baa9caf08 admin admin] PATH_INFO: `/v3/projects/a30a46f8463a47faa70d408d7b9a22db/users/e754ea19ac704d2ea308aacc78826c40/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:04.428414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b23c3-71d3-4686-bf63-1d2baa9caf08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a30a46f8463a47faa70d408d7b9a22db, user_id=e754ea19ac704d2ea308aacc78826c40, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:04.430995 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b23c3-71d3-4686-bf63-1d2baa9caf08 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:04.447213 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1457/2900] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:45:04 2022] PUT /identity/v3/projects/a30a46f8463a47faa70d408d7b9a22db/users/e754ea19ac704d2ea308aacc78826c40/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:45:04.458462 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1229a2-bfea-4de3-b82e-b4d321bcdb2d None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:04.459071 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1229a2-bfea-4de3-b82e-b4d321bcdb2d None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:04.459071 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1229a2-bfea-4de3-b82e-b4d321bcdb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:04.491812 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-9d1229a2-bfea-4de3-b82e-b4d321bcdb2d None None] MFA Rules not processed for user `e754ea19ac704d2ea308aacc78826c40`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:45:04.493046 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-9d1229a2-bfea-4de3-b82e-b4d321bcdb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:04.580282 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1444/2901] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:45:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:45:04.585143 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b23c3-71d3-4686-bf63-1d2baa9caf08 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:04.625439 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:45:04.673732 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b23c3-71d3-4686-bf63-1d2baa9caf08 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:04.678757 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b9947-d893-4220-ad2b-beeccd9f82d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:04.679303 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b9947-d893-4220-ad2b-beeccd9f82d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:04.679578 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b9947-d893-4220-ad2b-beeccd9f82d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:04.679881 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b9947-d893-4220-ad2b-beeccd9f82d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:04.680531 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b9947-d893-4220-ad2b-beeccd9f82d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:04.682460 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b9947-d893-4220-ad2b-beeccd9f82d4 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:04.712433 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1458/2902] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:45:04 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:45:04.716766 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1229a2-bfea-4de3-b82e-b4d321bcdb2d None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:04.729376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1229a2-bfea-4de3-b82e-b4d321bcdb2d None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:04.794893 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bc99a-449b-46e4-b512-9d6ff4045379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:04.795517 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bc99a-449b-46e4-b512-9d6ff4045379 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:04.795804 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bc99a-449b-46e4-b512-9d6ff4045379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:04.796070 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bc99a-449b-46e4-b512-9d6ff4045379 admin admin] PATH_INFO: `/v3/users` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:04.796723 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bc99a-449b-46e4-b512-9d6ff4045379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:04.798694 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bc99a-449b-46e4-b512-9d6ff4045379 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:04.823384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1445/2903] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:45:04 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:45:04.828601 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b9947-d893-4220-ad2b-beeccd9f82d4 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:04.839175 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b9947-d893-4220-ad2b-beeccd9f82d4 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:04.845564 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa96bc-8403-4b8b-b49d-8137b5dc3831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:04.846191 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa96bc-8403-4b8b-b49d-8137b5dc3831 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:04.846467 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa96bc-8403-4b8b-b49d-8137b5dc3831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:04.846892 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa96bc-8403-4b8b-b49d-8137b5dc3831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:04.847562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa96bc-8403-4b8b-b49d-8137b5dc3831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:04.849342 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa96bc-8403-4b8b-b49d-8137b5dc3831 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:04.861579 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1459/2904] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:45:04.869738 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bc99a-449b-46e4-b512-9d6ff4045379 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:04.882857 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bc99a-449b-46e4-b512-9d6ff4045379 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:04.889857 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbaa96-be43-492e-80ea-48514ccfb2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:04.890879 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbaa96-be43-492e-80ea-48514ccfb2f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:04.891321 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbaa96-be43-492e-80ea-48514ccfb2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:04.891887 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbaa96-be43-492e-80ea-48514ccfb2f9 admin admin] PATH_INFO: `/v3/projects/d8af3fb629f1408492bfb8713e5fb403/users/d69073df682d4daeb501cbd77dfc17cb/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:04.916837 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbaa96-be43-492e-80ea-48514ccfb2f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8af3fb629f1408492bfb8713e5fb403, user_id=d69073df682d4daeb501cbd77dfc17cb, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:04.922008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbaa96-be43-492e-80ea-48514ccfb2f9 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:04.942649 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1446/2905] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:45:04 2022] PUT /identity/v3/projects/d8af3fb629f1408492bfb8713e5fb403/users/d69073df682d4daeb501cbd77dfc17cb/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:45:04.947297 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa96bc-8403-4b8b-b49d-8137b5dc3831 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:04.957748 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa96bc-8403-4b8b-b49d-8137b5dc3831 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:05.018492 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787cdb2-5f2e-4493-b01f-7af49116c8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:05.019107 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787cdb2-5f2e-4493-b01f-7af49116c8bc admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:05.019385 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787cdb2-5f2e-4493-b01f-7af49116c8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:05.019651 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787cdb2-5f2e-4493-b01f-7af49116c8bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:05.020402 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787cdb2-5f2e-4493-b01f-7af49116c8bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:05.021995 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787cdb2-5f2e-4493-b01f-7af49116c8bc admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:05.032696 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1460/2906] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:45:05.037430 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbaa96-be43-492e-80ea-48514ccfb2f9 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:05.049003 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbaa96-be43-492e-80ea-48514ccfb2f9 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:05.053650 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78709d3f-51fd-4a7a-b3f4-9d84d2db7051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:05.054310 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78709d3f-51fd-4a7a-b3f4-9d84d2db7051 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:05.054590 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78709d3f-51fd-4a7a-b3f4-9d84d2db7051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:05.054858 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78709d3f-51fd-4a7a-b3f4-9d84d2db7051 admin admin] PATH_INFO: `/v3/projects/d8af3fb629f1408492bfb8713e5fb403/users/d69073df682d4daeb501cbd77dfc17cb/roles/a16b6daeda5b4a67992f3c12514ca90e` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:05.056815 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78709d3f-51fd-4a7a-b3f4-9d84d2db7051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8af3fb629f1408492bfb8713e5fb403, user_id=d69073df682d4daeb501cbd77dfc17cb, role_id=a16b6daeda5b4a67992f3c12514ca90e)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:05.060034 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78709d3f-51fd-4a7a-b3f4-9d84d2db7051 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:05.071558 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1447/2907] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:45:05 2022] PUT /identity/v3/projects/d8af3fb629f1408492bfb8713e5fb403/users/d69073df682d4daeb501cbd77dfc17cb/roles/a16b6daeda5b4a67992f3c12514ca90e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:45:05.082332 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30bb93-fdfd-4cbb-b07c-d1564c8d475a None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:05.082619 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30bb93-fdfd-4cbb-b07c-d1564c8d475a None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:05.082898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30bb93-fdfd-4cbb-b07c-d1564c8d475a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:05.117450 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-7f30bb93-fdfd-4cbb-b07c-d1564c8d475a None None] MFA Rules not processed for user `d69073df682d4daeb501cbd77dfc17cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:45:05.118701 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7f30bb93-fdfd-4cbb-b07c-d1564c8d475a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:05.196902 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1461/2908] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:45:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:45:05.209378 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78709d3f-51fd-4a7a-b3f4-9d84d2db7051 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:05.211168 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-78709d3f-51fd-4a7a-b3f4-9d84d2db7051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:05.218774 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:45:05.281688 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78709d3f-51fd-4a7a-b3f4-9d84d2db7051 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:05.285545 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c043e03-fc6c-489b-adaf-a60b4f024a80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:05.286177 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c043e03-fc6c-489b-adaf-a60b4f024a80 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:05.286454 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c043e03-fc6c-489b-adaf-a60b4f024a80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:05.286725 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c043e03-fc6c-489b-adaf-a60b4f024a80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:05.364473 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c043e03-fc6c-489b-adaf-a60b4f024a80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:05.366025 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c043e03-fc6c-489b-adaf-a60b4f024a80 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:05.383160 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1448/2909] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:45:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:45:06.959466 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30bb93-fdfd-4cbb-b07c-d1564c8d475a None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:06.961669 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-7f30bb93-fdfd-4cbb-b07c-d1564c8d475a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:06.975921 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30bb93-fdfd-4cbb-b07c-d1564c8d475a None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:06.979546 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9343378-400a-474e-903a-e88cbf1625c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:06.980214 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9343378-400a-474e-903a-e88cbf1625c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:06.980491 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9343378-400a-474e-903a-e88cbf1625c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:06.980763 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9343378-400a-474e-903a-e88cbf1625c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:07.002163 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:45:07.046998 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9343378-400a-474e-903a-e88cbf1625c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:07.048496 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9343378-400a-474e-903a-e88cbf1625c8 service cinder] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:07.058361 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1462/2910] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:45:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:45:07.681310 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c043e03-fc6c-489b-adaf-a60b4f024a80 service cinder] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:07.691492 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c043e03-fc6c-489b-adaf-a60b4f024a80 service cinder] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:07.695628 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e638cb-134a-4ffb-a729-1792fc248ea3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:07.696269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e638cb-134a-4ffb-a729-1792fc248ea3 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:07.696545 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e638cb-134a-4ffb-a729-1792fc248ea3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:07.696813 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e638cb-134a-4ffb-a729-1792fc248ea3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:07.707529 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e638cb-134a-4ffb-a729-1792fc248ea3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:07.709465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e638cb-134a-4ffb-a729-1792fc248ea3 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:07.720725 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1449/2911] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:45:07 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:45:11.745401 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9343378-400a-474e-903a-e88cbf1625c8 service cinder] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:11.823140 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9343378-400a-474e-903a-e88cbf1625c8 service cinder] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:11.828396 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45660c-2a94-4dcc-9b13-3b0f4bc7e7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:11.829048 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45660c-2a94-4dcc-9b13-3b0f4bc7e7d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:11.829323 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45660c-2a94-4dcc-9b13-3b0f4bc7e7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:11.829586 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45660c-2a94-4dcc-9b13-3b0f4bc7e7d6 admin admin] PATH_INFO: `/v3/users/fd365f0e8fcf4b08b93b714f2c7bbcc4` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:11.830774 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45660c-2a94-4dcc-9b13-3b0f4bc7e7d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd365f0e8fcf4b08b93b714f2c7bbcc4)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:11.832725 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45660c-2a94-4dcc-9b13-3b0f4bc7e7d6 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:11.893662 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0c45660c-2a94-4dcc-9b13-3b0f4bc7e7d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd365f0e8fcf4b08b93b714f2c7bbcc4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:11.894395 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0c45660c-2a94-4dcc-9b13-3b0f4bc7e7d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd365f0e8fcf4b08b93b714f2c7bbcc4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:11.904975 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0c45660c-2a94-4dcc-9b13-3b0f4bc7e7d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd365f0e8fcf4b08b93b714f2c7bbcc4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:11.918155 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0c45660c-2a94-4dcc-9b13-3b0f4bc7e7d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd365f0e8fcf4b08b93b714f2c7bbcc4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:11.926955 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-0c45660c-2a94-4dcc-9b13-3b0f4bc7e7d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd365f0e8fcf4b08b93b714f2c7bbcc4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:11.933414 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1463/2912] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:45:11 2022] DELETE /identity/v3/users/fd365f0e8fcf4b08b93b714f2c7bbcc4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:45:11.940856 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36dbd7d-df4b-4f53-bcea-94ae99a1a4f1 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:11.941461 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36dbd7d-df4b-4f53-bcea-94ae99a1a4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:11.941812 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36dbd7d-df4b-4f53-bcea-94ae99a1a4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:11.973086 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-f36dbd7d-df4b-4f53-bcea-94ae99a1a4f1 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:45:11.974980 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f36dbd7d-df4b-4f53-bcea-94ae99a1a4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:12.058971 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1450/2913] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:45:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:45:12.070753 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45660c-2a94-4dcc-9b13-3b0f4bc7e7d6 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:12.072296 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-0c45660c-2a94-4dcc-9b13-3b0f4bc7e7d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:12.126549 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:45:12.145257 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45660c-2a94-4dcc-9b13-3b0f4bc7e7d6 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:12.148993 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293496d6-8ec4-40d1-a85b-ca941036e59a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:12.149624 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293496d6-8ec4-40d1-a85b-ca941036e59a service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:12.149898 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293496d6-8ec4-40d1-a85b-ca941036e59a service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:12.150175 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293496d6-8ec4-40d1-a85b-ca941036e59a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:12.161066 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293496d6-8ec4-40d1-a85b-ca941036e59a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:12.162511 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293496d6-8ec4-40d1-a85b-ca941036e59a service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:12.172987 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1464/2914] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:45:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:45:12.501464 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36dbd7d-df4b-4f53-bcea-94ae99a1a4f1 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:12.503056 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-f36dbd7d-df4b-4f53-bcea-94ae99a1a4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:12.517631 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36dbd7d-df4b-4f53-bcea-94ae99a1a4f1 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:12.524292 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b07921-00c9-4bbc-9e05-bd4684217c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:12.525036 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b07921-00c9-4bbc-9e05-bd4684217c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:12.525400 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b07921-00c9-4bbc-9e05-bd4684217c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:12.525736 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b07921-00c9-4bbc-9e05-bd4684217c93 admin admin] PATH_INFO: `/v3/projects/33d43db2933d45df8725e316ad411fb4` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:12.527008 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b07921-00c9-4bbc-9e05-bd4684217c93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33d43db2933d45df8725e316ad411fb4)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:12.529720 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b07921-00c9-4bbc-9e05-bd4684217c93 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:12.594741 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:45:12.607416 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-18b07921-00c9-4bbc-9e05-bd4684217c93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33d43db2933d45df8725e316ad411fb4', 'request_id': 'req-18b07921-00c9-4bbc-9e05-bd4684217c93'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:12.614509 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-18b07921-00c9-4bbc-9e05-bd4684217c93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33d43db2933d45df8725e316ad411fb4', 'request_id': 'req-18b07921-00c9-4bbc-9e05-bd4684217c93'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:12.623945 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-18b07921-00c9-4bbc-9e05-bd4684217c93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33d43db2933d45df8725e316ad411fb4', 'request_id': 'req-18b07921-00c9-4bbc-9e05-bd4684217c93'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:12.636063 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-18b07921-00c9-4bbc-9e05-bd4684217c93 admin admin] The token cache is being invalidate because project 33d43db2933d45df8725e316ad411fb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:45:12.636376 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-18b07921-00c9-4bbc-9e05-bd4684217c93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:12.637011 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-18b07921-00c9-4bbc-9e05-bd4684217c93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:12.638755 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1451/2915] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:45:12 2022] DELETE /identity/v3/projects/33d43db2933d45df8725e316ad411fb4 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:45:12.643007 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293496d6-8ec4-40d1-a85b-ca941036e59a service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:12.660105 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293496d6-8ec4-40d1-a85b-ca941036e59a service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:12.734772 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fd080-e348-4cc7-b55f-ba63c2407d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:12.735502 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fd080-e348-4cc7-b55f-ba63c2407d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:12.735841 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fd080-e348-4cc7-b55f-ba63c2407d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:12.736087 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fd080-e348-4cc7-b55f-ba63c2407d2a admin admin] PATH_INFO: `/v3/users/e754ea19ac704d2ea308aacc78826c40` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:12.737352 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fd080-e348-4cc7-b55f-ba63c2407d2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e754ea19ac704d2ea308aacc78826c40)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:12.739338 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fd080-e348-4cc7-b55f-ba63c2407d2a admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:12.805875 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b71fd080-e348-4cc7-b55f-ba63c2407d2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e754ea19ac704d2ea308aacc78826c40'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:12.806551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b71fd080-e348-4cc7-b55f-ba63c2407d2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e754ea19ac704d2ea308aacc78826c40'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:12.815562 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b71fd080-e348-4cc7-b55f-ba63c2407d2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e754ea19ac704d2ea308aacc78826c40'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:12.831044 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b71fd080-e348-4cc7-b55f-ba63c2407d2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e754ea19ac704d2ea308aacc78826c40'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:12.838170 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-b71fd080-e348-4cc7-b55f-ba63c2407d2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e754ea19ac704d2ea308aacc78826c40'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:12.845903 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1465/2916] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:45:12 2022] DELETE /identity/v3/users/e754ea19ac704d2ea308aacc78826c40 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:45:13.160688 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b07921-00c9-4bbc-9e05-bd4684217c93 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:13.162198 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-18b07921-00c9-4bbc-9e05-bd4684217c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:13.179861 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b07921-00c9-4bbc-9e05-bd4684217c93 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:13.239083 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c575964-ef0d-4716-b719-2572f31513d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:13.239750 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c575964-ef0d-4716-b719-2572f31513d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:13.240037 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c575964-ef0d-4716-b719-2572f31513d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:13.240311 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c575964-ef0d-4716-b719-2572f31513d8 admin admin] PATH_INFO: `/v3/projects/a30a46f8463a47faa70d408d7b9a22db` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:13.241441 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c575964-ef0d-4716-b719-2572f31513d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a30a46f8463a47faa70d408d7b9a22db)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:13.243363 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c575964-ef0d-4716-b719-2572f31513d8 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:13.291990 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-3c575964-ef0d-4716-b719-2572f31513d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a30a46f8463a47faa70d408d7b9a22db', 'request_id': 'req-3c575964-ef0d-4716-b719-2572f31513d8'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:13.298834 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-3c575964-ef0d-4716-b719-2572f31513d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a30a46f8463a47faa70d408d7b9a22db', 'request_id': 'req-3c575964-ef0d-4716-b719-2572f31513d8'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:13.306223 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-3c575964-ef0d-4716-b719-2572f31513d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a30a46f8463a47faa70d408d7b9a22db', 'request_id': 'req-3c575964-ef0d-4716-b719-2572f31513d8'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:13.317683 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-3c575964-ef0d-4716-b719-2572f31513d8 admin admin] The token cache is being invalidate because project a30a46f8463a47faa70d408d7b9a22db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:45:13.317974 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-3c575964-ef0d-4716-b719-2572f31513d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:13.318621 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-3c575964-ef0d-4716-b719-2572f31513d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:13.320409 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1452/2917] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:45:13 2022] DELETE /identity/v3/projects/a30a46f8463a47faa70d408d7b9a22db => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:45:13.324714 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fd080-e348-4cc7-b55f-ba63c2407d2a admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:13.326110 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b71fd080-e348-4cc7-b55f-ba63c2407d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:13.339134 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fd080-e348-4cc7-b55f-ba63c2407d2a admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:13.397790 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619b1e6-07ea-4857-a03c-c608ed4ccdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:13.398453 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619b1e6-07ea-4857-a03c-c608ed4ccdbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:13.398724 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619b1e6-07ea-4857-a03c-c608ed4ccdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:13.398987 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619b1e6-07ea-4857-a03c-c608ed4ccdbc admin admin] PATH_INFO: `/v3/users/d69073df682d4daeb501cbd77dfc17cb` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:13.400142 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619b1e6-07ea-4857-a03c-c608ed4ccdbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d69073df682d4daeb501cbd77dfc17cb)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:13.402048 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619b1e6-07ea-4857-a03c-c608ed4ccdbc admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:13.405283 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:45:13.462505 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2619b1e6-07ea-4857-a03c-c608ed4ccdbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd69073df682d4daeb501cbd77dfc17cb'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:13.463195 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2619b1e6-07ea-4857-a03c-c608ed4ccdbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd69073df682d4daeb501cbd77dfc17cb'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:13.472163 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2619b1e6-07ea-4857-a03c-c608ed4ccdbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd69073df682d4daeb501cbd77dfc17cb'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:13.486475 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2619b1e6-07ea-4857-a03c-c608ed4ccdbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd69073df682d4daeb501cbd77dfc17cb'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:13.493716 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-2619b1e6-07ea-4857-a03c-c608ed4ccdbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd69073df682d4daeb501cbd77dfc17cb'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:13.499786 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1466/2918] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:45:13 2022] DELETE /identity/v3/users/d69073df682d4daeb501cbd77dfc17cb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:45:13.804661 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c575964-ef0d-4716-b719-2572f31513d8 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:13.806544 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-3c575964-ef0d-4716-b719-2572f31513d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:13.821768 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c575964-ef0d-4716-b719-2572f31513d8 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:13.888295 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f52f2d-a848-4058-863a-e514d53a8add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:13.888943 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f52f2d-a848-4058-863a-e514d53a8add admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:13.889219 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f52f2d-a848-4058-863a-e514d53a8add admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:13.889492 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f52f2d-a848-4058-863a-e514d53a8add admin admin] PATH_INFO: `/v3/projects/d8af3fb629f1408492bfb8713e5fb403` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:13.890643 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f52f2d-a848-4058-863a-e514d53a8add admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8af3fb629f1408492bfb8713e5fb403)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:13.892593 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f52f2d-a848-4058-863a-e514d53a8add admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:13.894203 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:45:13.945211 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-46f52f2d-a848-4058-863a-e514d53a8add admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8af3fb629f1408492bfb8713e5fb403', 'request_id': 'req-46f52f2d-a848-4058-863a-e514d53a8add'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:13.951992 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-46f52f2d-a848-4058-863a-e514d53a8add admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8af3fb629f1408492bfb8713e5fb403', 'request_id': 'req-46f52f2d-a848-4058-863a-e514d53a8add'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:13.960457 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-46f52f2d-a848-4058-863a-e514d53a8add admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8af3fb629f1408492bfb8713e5fb403', 'request_id': 'req-46f52f2d-a848-4058-863a-e514d53a8add'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:13.973095 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-46f52f2d-a848-4058-863a-e514d53a8add admin admin] The token cache is being invalidate because project d8af3fb629f1408492bfb8713e5fb403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:45:13.973384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-46f52f2d-a848-4058-863a-e514d53a8add admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:13.974055 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-46f52f2d-a848-4058-863a-e514d53a8add admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:13.975537 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1453/2919] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:45:13 2022] DELETE /identity/v3/projects/d8af3fb629f1408492bfb8713e5fb403 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:45:13.980688 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f4d6c-2fa9-4647-9382-699281e8c8ea None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:13.981360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f4d6c-2fa9-4647-9382-699281e8c8ea None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:13.981360 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f4d6c-2fa9-4647-9382-699281e8c8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:14.002552 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-dc9f4d6c-2fa9-4647-9382-699281e8c8ea None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:45:14.003671 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-dc9f4d6c-2fa9-4647-9382-699281e8c8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:14.070460 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1467/2920] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:45:14.080917 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052620d-2912-4f07-a580-67eb46037fdc None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:14.081214 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052620d-2912-4f07-a580-67eb46037fdc None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:14.081486 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052620d-2912-4f07-a580-67eb46037fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:14.102674 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-c052620d-2912-4f07-a580-67eb46037fdc None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:45:14.103919 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-c052620d-2912-4f07-a580-67eb46037fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:14.112246 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1454/2921] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:45:14.116738 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f4d6c-2fa9-4647-9382-699281e8c8ea None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:14.127161 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f4d6c-2fa9-4647-9382-699281e8c8ea None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:14.132016 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce352f-5d4a-4496-bc7b-90cef0380a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:14.132628 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce352f-5d4a-4496-bc7b-90cef0380a08 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:14.132913 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce352f-5d4a-4496-bc7b-90cef0380a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:14.133187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce352f-5d4a-4496-bc7b-90cef0380a08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:14.133840 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce352f-5d4a-4496-bc7b-90cef0380a08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:45:14.134144 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce352f-5d4a-4496-bc7b-90cef0380a08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:14.135751 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce352f-5d4a-4496-bc7b-90cef0380a08 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:14.148384 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1468/2922] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:45:14.153058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052620d-2912-4f07-a580-67eb46037fdc None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:14.162748 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052620d-2912-4f07-a580-67eb46037fdc None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:14.167791 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512c459-e381-4bba-9a39-c810faf4d78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:14.168450 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512c459-e381-4bba-9a39-c810faf4d78e admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:14.168829 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512c459-e381-4bba-9a39-c810faf4d78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:14.169169 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512c459-e381-4bba-9a39-c810faf4d78e admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:14.169898 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512c459-e381-4bba-9a39-c810faf4d78e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:14.171868 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512c459-e381-4bba-9a39-c810faf4d78e admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:14.204011 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1455/2923] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:45:14 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:45:14.208319 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce352f-5d4a-4496-bc7b-90cef0380a08 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:14.219736 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce352f-5d4a-4496-bc7b-90cef0380a08 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:14.278850 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3c341-7c7f-4abb-af74-febe8cbeda96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:14.279368 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3c341-7c7f-4abb-af74-febe8cbeda96 admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:14.279639 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3c341-7c7f-4abb-af74-febe8cbeda96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:14.279934 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3c341-7c7f-4abb-af74-febe8cbeda96 admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:14.280599 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3c341-7c7f-4abb-af74-febe8cbeda96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:14.283178 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3c341-7c7f-4abb-af74-febe8cbeda96 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:14.299057 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:45:14.305401 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1469/2924] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:45:14 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:45:14.310465 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512c459-e381-4bba-9a39-c810faf4d78e admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:14.320813 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512c459-e381-4bba-9a39-c810faf4d78e admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:14.325910 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0996f9-ad42-4b9e-bdcb-2386e044d415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:14.326500 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0996f9-ad42-4b9e-bdcb-2386e044d415 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:14.326783 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0996f9-ad42-4b9e-bdcb-2386e044d415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:14.327048 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0996f9-ad42-4b9e-bdcb-2386e044d415 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:14.327675 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0996f9-ad42-4b9e-bdcb-2386e044d415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:14.329286 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0996f9-ad42-4b9e-bdcb-2386e044d415 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:14.339108 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1456/2925] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:45:14.343334 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3c341-7c7f-4abb-af74-febe8cbeda96 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:14.353357 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3c341-7c7f-4abb-af74-febe8cbeda96 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:14.358251 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f467ae8-935a-4292-bc6c-ccd37c1e3c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:14.358855 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f467ae8-935a-4292-bc6c-ccd37c1e3c86 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:14.359130 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f467ae8-935a-4292-bc6c-ccd37c1e3c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:14.359401 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f467ae8-935a-4292-bc6c-ccd37c1e3c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:14.360074 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f467ae8-935a-4292-bc6c-ccd37c1e3c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:14.361678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f467ae8-935a-4292-bc6c-ccd37c1e3c86 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:14.373356 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1470/2926] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:45:14.377703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0996f9-ad42-4b9e-bdcb-2386e044d415 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:14.388784 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0996f9-ad42-4b9e-bdcb-2386e044d415 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:14.393372 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf6262-cb3f-4ca6-b554-d0e1c1cfcc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:14.394011 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf6262-cb3f-4ca6-b554-d0e1c1cfcc22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:14.394289 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf6262-cb3f-4ca6-b554-d0e1c1cfcc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:14.394583 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf6262-cb3f-4ca6-b554-d0e1c1cfcc22 admin admin] PATH_INFO: `/v3/projects/e662102424224a8f902a3a1935b6f3be/users/55374513418e4f25922839bf4e7c9e4c/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:14.409986 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf6262-cb3f-4ca6-b554-d0e1c1cfcc22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e662102424224a8f902a3a1935b6f3be, user_id=55374513418e4f25922839bf4e7c9e4c, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:14.412636 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf6262-cb3f-4ca6-b554-d0e1c1cfcc22 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:14.426660 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1457/2927] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:45:14 2022] PUT /identity/v3/projects/e662102424224a8f902a3a1935b6f3be/users/55374513418e4f25922839bf4e7c9e4c/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:45:14.438457 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc2ad5-f97e-43c1-84b5-5a95a604c5cf None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:14.438749 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc2ad5-f97e-43c1-84b5-5a95a604c5cf None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:14.439021 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc2ad5-f97e-43c1-84b5-5a95a604c5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:14.467630 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-b2dc2ad5-f97e-43c1-84b5-5a95a604c5cf None None] MFA Rules not processed for user `55374513418e4f25922839bf4e7c9e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:45:14.468876 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-b2dc2ad5-f97e-43c1-84b5-5a95a604c5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:14.535169 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1471/2928] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:45:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:45:14.548539 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf6262-cb3f-4ca6-b554-d0e1c1cfcc22 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:14.550799 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-5abf6262-cb3f-4ca6-b554-d0e1c1cfcc22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:14.640900 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf6262-cb3f-4ca6-b554-d0e1c1cfcc22 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:14.644701 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605d1ac-6805-4f00-be2c-7f5aeb66b8c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '289b020c9cd242dca9b512803199daae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:14.645314 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605d1ac-6805-4f00-be2c-7f5aeb66b8c8 service glance] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:14.645592 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605d1ac-6805-4f00-be2c-7f5aeb66b8c8 service glance] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:14.645863 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605d1ac-6805-4f00-be2c-7f5aeb66b8c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:14.655383 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605d1ac-6805-4f00-be2c-7f5aeb66b8c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:14.656871 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605d1ac-6805-4f00-be2c-7f5aeb66b8c8 service glance] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:14.666781 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1458/2929] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:45:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:45:24.531994 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=38 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:45:24.662410 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:45:42.089027 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc2ad5-f97e-43c1-84b5-5a95a604c5cf None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:42.152766 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc2ad5-f97e-43c1-84b5-5a95a604c5cf None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:42.157549 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ed500-4615-43b7-a688-607da0ef8435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:42.158178 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ed500-4615-43b7-a688-607da0ef8435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:42.158457 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ed500-4615-43b7-a688-607da0ef8435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:42.158726 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ed500-4615-43b7-a688-607da0ef8435 admin admin] PATH_INFO: `/v3/users/55374513418e4f25922839bf4e7c9e4c` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:42.159909 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ed500-4615-43b7-a688-607da0ef8435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55374513418e4f25922839bf4e7c9e4c)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:42.161819 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ed500-4615-43b7-a688-607da0ef8435 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:42.212495 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5c1ed500-4615-43b7-a688-607da0ef8435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55374513418e4f25922839bf4e7c9e4c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:42.213160 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5c1ed500-4615-43b7-a688-607da0ef8435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55374513418e4f25922839bf4e7c9e4c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:42.220677 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5c1ed500-4615-43b7-a688-607da0ef8435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55374513418e4f25922839bf4e7c9e4c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:42.233946 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5c1ed500-4615-43b7-a688-607da0ef8435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55374513418e4f25922839bf4e7c9e4c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:42.241751 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-5c1ed500-4615-43b7-a688-607da0ef8435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55374513418e4f25922839bf4e7c9e4c'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:42.249042 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1472/2930] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:45:42 2022] DELETE /identity/v3/users/55374513418e4f25922839bf4e7c9e4c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:45:42.253721 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e661f-4e88-43c2-bcb7-11f3bdc13a8b None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:42.254211 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e661f-4e88-43c2-bcb7-11f3bdc13a8b None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:42.254312 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e661f-4e88-43c2-bcb7-11f3bdc13a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:42.275080 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-9c1e661f-4e88-43c2-bcb7-11f3bdc13a8b None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:45:42.277260 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-9c1e661f-4e88-43c2-bcb7-11f3bdc13a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:42.344553 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1459/2931] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:45:42.354405 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ed500-4615-43b7-a688-607da0ef8435 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:42.355842 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-5c1ed500-4615-43b7-a688-607da0ef8435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:42.413867 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ed500-4615-43b7-a688-607da0ef8435 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:42.417626 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d6cf7-dfaf-493f-b665-4557b01f9c42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:42.418319 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d6cf7-dfaf-493f-b665-4557b01f9c42 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:42.418603 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d6cf7-dfaf-493f-b665-4557b01f9c42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:42.418872 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d6cf7-dfaf-493f-b665-4557b01f9c42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:42.429008 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d6cf7-dfaf-493f-b665-4557b01f9c42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:42.430432 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d6cf7-dfaf-493f-b665-4557b01f9c42 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:42.440678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1473/2932] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:45:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:45:42.720313 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e661f-4e88-43c2-bcb7-11f3bdc13a8b None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:42.721882 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-9c1e661f-4e88-43c2-bcb7-11f3bdc13a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:42.734779 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e661f-4e88-43c2-bcb7-11f3bdc13a8b None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:42.739375 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f9d1f-52d5-466f-a4f8-bb10b8f3afe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:42.740041 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f9d1f-52d5-466f-a4f8-bb10b8f3afe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:42.740324 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f9d1f-52d5-466f-a4f8-bb10b8f3afe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:42.740600 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f9d1f-52d5-466f-a4f8-bb10b8f3afe3 admin admin] PATH_INFO: `/v3/projects/e662102424224a8f902a3a1935b6f3be` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:42.741736 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f9d1f-52d5-466f-a4f8-bb10b8f3afe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e662102424224a8f902a3a1935b6f3be)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:42.743781 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f9d1f-52d5-466f-a4f8-bb10b8f3afe3 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:42.793400 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ba0f9d1f-52d5-466f-a4f8-bb10b8f3afe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e662102424224a8f902a3a1935b6f3be', 'request_id': 'req-ba0f9d1f-52d5-466f-a4f8-bb10b8f3afe3'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:42.800381 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ba0f9d1f-52d5-466f-a4f8-bb10b8f3afe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e662102424224a8f902a3a1935b6f3be', 'request_id': 'req-ba0f9d1f-52d5-466f-a4f8-bb10b8f3afe3'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:42.807959 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ba0f9d1f-52d5-466f-a4f8-bb10b8f3afe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e662102424224a8f902a3a1935b6f3be', 'request_id': 'req-ba0f9d1f-52d5-466f-a4f8-bb10b8f3afe3'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:42.818862 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ba0f9d1f-52d5-466f-a4f8-bb10b8f3afe3 admin admin] The token cache is being invalidate because project e662102424224a8f902a3a1935b6f3be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:45:42.819151 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ba0f9d1f-52d5-466f-a4f8-bb10b8f3afe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:42.819822 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-ba0f9d1f-52d5-466f-a4f8-bb10b8f3afe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:42.821550 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1460/2933] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:45:42 2022] DELETE /identity/v3/projects/e662102424224a8f902a3a1935b6f3be => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:45:42.826770 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4448a9-462b-4c97-8a46-ca8052585903 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:42.827056 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4448a9-462b-4c97-8a46-ca8052585903 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:42.827333 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4448a9-462b-4c97-8a46-ca8052585903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:42.849126 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-ef4448a9-462b-4c97-8a46-ca8052585903 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:45:42.850349 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ef4448a9-462b-4c97-8a46-ca8052585903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:42.868875 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:45:42.914560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1474/2934] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:45:42.924730 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d9676-2d3c-4c65-9e5e-cf496a4e9af0 None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:42.925058 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d9676-2d3c-4c65-9e5e-cf496a4e9af0 None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:42.925337 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d9676-2d3c-4c65-9e5e-cf496a4e9af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:42.945173 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-be0d9676-2d3c-4c65-9e5e-cf496a4e9af0 None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:45:42.946369 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-be0d9676-2d3c-4c65-9e5e-cf496a4e9af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:42.954802 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1461/2935] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:45:42.959061 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4448a9-462b-4c97-8a46-ca8052585903 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:42.969451 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4448a9-462b-4c97-8a46-ca8052585903 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:42.973973 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdb663-3b96-4b72-bc61-488060d715d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:42.974560 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdb663-3b96-4b72-bc61-488060d715d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:42.974833 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdb663-3b96-4b72-bc61-488060d715d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:42.975097 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdb663-3b96-4b72-bc61-488060d715d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:42.975752 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdb663-3b96-4b72-bc61-488060d715d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 14:45:42.976053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdb663-3b96-4b72-bc61-488060d715d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:42.977614 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdb663-3b96-4b72-bc61-488060d715d5 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:42.989053 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1475/2936] 10.222.0.62 () {58 vars in 1153 bytes} [Tue Oct 4 14:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 14:45:42.993269 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d9676-2d3c-4c65-9e5e-cf496a4e9af0 None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:43.002722 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d9676-2d3c-4c65-9e5e-cf496a4e9af0 None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:43.008352 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b8752-fce1-4601-b17c-b7019b9a6436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:43.009016 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b8752-fce1-4601-b17c-b7019b9a6436 admin admin] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:43.009343 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b8752-fce1-4601-b17c-b7019b9a6436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:43.009620 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b8752-fce1-4601-b17c-b7019b9a6436 admin admin] PATH_INFO: `/v3/projects` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:43.010304 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b8752-fce1-4601-b17c-b7019b9a6436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:43.012746 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b8752-fce1-4601-b17c-b7019b9a6436 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:43.044848 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1462/2937] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Oct 4 14:45:42 2022] POST /identity/v3/projects => generated 397 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 14:45:43.047241 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdb663-3b96-4b72-bc61-488060d715d5 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:43.057187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdb663-3b96-4b72-bc61-488060d715d5 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:43.114638 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b371fb7-ecb3-4fae-9118-6da0e6d5430e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:43.115349 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b371fb7-ecb3-4fae-9118-6da0e6d5430e admin admin] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:43.115551 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b371fb7-ecb3-4fae-9118-6da0e6d5430e admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:43.115820 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b371fb7-ecb3-4fae-9118-6da0e6d5430e admin admin] PATH_INFO: `/v3/users` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:43.116450 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b371fb7-ecb3-4fae-9118-6da0e6d5430e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:43.118361 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b371fb7-ecb3-4fae-9118-6da0e6d5430e admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:43.140725 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1476/2938] 10.222.0.62 () {60 vars in 1144 bytes} [Tue Oct 4 14:45:43 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 14:45:43.144788 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b8752-fce1-4601-b17c-b7019b9a6436 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:43.155703 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b8752-fce1-4601-b17c-b7019b9a6436 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:43.160495 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aeb70f-d391-40c9-ae38-05b590972688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:43.161092 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeb70f-d391-40c9-ae38-05b590972688 admin admin] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:43.161371 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeb70f-d391-40c9-ae38-05b590972688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:43.161643 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeb70f-d391-40c9-ae38-05b590972688 admin admin] PATH_INFO: `/v3/roles` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:43.162283 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aeb70f-d391-40c9-ae38-05b590972688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:43.163945 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aeb70f-d391-40c9-ae38-05b590972688 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:43.173876 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1463/2939] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:45:43.177678 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b371fb7-ecb3-4fae-9118-6da0e6d5430e admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:43.187509 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b371fb7-ecb3-4fae-9118-6da0e6d5430e admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:43.192166 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7931c15-339e-40e7-ad23-5a738f44a2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:43.192765 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7931c15-339e-40e7-ad23-5a738f44a2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:43.193049 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7931c15-339e-40e7-ad23-5a738f44a2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:43.193319 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7931c15-339e-40e7-ad23-5a738f44a2b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:43.193959 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7931c15-339e-40e7-ad23-5a738f44a2b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:43.196139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7931c15-339e-40e7-ad23-5a738f44a2b7 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:43.208587 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1477/2940] 10.222.0.62 () {58 vars in 1122 bytes} [Tue Oct 4 14:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 14:45:43.212744 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aeb70f-d391-40c9-ae38-05b590972688 admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:43.224110 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aeb70f-d391-40c9-ae38-05b590972688 admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:43.228916 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b78ee4-c227-485e-93f6-e451c85f462d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:43.229580 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b78ee4-c227-485e-93f6-e451c85f462d admin admin] REQUEST_METHOD: `PUT` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:43.229862 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b78ee4-c227-485e-93f6-e451c85f462d admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:43.230141 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b78ee4-c227-485e-93f6-e451c85f462d admin admin] PATH_INFO: `/v3/projects/a57dffeb8b864194963340dd8d54de0f/users/1bfcf64e4bf84e1da4356d1cc5c019d4/roles/eb2435bb443d4469899fb3830f4ee5b1` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:43.244962 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b78ee4-c227-485e-93f6-e451c85f462d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a57dffeb8b864194963340dd8d54de0f, user_id=1bfcf64e4bf84e1da4356d1cc5c019d4, role_id=eb2435bb443d4469899fb3830f4ee5b1)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:43.247658 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b78ee4-c227-485e-93f6-e451c85f462d admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:43.261415 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1464/2941] 10.222.0.62 () {60 vars in 1483 bytes} [Tue Oct 4 14:45:43 2022] PUT /identity/v3/projects/a57dffeb8b864194963340dd8d54de0f/users/1bfcf64e4bf84e1da4356d1cc5c019d4/roles/eb2435bb443d4469899fb3830f4ee5b1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 14:45:43.272655 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97b0cc-239d-4575-b3b4-1f27e9d40c70 None None] REQUEST_METHOD: `POST` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:43.273028 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97b0cc-239d-4575-b3b4-1f27e9d40c70 None None] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:43.273380 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97b0cc-239d-4575-b3b4-1f27e9d40c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:43.303046 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.auth.core [None req-6f97b0cc-239d-4575-b3b4-1f27e9d40c70 None None] MFA Rules not processed for user `1bfcf64e4bf84e1da4356d1cc5c019d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:45:43.304307 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-6f97b0cc-239d-4575-b3b4-1f27e9d40c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:43.373976 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1478/2942] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:45:43 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 14:45:43.385335 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b78ee4-c227-485e-93f6-e451c85f462d admin admin] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:43.387040 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-97b78ee4-c227-485e-93f6-e451c85f462d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:43.409821 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:45:43.447307 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b78ee4-c227-485e-93f6-e451c85f462d admin admin] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:43.451786 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8a68c-0328-405c-ad5a-75ac34195122 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5d3bf1c2d944d51a0fd0ff84be1c7e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:43.452390 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8a68c-0328-405c-ad5a-75ac34195122 service cinder] REQUEST_METHOD: `GET` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:43.452669 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8a68c-0328-405c-ad5a-75ac34195122 service cinder] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:43.452942 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8a68c-0328-405c-ad5a-75ac34195122 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:43.461290 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8a68c-0328-405c-ad5a-75ac34195122 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:43.462724 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8a68c-0328-405c-ad5a-75ac34195122 service cinder] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:43.471770 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1465/2943] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:45:43 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:45:48.525187 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97b0cc-239d-4575-b3b4-1f27e9d40c70 None None] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:48.544504 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:45:48.593907 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97b0cc-239d-4575-b3b4-1f27e9d40c70 None None] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:48.599096 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b9d9a-a9f5-4b45-92c9-92cebcccf8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:48.599904 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b9d9a-a9f5-4b45-92c9-92cebcccf8a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:48.600205 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b9d9a-a9f5-4b45-92c9-92cebcccf8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:48.600459 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b9d9a-a9f5-4b45-92c9-92cebcccf8a6 admin admin] PATH_INFO: `/v3/users/1bfcf64e4bf84e1da4356d1cc5c019d4` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:48.601868 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b9d9a-a9f5-4b45-92c9-92cebcccf8a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bfcf64e4bf84e1da4356d1cc5c019d4)` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:48.603860 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b9d9a-a9f5-4b45-92c9-92cebcccf8a6 admin admin] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:48.653362 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-066b9d9a-a9f5-4b45-92c9-92cebcccf8a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bfcf64e4bf84e1da4356d1cc5c019d4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:48.654023 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-066b9d9a-a9f5-4b45-92c9-92cebcccf8a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bfcf64e4bf84e1da4356d1cc5c019d4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:48.662078 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-066b9d9a-a9f5-4b45-92c9-92cebcccf8a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bfcf64e4bf84e1da4356d1cc5c019d4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:48.675628 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-066b9d9a-a9f5-4b45-92c9-92cebcccf8a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bfcf64e4bf84e1da4356d1cc5c019d4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:48.682648 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.notifications [None req-066b9d9a-a9f5-4b45-92c9-92cebcccf8a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bfcf64e4bf84e1da4356d1cc5c019d4'} {{(pid=81467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:48.690386 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1479/2944] 10.222.0.62 () {58 vars in 1224 bytes} [Tue Oct 4 14:45:48 2022] DELETE /identity/v3/users/1bfcf64e4bf84e1da4356d1cc5c019d4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:45:48.694839 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5237381-f2bf-42c2-955e-56aaf999f69f None None] REQUEST_METHOD: `POST` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:48.695574 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5237381-f2bf-42c2-955e-56aaf999f69f None None] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:48.695747 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5237381-f2bf-42c2-955e-56aaf999f69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:48.716489 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.auth.core [None req-b5237381-f2bf-42c2-955e-56aaf999f69f None None] MFA Rules not processed for user `ea10fbfe4b4e4d64acf7b2c318e4a8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 14:45:48.718707 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b5237381-f2bf-42c2-955e-56aaf999f69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:48.781049 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1466/2945] 10.222.0.62 () {58 vars in 958 bytes} [Tue Oct 4 14:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 14:45:48.791001 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b9d9a-a9f5-4b45-92c9-92cebcccf8a6 admin admin] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:48.792456 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-066b9d9a-a9f5-4b45-92c9-92cebcccf8a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:48.855089 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b9d9a-a9f5-4b45-92c9-92cebcccf8a6 admin admin] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:48.858917 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b95bc-7c21-4de3-8859-1522fe594712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624487005e4f4180a9d56a29a7daad1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:48.859804 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b95bc-7c21-4de3-8859-1522fe594712 service neutron] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:48.860079 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b95bc-7c21-4de3-8859-1522fe594712 service neutron] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:48.860351 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b95bc-7c21-4de3-8859-1522fe594712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:48.869914 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b95bc-7c21-4de3-8859-1522fe594712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:48.871384 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b95bc-7c21-4de3-8859-1522fe594712 service neutron] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:48.881389 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1480/2946] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:45:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:45:49.194811 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5237381-f2bf-42c2-955e-56aaf999f69f None None] Authenticating user token {{(pid=81468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:45:49.196550 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.fernet_utils [None req-b5237381-f2bf-42c2-955e-56aaf999f69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:45:49.209881 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5237381-f2bf-42c2-955e-56aaf999f69f None None] Validating token access rules against request {{(pid=81468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:45:49.219524 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f123b1-9edb-48bb-acb8-d895071feac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea10fbfe4b4e4d64acf7b2c318e4a8a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e81a80a6484baf89f76501cdc63799', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:45:49.220409 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f123b1-9edb-48bb-acb8-d895071feac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:45:49.220820 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f123b1-9edb-48bb-acb8-d895071feac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:45:49.221554 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f123b1-9edb-48bb-acb8-d895071feac5 admin admin] PATH_INFO: `/v3/projects/a57dffeb8b864194963340dd8d54de0f` {{(pid=81468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:45:49.223527 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f123b1-9edb-48bb-acb8-d895071feac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a57dffeb8b864194963340dd8d54de0f)` {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:45:49.224557 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f123b1-9edb-48bb-acb8-d895071feac5 admin admin] RBAC: Authorization granted {{(pid=81468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:45:49.281985 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-85f123b1-9edb-48bb-acb8-d895071feac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a57dffeb8b864194963340dd8d54de0f', 'request_id': 'req-85f123b1-9edb-48bb-acb8-d895071feac5'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:49.291105 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-85f123b1-9edb-48bb-acb8-d895071feac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a57dffeb8b864194963340dd8d54de0f', 'request_id': 'req-85f123b1-9edb-48bb-acb8-d895071feac5'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:49.316821 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-85f123b1-9edb-48bb-acb8-d895071feac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a57dffeb8b864194963340dd8d54de0f', 'request_id': 'req-85f123b1-9edb-48bb-acb8-d895071feac5'} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:49.338723 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-85f123b1-9edb-48bb-acb8-d895071feac5 admin admin] The token cache is being invalidate because project a57dffeb8b864194963340dd8d54de0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 14:45:49.339012 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-85f123b1-9edb-48bb-acb8-d895071feac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:49.339795 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG keystone.notifications [None req-85f123b1-9edb-48bb-acb8-d895071feac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 14:45:49.341334 dv-cinder-860260-1-smb devstack@keystone.service[81468]: [pid: 81468|app: 0|req: 1467/2947] 10.222.0.62 () {58 vars in 1233 bytes} [Tue Oct 4 14:45:49 2022] DELETE /identity/v3/projects/a57dffeb8b864194963340dd8d54de0f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 14:45:58.877076 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:45:59.329384 dv-cinder-860260-1-smb devstack@keystone.service[81468]: DEBUG dbcounter [-] [81468] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:48:43.340264 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b95bc-7c21-4de3-8859-1522fe594712 service neutron] Authenticating user token {{(pid=81467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 14:48:43.342410 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-ae1b95bc-7c21-4de3-8859-1522fe594712 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:48:43.514444 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b95bc-7c21-4de3-8859-1522fe594712 service neutron] Validating token access rules against request {{(pid=81467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 14:48:43.590219 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43c949-30c0-4b63-b06d-4bad92ca8506 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f98c07455a241398784d221df273aba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd73ece314ef4f2eabb34e2a88d610ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 14:48:43.590774 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43c949-30c0-4b63-b06d-4bad92ca8506 service placement] REQUEST_METHOD: `GET` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 14:48:43.591043 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43c949-30c0-4b63-b06d-4bad92ca8506 service placement] SCRIPT_NAME: `/identity` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 14:48:43.591310 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43c949-30c0-4b63-b06d-4bad92ca8506 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 14:48:43.593139 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.fernet_utils [None req-1a43c949-30c0-4b63-b06d-4bad92ca8506 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 14:48:43.606078 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43c949-30c0-4b63-b06d-4bad92ca8506 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 14:48:43.607695 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43c949-30c0-4b63-b06d-4bad92ca8506 service placement] RBAC: Authorization granted {{(pid=81467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 14:48:43.619104 dv-cinder-860260-1-smb devstack@keystone.service[81467]: [pid: 81467|app: 0|req: 1481/2948] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Oct 4 14:48:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 14:48:53.614249 dv-cinder-860260-1-smb devstack@keystone.service[81467]: DEBUG dbcounter [-] [81467] Writing DB stats keystone:SELECT=89 {{(pid=81467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}